Key words
CT - physics - QA/QC - technical aspects
Introduction
In the late 1990 s, dedicated cone-beam computed tomography (CBCT) units were introduced
for three-dimensional (3 D) imaging of oral and maxillofacial structures [1]
[2] and are widely used in clinical routine today [3]
[4]
[5]. As a basic principle, they consist of a device rotating circularly that is equipped
with an x-ray source on one side and an image intensifier or a flat-panel detector
on the opposite side [6] in order to acquire projection data for the volume data reconstruction process.
These dental CBCT systems, sometimes labelled as digital volume tomography (DVT) scanners,
feature high isotropic spatial resolution for a small field of view [7] at low dose [8] and with reasonable geometric accuracy [9]. In addition, dental CBCT implies relatively low investment in equipment and floor
space requirement [2]. Consequently, this new technique has found increasing acceptance in dental and
cranio-maxillofacial practice in the fields of image-guided treatment planning, orthodontics
and traumatology [10]
[11]
[12].
As for all medical imaging devices, the overall system performance needs to be checked
on a regular basis. However, to date there is still a lack of transnational consensus
on acceptance and constancy testing for image quality (IQ) and dose of dental CBCT
systems. Only national recommendations related to quality assurance (QA) and testing
of equipment exist but are not generally consistent with one another (e. g. [13]
[14]). This deficiency was recognized by the United States [15] and the European Union [16] with the result that “basic principles” on the use of dental CBCT were established.
Even though a few previous studies [17]
[18]
[19] and special working groups (e. g. SEDENTEXCT project [20]) tried to formulate IQ testing procedures for dental CBCT, there is currently no
consensus on the metrics needed to characterize volumetric dental CBCT system performance
sufficiently in clinical practice. Previous work in the field of establishing QA standards
differs in the amount, complexity, and dimensionality of IQ parameters which have
to be assessed as well as in the method of their determining.
The German Institute for Standardization issued the national standard DIN 6868 – 161
[21] (hereinafter referred to as the DIN standard) related to acceptance testing for
image quality of dental CBCT systems in 2013. As part of this introduction, completely
new IQ metrics were proposed that have not been employed for quality control of clinical
computed tomography (CT) x-ray equipment until now.
The purpose of this work was to implement two procedures for routine QA in dental
CBCT, to validate the reliability of the respective IQ parameters on a clinical scanner,
and to compare these results against each other. We focused on the new DIN standard
and on conventional IQ metrics according to the well-established standard IEC 61 223 – 3-5
[22] in clinical CT (hereinafter referred to as the IEC standard). To allow for automated
assessment of imaging performance, all IQ evaluation methods and phantom-specific
detection algorithms were implemented in a dedicated computer program.
This work did not address to estimating dose in dental CBCT. Using the well-established
CT dose index [6] with the standard 16 cm head phantom appears to be adequate at this point in time.
Materials and Methods
Phantoms
A new DIN-compliant phantom [21] (manufactured by QRM GmbH, Möhrendorf, Germany) is schematically depicted in [Fig. 1]. It consists of four cylindrical phantom sections, each with a diameter of 160 mm
and made of polymethyl methacrylate (PMMA). A polyvinyl chloride (PVC) air test insert
is embedded in the centre of phantom section 3 to determine all desired IQ parameters
as stated by [21].
Fig. 1 Design of the new DIN-compliant phantom [21]. a 3 D rendered sketch of the four phantom sections (all length specifications in mm).
b–e Ideal transverse views of sections 1 – 4 (C = 0 a. u., W = 1000 a. u.).
Abb. 1 Design des neuen, DIN-konformen Prüfkörpers [21]. a 3-D gerenderte Darstellung der vier Phantomsektionen (alle Längenangaben in mm).
b–e Ideale, transversale Schnittbilder der Sektionen 1 – 4 (C = 0 w. E., W = 1000 w. E.).
A modular CT IQ phantom of a previously proposed QA framework [19] (QRM GmbH, Möhrendorf, Germany) was used to measure conventional IQ metrics. Image
noise, uniformity, contrast, and 3 D spatial resolution were assessed [22] by using phantom sections 1 – 3 shown in [Fig. 2]. An optional extension ring of 160 mm in diameter and made of resin was applied
to meet the spatial dimensions of the new DIN-compliant phantom.
Fig. 2 Design of the modular IEC-compliant phantom [19]. 3 D rendered sketch of the complete phantom consisting of five sections a and the optional extension ring b. All length specifications are in mm. c–e Ideal transverse views of sections 1 – 3 evaluated in this study (C = 0 a. u., W = 1000
a. u.).
Abb. 2 Design des modularen, IEC-konformen Prüfkörpers [19]. 3 D gerenderte Darstellung des kompletten, aus fünf Sektionen bestehenden Phantoms
a und des optionalen Erweiterungsringes b. Alle Längenangaben sind in mm. c–e Ideale, transversale Schnittbilder der in dieser Studie ausgewerteten Sektionen 1 – 3
(C = 0 w. E., W = 1000 w. E.).
Assessment of Imaging Performance
Image Quality Parameters According to DIN 6868 – 161
The approximated in-plane modulation transfer function (MTF), the contrast-to-noise
indicator (CNI), and the uniformity indicator (UI*) were determined as stated in [21]. For this, sections 2 and 3 of the new DIN-compliant phantom were positioned in
the x-ray beam in a way that all the relevant test structures were captured by the
detector. In the following, the acceptance test procedure for IQ according to [21] is briefly outlined.
In-plane spatial resolution is assessed by using an approximation procedure. To calculate
the approximated MTF (MTF*), the PVC-air edge of phantom section 3 ([Fig. 1 d]) is analysed. The post-processing of the voxels covered by a rectangular region
of interest (ROI), with an edge length of 5 mm parallel to the edge and an edge length
of 10 mm perpendicular to the edge, is as follows:
-
Row-by-row averaging of voxel profiles parallel to the PVC-air edge to acquire the
edge spread function (ESF).
-
Computation of the line spread function (LSF) by differentiating the ESF profile.
-
Calculation of the MTF* by averaging the moduli of the discrete Fourier-transformed
LSF and the symmetrized LSF profile.
The 50 % (MTF*
50 %) and 10 % MTF* (MTF*
10 %) values were determined from the MTF* curve to allow for characterizing spatial resolution
of the dental CBCT system.
The CNI represents the PVC-PMMA contrast in relation to the averaged noise of the
PVC and PMMA compartment of phantom section 3 ([Fig. 1 d]). In order to collect a representative edge profile, transverse slices of 1 mm thickness
in z-direction were averaged to generate the mean image of the test insert. The pixel
sequences that are in parallel to the PVC-PMMA edge are averaged row by row. Subsequently,
the PVC-PMMA contrast is determined through the first and second derivative of the
edge profile and the noise of the PVC and PMMA compartment is estimated by the standard
deviation of the respective test inserts.
The UI* is defined by the PVC-PMMA contrast normalized to the most dominant non-uniformity
(NUmax) in voxel values of phantom section 2 ([Fig. 1c]). The maximum variation of the mean voxel value measured for one central (
CT
c) and four peripheral ROIs (
CT
p, i) from the average of
CT
c and
CT
p, i (with i = 1, …, 4) corresponds to NUmax. We used circular ROIs, each with a diameter of 16 mm. A distance of 16 mm between
the phantom border and the boundary of the peripheral ROIs was kept.
Conventional Image Quality Parameters
The conventional IQ parameters were determined in accordance with the IEC standard
based on a previously proposed QA framework [19]. The volume data analysis is summarized below. More detailed information on this
procedure can be found in the original paper.
Image noise and uniformity in voxel values were measured using the homogeneous phantom
section 3 ([Fig. 2e]). The standard deviation (σ) was computed for a circular ROI of 40 mm in diameter placed in the phantom centre
to examine the amount of fluctuation in voxel values. The uniformity index (UI) [19] denotes the normalized percent difference between
CT
p, i (with i = 1, …, 4) of the peripheral ROI labelled by i and
CT
c and allows for quantifying uniformity in voxel values. Each of these circular ROIs
had a diameter of 10 mm. The peripheral ROIs were located on a circular trajectory
with a radius of 35 mm and featured an angular step size of 90°.
The contrast-to-noise ratio (CNR) was determined using phantom section 1 ([Fig. 2c]). We investigated the cylindrical medium-contrast insert consisting of 100 mg cm–3 hydroxyapatite (HA100) in relation to a water-equivalent background material. The
CNR is determined as the difference in mean voxel values of a certain target and background
material normalized to the standard deviation for the background material. Therefore,
two cylindrical volumes of interest (VOIs), each with a diameter of 9 mm and a height
of 7.5 mm, were positioned on the inner part of the inserts.
Comprehensive evaluation of volumetric spatial resolution is still an above-standard
procedure for quality control of clinical CT x-ray equipment, but it is conform to
[22] by all means. 3 D MTFs were calculated from measurements of the spherical edge of
phantom section 2 ([Fig. 2 d]). The ESFs corresponding to the step response in the x-, y-, and z-direction as
well as in the xy-plane were sampled by a trilinear interpolation as a function of
radial distance from the centre of the sphere. The ESF profiles were differentiated
with respect to the radial distance to obtain the corresponding LSF. The exact MTF
was computed by taking the modulus of the discrete Fourier-transformed LSF. This technique
was performed for all direction-specific components of the 3 D spatial resolution.
As figures of merit, the 50 % (MTF
50 %) and 10 % MTF (MTF
10 %) values were tracked for each type of the MTFs.
Automated Volume Data Analysis
To correctly assess all desired IQ parameters and, in consequence, to achieve high
reliability of the measured imaging performance, the ROIs and VOIs must be accurately
centred and aligned in the reconstructed volume data set. For this purpose, we developed
automated detection algorithms for both types of QA phantoms described in section
2.1, which were integrated in a dedicated computer program (ImpactIQ, CT Imaging GmbH,
Erlangen, Germany). The registration processes are based solely on the CT volumes
without the need of external markers or strict phantom alignment to allow for easy-to-use
quality control in clinical routine.
The detection algorithm for the new DIN-compliant phantom was implemented in C++ employing
a multi-step approach as follows:
-
Initialization of the evaluation program including read-in of the reconstructed volume
data set.
-
Calculation of the z-vector of the phantom.
-
Calculation of the spatial shift of the phantom.
-
Calculation of the x- and y-vector of the phantom.
The phantom segmentation was performed analogous to [19]
The detection of the IEC-compliant phantom was realized applying the procedure described
in [19].
Both detection algorithms provide the position off-centre and the orientation of the
phantoms. As a result of this, the groups of ROIs and VOIs needed for evaluating all
IQ aspects are arranged according to the strategies specified in section 2.2.
Setup for Measurements
Measurements were performed on a dental CBCT system (KaVo 3 D eXam, KaVo Dental GmbH,
Biberach/Riß, Germany) installed at the University Medical Centre of Erlangen, Germany.
The data acquisition and reconstruction parameters used correspond to a predefined
standard clinical protocol and are listed in [Table 2]. The reconstructed volume data sets were exported as uncompressed DICOM images provided
by the dental CBCT system.
Table 1
List of abbreviations.
Tab. 1 Abkürzungsverzeichnis.
3 D
|
three-dimensional
|
a. u.
|
arbitrary units
|
CBCT
|
cone-beam computed tomography
|
cm
|
centimetre
|
CNI
|
contrast-to-noise indicator
|
CNR
|
contrast-to-noise ratio
|
CT
|
computed tomography
|
DIN
|
German Institute for Standardization
|
FOM
|
field of measurement
|
HA100
|
100 mg cm-3 hydroxyapatite
|
IEC
|
International Electrotechnical Commission
|
kV
|
kilovoltage
|
mAs
|
milliampere-second
|
mm
|
millimetre
|
MTF
|
modulation transfer function
|
MTF*
|
approximated MTF
|
PMMA
|
polymethyl methacrylate
|
PVC
|
polyvinyl chloride
|
UI
|
uniformity index
|
UI*
|
uniformity indicator
|
Table 2
Scan and reconstruction parameters for the measurements carried out on the dental
CBCT system KaVo 3 D eXam.
Tab. 2 Aufnahme- und Rekonstruktionsparameter für die Experimente, welche an dem DVT-Gerät
KaVo 3 D eXam ausgeführt wurden.
parameters
|
settings
|
scan protocol
|
standard
|
scan trajectory
|
circular
|
tube voltage / kV
|
120
|
tube current-exposure time product / mAs
|
18.54
|
field of measurement / cm3
|
16 × 16 × 13
|
reconstruction kernel
|
– (default)
|
reconstructed volume / voxel
|
536 × 536 × 440
|
reconstructed voxel size / mm3
|
0.3 × 0.3 × 0.3
|
Both QA phantoms were centred at two different axial distances from the centre of
the field of measurement (FOM) (z = 0 cm and z = 6 cm). This makes an evaluation of
the effect of the phantom location and, in consequence, the severity of image artefacts
feasible.
Results
The position and orientation of the phantoms were detected fully automatically in
all these measurements. Thus, a reproducible placement of the evaluation regions and
volumes was provided. This was initially verified by visual inspection of the ROIs
and VOIs marked in the volume data sets.
The IQ parameters determined in this study are summarized in [Table 3]. Representative transverse views of the phantom sections used for assessment of
imaging performance in dental CBCT according to the standards [21] and [22] are depicted in [Fig. 3], [4]. The reconstructed images correspond to two different axial positions and have an
identical display window level.
Table 3
Image quality parameters according to [21] (new) and IEC-compliant procedures (conv.) measured at two different axial positions.
For comparative purposes, the percent difference of the results at the peripheral
FOM (z = 6 cm) to the centre (z = 0 cm) is also listed.
Tab. 3 Bildqualitätsparameter gemäß [21] (new) und IEC-konformen Prozeduren (conv.), welche an zwei unterschiedlichen, axialen
Positionen gemessen wurden. Der prozentuale Unterschied zwischen den Ergebnissen für
das periphere Messfeld (z = 6 cm) und dem Messfeldzentrum (z = 0 cm) wird für vergleichende
Zwecke ebenfalls aufgeführt.
IQ parameters
|
z = 0 cm
|
z = 6 cm
|
difference / %
|
uniformity
|
UI* (new)
|
27.42
|
19.19
|
–30.0
|
UI (conv.) / %
|
4.09
|
–3.98
|
–197.3
|
image contrast
|
CNI (new)
|
26.96
|
21.84
|
–19.0
|
CNR (conv.)
|
3.97
|
2.52
|
–36.5
|
resolution
|
MTF
*
50 % (new) / cm–1
|
4.78
|
4.70
|
–1.7
|
MTF
*
10 % (new) / cm–1
|
8.20
|
8.15
|
–0.6
|
MTF
*
50 %, xy (conv.) / cm–1
|
4.75
|
4.65
|
–2.1
|
MTF
*
10 %, xy (conv.) / cm–1
|
8.57
|
8.41
|
–1.9
|
MTF
*
50 %, z (conv.) / cm–1
|
4.75
|
4.18
|
–12.0
|
MTF
*
10 %, z (conv.) / cm–1
|
9.04
|
8.97
|
–0.8
|
image noise
|
|
|
|
σ(conv.) / a. u.
|
33.01
|
38.83
|
17.6
|
Fig. 3 Transverse views of the sections 2 and 3 of the new DIN-compliant phantom [21] centred at two different axial positions (z = 0 cm and z = 6 cm). The images are
windowed identically (C = 0 a. u., W = 800 a. u.).
Abb. 3 Transversale Schnittbilder von den Sektionen 2 und 3 des neuen, DIN-konformen Prüfkörpers
[21], welcher an zwei unterschiedlichen, axialen Positionen (z = 0 cm und z = 6 cm) zentriert
wurde. Die Bilder besitzen eine identische Fensterung (C = 0 w. E., W = 800 w. E.).
Fig. 4 Transverse views of the sections 1 – 3 of the modular IEC-compliant phantom [19] centred at two different axial positions (z = 0 cm and z = 6 cm). The images are
windowed identically (C = 0 a. u., W = 800 a. u.).
Abb. 4 Transversale Schnittbilder von den Sektionen 1 – 3 des modularen, IEC-konformen Prüfkörpers
[19], welcher an zwei unterschiedlichen, axialen Positionen (z = 0 cm und z = 6 cm) zentriert
wurde. Die Bilder besitzen eine identische Fensterung (C = 0 w. E., W = 800 w. E.).
The difference in measuring at z = 0 cm and z = 6 cm was most prominently observed
for the homogeneous phantom sections. This was also confirmed quantitatively by the
determined IQ parameters listed in [Table 3]. With increasing axial distance from the centre of the FOM, UI* and CNI fell by
30 % and 19 %, respectively. Conventional IQ parameters by means of the UI and the
CNR provided sensitivity to the dependence of the phantom position by a factor of
about 2 to 7 times higher than for the new DIN standard; i. e., UI and CNR were reduced
by 197.3 % and 36.5 %, respectively. Image noise was increased by about 18 %. Moreover,
the identification of cupping and capping artefacts in the reconstructed volume data
sets was feasible with the UI indicated by a positive and negative value, respectively.
Good consistency between this quantitative uniformity analysis and the visual perception
of the associated transverse slices shown in [Fig. 4c, f] was achieved.
For the assessment of high-contrast spatial resolution, the MTFs of the dental CBCT
system using the approximated as well as the exact calculation procedure are presented
in [Fig. 5]. The resulting curves were well comparable in shape. As shown in [Table 3], 50 % and 10 % in-plane MTF values from the approximated and the exact MTF methodology
were in agreement to within 5 %. Furthermore, no significant difference between both
measurements at z = 0 cm and measurements at z = 6 cm was observed for in-plane resolution
regardless of the calculation procedure. By comparing the in-plane 50 % and 10 % MTF values
with those in z-direction, the dental CBCT system showed almost isotropic 3 D high-contrast
spatial resolution.
Fig. 5 Representative MTFs of the dental CBCT system measured at the two axial positions
z = 0 cm and z = 6 cm.
Abb. 5 Repräsentative MÜFs des DVT-Gerätes, welche an den beiden axialen Positionen z = 0 cm
und z = 6 cm gemessen wurden.
Discussion
As for all new tomographic imaging devices, the compliance of physical imaging characteristics
with specifications needs to be verified in clinical practice. However, presently,
there are competing methodologies for acceptance and constancy testing for image quality
in CT.
The DIN standard represents an important step for quality control in dental CBCT since
it denotes the first national consensus on acceptance testing for IQ of this modality.
This standard focuses on a broad range of dedicated CBCT scanners differing in their
architecture, technical equipment, and output data format. However, the introduction
of completely new IQ metrics might be brought into question since the functional principle
of the dental CBCT devices is quite comparable to conventional CT systems and the
manufacturers claim full 3 D capability. Furthermore, a direct interpretation of physical
imaging characteristics through the new metrics UI* and CNI is not possible. In other
words, correct analysis of both uniformity and image contrast is not provided by the
new methodology according to the instructions stated in section 4.3.7 and appendix
B of [21] insofar the former is defined by differences in mean voxel values measured in the
centre and periphery and the latter is defined by the mean voxel value of a certain
target material after subtraction of the mean voxel value of the background material.
The optional assessment of well-established IQ parameters as an amendment to the existing
acceptance testing standard for IQ in dental CBCT is desirable. A proof of concept
for determining image noise, CT value accuracy and uniformity, contrast, and 3 D resolution
has already been successfully performed in previous studies on different dental CBCT
systems of various manufacturers considering several acquisition volumes [17]
[18]
[19]
[23]
[24]. This may also contribute to refine the upcoming constancy testing standard 6868 – 15
for IQ in dental CBCT.
According to the recently updated German quality assurance guideline [25], the new DIN 6868 – 161 shall only be applied when a corresponding constancy testing
standard 6868 – 15 is finalized. Until then, acceptance testing for IQ in dental CBCT
has to be performed according to the procedures described in [25]. However, this guideline and the DIN standard differ in IQ parameters which have
to be assessed; e. g. image noise and CT value accuracy are addressed by [25] but not by DIN. In consequence, acceptance and constancy testing procedures still
need to be harmonized.
Our study confirmed that evaluating phantom sections 1, 2, and 3 of the modular IEC-compliant
phantom appears to be sufficient to assess imaging performance for quality control
purposes in clinical CT objectively. This configuration of the modules allows for
the measurement of image noise, uniformity, contrast, and 3 D resolution. Thus, the
conformity to the IEC standard is met and the equivalence to the new DIN standard
is considered to be ensured.
Our measurements revealed that the position of the QA phantoms plays an important
role for image quality control in CBCT. The conventional IQ parameters were more sensitive
to image artefacts. So, determining the standard deviation, the UI, and the CNR appears
to be well-suited to identify possible degradations of the apparatus at an early stage,
as indicated in [Table 3].
Evaluating only planar IQ parameters in the isocentre of the scanner turned out to
be inadequate for the comprehensive characterisation of imaging performance in CBCT,
as confirmed by the results in [Table 3]. Physical IQ aspects with respect to image noise, uniformity, contrast, and resolution
depend critically on their direction and position [19]. Consequently, the assessment of essential objective IQ metrics, e. g. standard
deviation, UI, CNR, and 3 D MTF in the complete FOM, are considered to be necessary
after a new device has been installed or major modifications have been made to existing
equipment.
In conclusion, there is no similarity between the recently proposed metrics [21] and the well-established CT IQ assessment [22]. In addition, direct measurements of physical image characteristics such as image
noise, uniformity, contrast, and axial resolution are not supported by the new concept
according to DIN 6868 – 161.
Clinical Relevance of the Study
-
Acceptance and constancy testing are a necessity for clinical computed tomography
(CT) systems and need to be harmonized and established for cone-beam CT (CBCT).
-
Distinct differences between the new DIN 6868 – 161 and the established IEC 61 223 – 3-5
have been recognized and should be taken into account for the upcoming standard DIN 6868 – 15
for constancy testing in dental CBCT.