Rater agreement reliability of the dial test in the ACL-deficient knee

Posterolateral rotatory instability (PLRI) of the knee can easily be missed, because attention is paid to injury of the cruciate ligaments (Hughston & Jacobson, 1985; Kim et al., 2010). If left untreated this clinical instability may persist after reconstruction of the cruciate ligaments (O’Brien et al., 1991) and may put the graft at risk of failure (Harner et al., 2000; LaPrade et al., 2002; LaPrade et al., 1999). PLRI is defined as posterior subluxation and external rotation of the lateral tibial plateau in relation to the lateral femur condyle (Hughston et al., 1976; Hughston & Jacobson, 1985; Hughston & Norwood, 1980), as a consequence of injury to structures of the posterolateral corner (PLC) of the knee (Davies et al., 2004; Ferrari, 1999; Seebacher et al., 1982; Terry & LaPrade, 1994; Veltri & Warren, 1994). Multiple tests are described to diagnose PLRI, including the posterolateral drawer test (Hughston & Norwood, 1980), external rotation recurvatum test (Hughston & Norwood, 1980), reverse pivot shift test (Jakob et al., 1981), adduction stress test at 30° of flexion (Hughston & Jacobson, 1985) and an external rotation test (Loomer, 1991; Veltri & Warren, 1993), which is also known as the dial test or posterolateral rotation test (LaPrade & Wentorf, 2002; Larsen & Toth, 2005).

In 1991 Loomer (Loomer, 1991) described the dial test as a modification of the posterolateral drawer test. It is a tibial external rotation test based on biomechanical cutting studies (Gollehon et al., 1987; Grood et al., 1988) and has been extensively studied and described in the PCL-injured knee. Several ligament cutting studies (Bae et al., 2008; Grood et al., 1988; Strauss et al., 2007; Veltri et al., 1995; Wroble et al., 1993) and studies on clinical devices mimicking or measuring external rotation of the tibia, such as the dial test (Bae et al., 2008; Bleday et al., 1998; Forsythe et al., 2017; Krause et al., 2013; Lorbach et al., 2012; Musahl et al., 2007; Samukawa et al., 2007; Stinton et al., 2016; Tsai et al., 2008) have been performed. Its initial use was to distinguish between posterior cruciate ligament (PCL) injury solely and combined PCL and PLC injury. As is known, damage to the PLC may also be present in patients with anterior cruciate ligament (ACL) injury (Kim et al., 2010; LaPrade & Wentorf, 2002; O’Brien et al., 1991).

Many clinicians use the dial test in their daily practice for assessing PLRI in the ACL-deficient knee and whether or not to perform a PLC reconstruction of the knee at time of ACL reconstruction. The dial test is easy to perform and understand, and is widely accepted to diagnose PLRI of the knee in combination with other tests. We acknowledge the difficulty of relying on physical examination for the diagnosis of PLRI and no objective quantitative test exists for assessing increased external rotation. This makes accurate diagnosis of PLRI difficult (Laprade et al., 2014). As is known, a positive dial test may result from either posterolateral or medial knee injuries (Griffith et al., 2009; Wijdicks et al., 2010) and the results of rotatory instability tests should be carefully interpreted.

Literature on the reliability of the dial test is limited (Jung et al., 2009; Kim et al., 2010; Krause et al., 2013; Lee et al., 2015), especially in patients with ACL injury (Forsythe et al., 2017; Samukawa et al., 2007). At the moment no validity and reliability studies of the manual dial test are performed in patients with ACL injury yet.

Therefore, the purpose of this study is to determine the reliability of the manual dial test by focusing on the rater agreement in patients with suspected ACL injury and possible concomitant injury of the knee. We hypothesize that the dial test has good rater agreement.

A monocenter study was performed to evaluate the rater agreement reliability of the dial test. This study was approved by the institutional review board of the author’s institution. All subjects provided written informed consent. The authors had no financial conflicts of interest.

Fifty-two patients between the ages of 18 and 50 years were included. Inclusion criteria were patients with a history of distorsion of the knee and thus strong suspicion on ACL injury or patients with proven ACL injury on magnetic resonance imaging (MRI) of the knee. Exclusion criteria included rheumatoid arthritis or other systemic inflammatory diseases, a history of previous injury or complaints of the contralateral knee, a locked knee, previous surgery on one of both knees, (congenital) malformation that could influence rotation of the knee or foot, asymmetrical rotation of the hips and asymmetrical leg axis.

Quantification of external rotation in the knee

An objective quantification measuring device was developed and used for determining external rotation of the knee. The patient was placed in prone position with the knees in 30°, 60° and 90° of flexion. Support was provided for the legs while keeping accurate flexion angles of the knees and relative muscle relaxation was possible. Air inflatable walkers (protect.Air ROM Walker, size medium, Medi, Bayreuth, Germany) were used to fixate the ankle relative to the tibia to minimize the rotation of the ankle. It offers a snug fit, without being uncomfortable. A strap was used on both legs just proximal to the knees to avoid natural abduction of the hips. Based on biomechanical studies in vivo, a 6 Nm external torque was applied on both feet by means of a wrench with an electronic torque adapter (Kraftwerk Europe, art. 4081–14, ±2%) (Alam et al., 2013; Branch et al., 2010; Markolf et al., 1984; Mouton et al., 2012; Shultz et al., 2007; Tsai et al., 2008). With help of fixed angle gauges the thigh-foot angle was measured during external rotation of the ACL-insufficient knee and contralateral knee with both feet starting in neutral position and not the patient’s own resting position of the feet. Side-to-side difference of ≥10° after applying 6 Nm external torque was considered a positive dial test (Fig. 1).

All included patients showed increased anterior translation as assessed by the Lachmann test, anterior drawer test or pivot shift test when performed by either the orthopaedic surgeon or the blinded examiner. No increased posterior translation was found as assessed by a posterior drawer test.

In total, the blinded researcher found a positive dial test on the injured knee in 11 (21.2%) patients and found a positive test on the healthy knee in 4 (7.7%) patients during the first examination. The orthopedic surgeon found a positive test on the injured side in 9 (18.0%) patients and in 1 (2.0%) patient on the healthy knee. The overall proportion of agreement between raters was 70%. On the quantification measuring tool 8 (30.8%) of 26 patients had a positive test. Overall agreement between the researcher and the device was 62%.

No significant intra-rater agreement was found for the dial test with a Cohen’s kappa ranging from 0.16 to 0.49. An almost perfect rater-device agreement was found in 30° flexion of the knees, κ_C = 0.84 (95% CI: 0.52 to 1.15), p < 0.001. A moderate rater-device agreement was found in 30° and 90° combined, κ_C = 0.50 (95% CI: 0.13 to 0.86), p = 0.008.

Structures of the PLC encompass the LCL, popliteus tendon and the popliteofibular ligament (Laprade et al., 2014). As is well-known, an injury of the LCL can clinically be differentiated from the popliteus tendon by performing both varus stress tests and the dial test (LaPrade et al., 2008; Laprade et al., 2010). Isolated LCL injury may result only in increased varus gapping and no increase in external rotation. On the other hand injury to the popliteus tendon may result in increased external rotation without varus gapping. Also, the heel height test has been described in the literature for the diagnosis of combined ACL and LCL tears (Cinque et al., 2017). Varus stress radiographs can provide an objective measure for diagnosis of LCL and posterolateral knee injuries (LaPrade et al., 2008).

In this study we focussed on increased external rotation as assessed by the dial test in the ACL-injured knee. The principal finding of this study is that the manual dial test has a fair inter-rater agreement in 30° and 90° of flexion in patients with ACL injury.

Reliability testing of the dial test has only been performed in several studies (Forsythe et al., 2017; Jung et al., 2009; Kim et al., 2010; Krause et al., 2013; Lee et al., 2015). These studies show substantial to almost perfect agreement, ranging from 0.60 to 0.92, when using an intraclass correlation coefficient (ICC) that can be used for quantitative measurements of tibial external rotation. However, the manual dial test is scored positive or negative by the clinician and no measurement tool is incorporated in to daily practice, therefore an ICC is not useful for determining reliability of the manual dial test. Results of these reliability studies (Forsythe et al., 2017; Jung et al., 2009; Kim et al., 2010; Krause et al., 2013; Lee et al., 2015) are difficult to compare as groups of patients, method of measurement and position in which the dial test is performed, differ from one another.

Likewise, significant correlations between the dial test and injury to structures of the PLC were found during surgical exploration (Kim et al., 2010; Laprade & Terry, 1997) and in selective ligament cutting studies performing external rotation of the tibia (Bae et al., 2008; Grood et al., 1988; Strauss et al., 2007; Veltri et al., 1995; Wroble et al., 1993). Nonetheless a cadaveric study of Bae et al. (Bae et al., 2008) suggests that in patients with ACL injury, injury to less than three posterolateral structures (excluding the PCL) might not be clinically detected by the dial test. Also Veltri et al. (Veltri et al., 1995) state that the standard external rotation test performed at 30° of knee flexion may not be routinely reliable for detecting combined anterior cruciate and posterolateral ligament injury. They suggest that increased total rotation may be indicative for injury to the posterolateral structures in the ACL-deficient knee. Furthermore, a study of Griffith et al. (Griffith et al., 2009) shows that significant increases in external rotation at 30° of knee flexion were found with all medial knee structures sectioned, which indicates that a positive dial test may be found not only for posterolateral knee injuries but also for medial knee injuries. Therefore, careful correlation with the results of valgus stress testing and assessment of the location of tibial subluxation during the dial test, performed in prone and supine position, is necessary to distinct between possible posterolateral or medial knee injury (Griffith et al., 2009; Wijdicks et al., 2010). Also comparing the lateral tibial condyle with the medial tibial condyle during posterolateral and anteromedial drawer tests can aid in this distinction (Hughston & Norwood, 1980; Wijdicks et al., 2010).

There is no consensus in literature whether the dial test should be performed in prone or supine position in the ACL-deficient knee (Lunden et al., 2010). It was first described in supine position (Loomer, 1991) and later on in prone position (Veltri & Warren, 1993). Performing the dial test in prone position is considered the same as applying an anterior force to the tibia when performed in supine position (Jung et al., 2009; Strauss et al., 2007). Even though no posterior tibial subluxation will be visible if the posterior subluxation is reduced in the PCL-injured knee, it increases the ability of an examiner to detect a concomitant PLC injury in the setting of a PCL-deficient knee (Jung et al., 2009; Lee et al., 2015; Strauss et al., 2007). No such studies are performed in the ACL-deficient knee. Therefore, we chose to perform the dial test in prone position in the suspected ACL-injured patient, because it offers easy control of the flexion angles in the knee, flexion of the hips, manual torque applied and requires only one examiner.

The dial test is considered positive if ≥10° side-to-side difference is present (Veltri & Warren, 1993), however as is known side-to-side differences are present in healthy subjects and in the ACL-injured knee without concomitant PLC injury (Forsythe et al., 2017; Krause et al., 2013). A study from Krause et al. (Krause et al., 2013) demonstrated side-to-side differences ranging from 4.7° to 5.9° in healthy subjects. They show that a threshold of ≥10° side-to-side difference results in incorrect positive testing in 21% of their subjects and therefore suggest a threshold of ≥15° side-to-side difference. Even though biomechanical cadaveric studies suggest that the ACL does play a secondary role in restraining internal tibial rotation (Mouton et al., 2012; Wroble et al., 1993), a study of Forsythe et al. (Forsythe et al., 2017) demonstrated that isolated deficiency of the ACL accounts for nearly 7° of tibial external rotation found by the dial test in the absence of PLC injury and caution should be taken when interpreting the dial test.

Besides variations in applied torque by different examiners, the amount of laxity can also influence the result of the dial test. Cooper et al. (Cooper, 1991) performed the dial test on healthy subjects under anesthesia. They found that the amount of external rotation laxity varied inversely according to their laxity index and that the thigh-foot angle only indirectly correlates with tibial rotation at the knee. Another study of Stinton et al. (Stinton et al., 2016) shows contradictory results. They state that the foot is not an accurate measure of tibial rotation and that the dial test performed by the clinician should focus on observation at the tibial tubercle and not on the foot. Because of these factors affecting the result of the dial test, it might be beneficial that an increase of side-to-side difference of external tibial rotation must be evaluated as a part of maximum external rotation, resulting in a percentage. This eliminates the individual variety in rotation laxity.

In summary, several patients with ACL injury showed increased external rotation of the knee as assessed by the manual dial test. This study found fair inter-rater agreement of the manual dial test performed in prone position in patients with ACL injury. Based on this study rater agreement reliability of the manual dial test is questionable in the patient suspected for ACL injury, with or without concomitant injury. Diagnosing PLRI depends highly on the orthopaedic surgeon performing the dial test if no injury to the PLC is seen on MRI. This can result in high variety in the decision of whether or not to perform an additional PLC reconstruction amongst orthopaedic surgeons. Caution should be taken when addressing PLRI with a PLC reconstruction if solely based on a positive dial test. Therefore other tests should be performed to eliminate other causes of increased external rotation in the ACL-injured knee, such as concomitant medial injury. Ideally, the results of this study should be compared to a healthy control group for further clarification on this matter. We believe that the dial test provides valuable information about the external rotation laxity of the knee. Also, further research should focus on quantification devices of tibial rotation (Bae et al., 2008; Bleday et al., 1998; Jung et al., 2009; Krause et al., 2013; Lorbach et al., 2012; Musahl et al., 2007; Stinton et al., 2016; Tsai et al., 2008), so that the increase of tibial rotation can be evaluated in relation to total rotation.

This study has several limitations. We did not compare results of the manual dial test performed in prone position compared to the supine position. Also, we did not differentiate between injury to the PLC or the medial structures which could both result in a positive dial test. No ICC was calculated for the manual dial test due to dichotomy of the results. Therefore, no minimal detectable change (MDC) and minimal clinically important difference (MCID) were calculated. We tried to minimize factors that influence the result of the dial test. However, the accuracy of the test depends on applied torque of the examiner, accuracy of estimating 10° side-to-side difference and laxity of the patient. Moreover, the patient’s reflex to resist instability tests due to discomfort or fear may result in some inaccuracies, such as a positive dial test on the healthy contralateral knee. Also, the orthopaedic surgeon was not blinded in contrast to the second examiner. No significant intra-rater agreement was found, possibly due to a large time interval between the assessments and a small sample size, resulting in large confidence intervals. Also, we do not know whether the time between ACL injury and physical examination influences the amount of external rotation and thus the outcome of the dial test. Because of the absence of a gold standard and the heterogeneity of concomitant injury of our patient population no sensitivity and specificity for the dial test could be calculated for diagnosing PLC injury. However, we do believe this is a representative and clinically relevant group of patients in whom the dial test should be performed.

According to our study the manual dial test performed in prone position has a fair inter-rater agreement in 30° and 90° of flexion in patients with ACL injury. Therefore its rater agreement reliability is questionable in the ACL-injured knee and its findings should be interpreted with caution.