Off-Road Screening Tools

Purpose of this page

This page provides information on evidence-based screening tools available to health professionals involved in evaluating an older person’s fitness to drive in an off-road setting, such as for General Practitioners.  

Screening tools are designed to support the clinical evaluation and decision-making process and should be used as part of a thorough interview on the patient’s driving requirements and history, medical review, and collaborative decision-making process with the patient and those involved in their care.    

Why must you use validated screening tools to aid Fitness to Drive decisions?

Off-road or office-based screening questionnaires and tests can inform the broader fitness to drive evaluation performed by a clinician.  

The Medical Fitness to Drive guidelines (e.g., AustRoads) recommend the core domains of sensory function, motor function and cognition be considered when evaluating Fitness to Drive.  

Validated screening tools:

  1. Objectively measure a client’s level of visual, cognitive and/or sensorimotor function.
  2. Predict a client’s risk of unsafely operating a vehicle in traffic. This is not the same as meeting other conditions that a screening tool is designed to assess – such as detecting dementia or abnormal cognition.
  3. Identify clients most in need of further evaluation through on-road or specialist assessment.

A screening tool must: 

  • be well-validated to detect driving safety. 
  • be relevant to driving, and this is readily apparent to the patient. 
  • be accurate at detecting unsafe drivers in your client population. 

 

What is a validated driver screening tool?

A senior man sits in the front seat with a driving instructor, who holds a clipboard and pen.

Test validity refers to how well a test measures what it is supposed to measure.  

A driver screening tool is a quick, office-based measure that tests the skills required for safe driving (i.e., sensory, motor, and cognitive function) and is demonstrated to predict pass or fails rates on a practical on-road driving assessment.  

Why an on-road assessment?

The ‘standard’ for measuring driver safety in traffic is through a practical driving assessment conducted by a qualified driver trained occupational therapist. The on-road evaluation should use a standardised and replicable scoring method to assess driver behaviour, level of risk, and adherence to road law. [see next section for more on On-Road Assessment] 

There are several other methods of measuring driving safety, including using a driving simulator, or in-vehicle video monitoring of naturalistic driving, but these methods are not standardised, are time and resource intensive to score, and rarely used clinically.  

Examples of Validated Screening Tools Used in Fitness to Drive Assessment

Useful Field Of View Subtest 2

(Administration time: 5-10 mins)

Computerised/Online test; measures the patient’s extent of visual attention, divided attention, and speed of visual processing. It involves identifying an image in central vision while simultaneously detecting the location of a peripheral image. The duration of images gradually decreases until the test identifies the optimal ‘threshold’ image duration, allowing the patient to perform with 80% accuracy. Score range from 17ms to 500ms.

Drive Safe

(Administration time: 20 mins)

Computerised/iPad App Store test; assesses visual attention and working memory and can predict the likelihood of passing or failing an on-road assessment. It presents a series of images simulating the view through a windshield at a roundabout, with varying positions of pedestrians and vehicles. Patients view each image for 3 seconds and then report details about the position and direction of travel of each object once the image is removed.

OTDORA Drive Home Maze Test

(Administration time 5 mins)

A component of the OT-DORA battery, this assessment tasks clients with navigating a drawn maze without getting stuck in dead-ends or going outside the boundaries. Time taken to finish the maze is measured.

OTDORA 14-iten Road Law (and Road Craft) TEST

(Administration time 10 mins)

Part of the OT-DORA battery, this test evaluates participants’ knowledge of road rules. It includes multiple-choice and short-answer questions, as well as questions involving diagrams of intersections. Performance on this test helps assess understanding of essential road safety principles.

Snellgrove Maze Test

(Administration time 5-10 mins)

Originally a timed pencil and paper test, now available as an iPad app. This assessment measures attention, visuo-constructional ability, and planning skills. Clients navigate through practice and actual mazes, with performance evaluated based on completion time and number of errors.

Trial Making Test B

(Administration time 5 mins)

In this assessment, clients are asked to connect 25 circles on a sheet of paper, alternating between numbers (1-13) and letters (A-L). The goal is to connect them as quickly as possible without lifting the pen/pencil. The speed needed to complete the task is measured to evaluate cognitive flexibility and task switching skills.

Hazard Perception Test

(Administration time 15 mins to 1 hour)

Computerised test; this test uses video clips depicting traffic scenarios where crashes are most likely to occur. Clients watch the clips and touch the screen when they spot a potential hazard. It assesses their ability to recognise risky situations while driving, providing insights into their situational awareness and responsiveness.

Multi-D Test

(Administration time 10-15 mins)

Comprises computer subtests assessing cognitive, motor, and visual function. One subtest measures complex reaction time where clients react as quickly as possible using their hands or feet to stimuli presented on the screen. This measures motor speed, cognitive flexibility and response inhibition. In the vision subtest, clients view moving dot stimuli and must identify the direction of movement of the dots. This measures sensitivity to visual motion. The two scores are combined to estimate the client’s risk of failing an on-road test. The Multi-D is currently under development and not yet released to the public.

How to interpret the validity of driver screening tools

1. Examine the measures of validity of a test: 

You may already be familiar with the following measures of diagnostic test accuracy:

Sensitivity: A tests ability to identify individuals as having the target condition (in this case, unsafe driving). The more sensitive a test, the better it is at detecting individuals who are unsafe drivers, but a test that detects everyone as an unsafe driver also has 100% sensitivity. High sensitivity means there are fewer ‘false negative’ results and more people are identified as unsafe.

Actual On-Road safety
Test A (Ideal) safe unsafe
Predicted safe 80 0
Predicted unsafe 0 20
Test A Sensitivity = 100% Test A False Negatives = 0%
Test B safe unsafe
Predicted safe 0 0
Predicted unsafe 80 20
Test B Sensitivity = 100% Test B False Negatives = 0%

Specificity: A tests ability to identify individuals who are safe drivers. A test that detects no one as an unsafe driver has 100% specificity. High specificity means fewer ‘false positive’ results and fewer people are identified as unsafe.

Ideally, you want to use tests with both high sensitivity and high specificity, however, simply balancing these two metrics is not sufficient for selecting an accurate test, or to choose between tests. 

Further reading on medical test heuristics can be found here.

 

Positive and Negative Predictive values are also informative:

Positive Predictive Value (PPV): If a test identifies an individual as an unsafe driver, the probability that they are actually an unsafe driver. This value depends on the test’s sensitivity as well as the prevalence of unsafe driving in the population the test is being used in.

Negative Predictive Value (NPV): If a test identifies an individual as safe, the probability they are actually safe. This value depends on test specificity as well as the prevalence of unsafe driving in the population.

A test with high sensitivity and specificity can have a low positive predictive value when used in a population where most drivers are safe.

2. Consider the population in which the test was validated.

The same test can perform differently depending on the prevalence of unsafe driving in the sample. Check out this tool to better understand how prevalence affects PPV and NPV.

 

Actual On-Road safety
Test A in community sample (unsafe drivers= 10%) safe unsafe
Predicted safe 64 5
Predicted unsafe 16 15
Test A Sensitivity = 75% Test A Specificity = 80% Test A PPV = 29.41%
Test A in dementia sample (unsafe drivers= 50%) safe unsafe
Predicted safe 64 5
Predicted unsafe 16 15
Test A Sensitivity = 75% Test A Specificity = 80% Test A PPV = 78.95%

 

When comparing the predictive ability and PPV of different screening tests, you must compare results taken from the same type of sample population, with similar prevalences of unsafe driving.

 

For example, the following tests and their predictive validity measures were derived from a sample of older drivers aged 65+ years drawn from the general community with a 12% prevalence of unsafe driving:

 

Test sensitivity specificity PPV NPV Correctly classified
Useful Field of View 50.8 85.7 32.7 92.7 81.5
DriveSafe 59.4 78.8 27.3 93.5 76.5
OTDORA Maze Test 67.2 60.9 19.1 93.1 61.7
Trail Making Test B 75.4 63.9 21.9 95.1 65.3
Hazard Perception Test 75.4 57.4 19.4 94.5 59.6
Multi-D Battery 77.1 82.1 33.3 96.9 81.6
DriveSafe Intersection Test 66.7 54.4 15.6 92.8 55.8
OTDORA 14-Item Road Law Test 29.5 89.0 25.7 90.7 82.1

Source: https://jamanetwork.com/journals/jamanetworkopen/fullarticle/2767247

3. Consider the client population that you are working with.

Some screening tests may demonstrate greater sensitivity and specificity for detecting unsafe drivers in certain populations but not others.

For example, the Mini-Mental Status Exam measures very basic cognitive abilities with scores ranging from 0 to 30. The MMSE was originally designed to detect significant cognitive impairment or dementia when used with a cut-off score of <24.

Studies show that the MMSE is not predictive of unsafe driving in older drivers living in the community. In unselected community samples, sensitivity is around 10% to 2%; Specificity 98% to 99%; PPV 50% to 33%; NPV 84% to 88%.

In patient samples selected for probable dementia, Parkinson’s disease, or referred for specialist driver evaluation, the MMSE is reported to predict unsafe driving with a sensitivity around 92% to 60%; specificity 73% to 14% and PPV from 65% to 62%; NPV 72% to 50%

Therefore, the MMSE is not recommended as a screening tool for FTD evaluations in primary care.