Automatic AI prioritization of X-ray / CT studies for urgent radiologist review
Every CT and X-ray acquired in a modern hospital flows automatically into the Picture Archiving and Communication System (PACS), then lands on a radiologist's worklist. Without triage software, that worklist is ordered by arrival time alone — a life-threatening intracranial hemorrhage can sit for hours behind a stack of routine outpatient films simply because it was acquired later.
The Picture Archiving and Communication System (PACS) is the backbone of digital radiology: every image acquired by a CT, X-ray, or MRI scanner is stored in DICOM format and pushed to a central archive, then routed to a radiologist's worklist for interpretation. In a busy emergency department, hundreds of studies can be queued simultaneously across body regions and modalities.
Without automated prioritization, the default worklist ordering is FIFO (first-in-first-out) — sometimes lightly modified by manual "STAT" flags that a technologist or ordering physician sets by hand. This manual flagging is inconsistent: a busy ED physician may forget to mark a study STAT, or may over-flag routine studies out of caution, defeating the purpose of prioritization.
The result is a queue where clinical urgency and position in line are only loosely correlated. A patient with a large-vessel occlusion stroke, where "time is brain" and every minute of delay costs roughly 1.9 million neurons, can wait alongside a scheduled outpatient knee X-ray.
Studies show that for time-critical findings like large-vessel occlusion (LVO) stroke, each 15-minute delay in treatment initiation is associated with measurably worse 90-day functional outcomes — making worklist ordering a genuine clinical variable, not just an operational inconvenience.
Diagnostic imaging volume has grown far faster than the radiology workforce. CT utilization in emergency departments has risen roughly 30–40% over the past decade, driven by expanding clinical indications, aging populations, and increasingly sensitive diagnostic criteria for conditions like pulmonary embolism.
A single large academic medical center may generate 500 to over 1,000 cross-sectional and radiographic studies per day. On overnight and weekend shifts, a single on-call radiologist (or a remote teleradiology group) may be solely responsible for reading all of them — meaning any inefficiency in ordering directly translates into delayed diagnosis for whichever critical case happens to be queued behind non-urgent studies.
This mismatch between supply and demand is precisely the environment in which AI triage tools were designed to help: not by replacing radiologist judgment, but by re-ordering the queue so that the radiologist's finite attention is spent first on the studies most likely to contain a life-threatening finding.
Manual urgency flagging depends on the ordering clinician correctly anticipating an abnormal finding before the image is even read — which is circular: the entire point of the imaging study is to determine whether a critical finding is present. Referring physicians tend to over-flag out of liability caution, which dilutes the signal, or under-flag atypical presentations of serious disease (for example, a subtle early ischemic stroke or a small pneumothorax that does not fit the classic clinical picture).
This creates a persistent gap: the sickest patients are not reliably surfaced first, and radiologists must read in arrival order, hoping urgent findings do not slip through the cracks during a busy shift. AI triage systems close this gap by applying a consistent, image-derived urgency score to every single study at the moment it is acquired — before any human has looked at it.
Once a study lands in PACS, a convolutional neural network — typically built on a DenseNet or ResNet backbone — automatically processes the pixel data, extracting layered feature maps that progressively capture edges, textures, and anatomical structures relevant to specific critical findings such as intracranial hemorrhage, pneumothorax, or pulmonary embolism.
Most FDA-cleared imaging triage products use convolutional neural networks adapted from architectures proven on natural-image benchmarks, then fine-tuned on large, expert-labeled medical imaging datasets:
• DenseNet (Densely Connected Convolutional Networks): each layer receives feature maps from all preceding layers, improving gradient flow and feature reuse — well suited to the subtle texture differences that distinguish, for example, acute hemorrhage from normal brain parenchyma on non-contrast CT.
• ResNet (Residual Networks): uses skip connections that let the network learn residual functions, enabling much deeper architectures (50, 101+ layers) without vanishing-gradient degradation. ResNet-50 and ResNet-101 backbones are common in commercial chest X-ray and CT triage products.
• 3D CNNs / volumetric processing: for CT, many products process the full volumetric stack (not just individual 2D slices) using 3D convolutions or slice-wise 2D CNNs with a recurrent or attention layer to aggregate information across the z-axis — critical for detecting small, focal findings like early pneumothorax or a segmental pulmonary embolism that may only appear on a handful of slices.
The network is typically pretrained on large natural-image datasets (ImageNet) for low-level feature initialization, then fine-tuned end-to-end on hundreds of thousands of expert-annotated medical studies specific to the target pathology.
Aidoc's intracranial hemorrhage algorithm and Viz.ai's LVO detection module were both trained on well over 100,000 annotated studies pooled across multiple health systems — dataset scale and diversity are now recognized as the single largest driver of real-world generalization performance.
Different triage products target different critical findings, each requiring the network to learn distinct visual signatures:
• Intracranial hemorrhage (ICH): subtle hyperdensity on non-contrast head CT, which can be epidural, subdural, subarachnoid, intraparenchymal, or intraventricular — each with a different characteristic shape and location that the CNN must learn to distinguish from calcification or motion artifact.
• Pneumothorax: a thin, low-density pleural line separating collapsed lung from the chest wall on X-ray or CT — a finding that is easy for a fatigued reader to miss on a supine portable film but that a CNN can flag consistently.
• Pulmonary embolism (PE): a filling defect within a contrast-enhanced pulmonary artery on CT pulmonary angiography, often small and located in a peripheral subsegmental branch.
• Large-vessel occlusion (LVO) stroke: an abrupt cutoff or hyperdense sign in a major cerebral artery on CT angiography, where speed of detection directly affects candidacy for mechanical thrombectomy.
Each of these is a narrow, single-purpose model — current-generation triage AI is not a general-purpose radiologist, but a bank of specialized binary or probabilistic detectors running in parallel on every incoming study.
Feature extraction happens automatically and silently: as soon as a DICOM study is sent to PACS, it is also routed (via a DICOM listener or cloud API) to the AI inference server, which typically returns a result in under five minutes — often under 60 seconds on modern GPU hardware. This runs entirely in parallel with, not instead of, the normal PACS routing, so the study is never delayed waiting for the AI.
The inference server outputs both a study-level probability score and, in many products, a slice-level or pixel-level localization map that will later be used to generate the heatmap overlay radiologists see in the reading stage of the pipeline.
The CNN's final layer outputs a probability that a given study contains the target critical finding. That raw probability is calibrated against a chosen sensitivity threshold to produce a binary triage flag, while a saliency or segmentation map highlights exactly where in the image the suspicious finding is located — giving the radiologist both a priority signal and a starting point for review.
The CNN's output layer typically produces a sigmoid or softmax probability between 0 and 1, representing the model's estimated likelihood that the target finding is present. This raw score is calibrated — adjusted so that a predicted probability of, say, 0.8 actually corresponds to roughly an 80% real-world likelihood — using techniques like Platt scaling or isotonic regression on a held-out validation set.
A sensitivity threshold is then applied: any study scoring above the threshold is flagged as "AI-suspected critical" and pushed to the top of the worklist. This threshold is a tunable operating point on the model's ROC (receiver operating characteristic) curve, and it encodes an explicit clinical trade-off between sensitivity (catching every true critical case) and specificity (not overwhelming radiologists with false alarms).
Most deployed hemorrhage and LVO detection tools report AUC (area under the ROC curve) values in the 0.90–0.97 range on validation cohorts — meaning the model is highly effective at ranking studies by true urgency, even though its binary flag at any single threshold is imperfect.
Viz.ai's LVO detection algorithm, one of the first FDA-cleared AI stroke triage tools (2018), has been shown in multi-center studies to reduce door-to-treatment time for large-vessel occlusion stroke by roughly an hour on average — directly increasing the fraction of patients treated within the therapeutic window for thrombectomy.
Alongside the numeric score, most commercial triage tools generate a visual localization overlay — commonly produced via Grad-CAM (Gradient-weighted Class Activation Mapping) or a dedicated segmentation sub-network — that highlights the specific image region driving the model's prediction.
This serves two purposes. First, it gives the radiologist a fast visual anchor: rather than scanning an entire CT volume from scratch, they can jump directly to the flagged region and confirm or refute the finding in seconds. Second, it functions as a basic explainability and quality-control mechanism — if the heatmap highlights an obviously irrelevant region (a rib, an artifact, patient motion), the radiologist can immediately recognize the flag as likely spurious rather than trusting the score blindly.
Regulatory guidance increasingly expects this kind of interpretability output as a condition of clearance, since a black-box probability alone gives clinicians no way to sanity-check an unexpected result.
AI-based imaging triage tools are regulated by the FDA as Software as a Medical Device (SaMD), most commonly cleared through the 510(k) pathway (demonstrating substantial equivalence to a predicate device) or, for genuinely novel functions, the De Novo pathway. Both require clinical validation data demonstrating sensitivity, specificity, and generalizability across the intended patient population.
Critically, these tools are cleared as computer-aided triage and notification (CADt) devices — they are explicitly not authorized to make a diagnosis. Their labeled function is to flag a study for prioritized review; the radiologist remains solely responsible for interpretation and diagnosis. This distinction shapes both the regulatory bar (lower than a diagnostic claim) and the clinical workflow (AI output is a queue-ordering signal, not a report).
Over twenty FDA-cleared products now address triage across intracranial hemorrhage, pneumothorax, pulmonary embolism, LVO stroke, aortic dissection, and other time-critical findings, offered by vendors including Viz.ai, Aidoc, GE Healthcare (Critical Care Suite), Rapid AI, and others.
Once a study is scored, the AI triage system pushes its result directly into the PACS worklist via an HL7 or DICOM integration, dynamically re-sorting the radiologist's queue: flagged studies are elevated to the top with a visual red-flag indicator, while unflagged routine studies remain in standard FIFO order beneath them.
Worklist re-ranking is not a separate application the radiologist has to check — it is integrated directly into the PACS or RIS (Radiology Information System) worklist the radiologist already reads from, typically via HL7 messaging or a vendor-specific DICOM integration. When the AI server returns a positive flag, it writes an urgency indicator (often a colored icon, banner, or explicit re-ordering of worklist rows) back into the same interface the radiologist uses for every other study.
This tight integration is deliberate: prior generations of "AI second opinion" tools that required radiologists to open a separate viewer or dashboard saw poor adoption, because it added workflow friction rather than removing it. Modern triage tools instead aim to be invisible until they have something urgent to say, at which point they interrupt the normal FIFO flow directly at the point of read.
Some systems go further with device-to-device notification — pushing a mobile alert or secure message to the on-call radiologist's phone the moment a high-confidence critical finding (e.g., large-vessel occlusion) is detected, even before the study would naturally reach the top of a passive worklist.
A large multi-site study of Aidoc's intracranial hemorrhage triage tool found that median time-to-diagnosis for flagged ICH cases dropped from approximately 8 hours (in the unassisted arrival-order workflow) to under 20 minutes after deployment — an improvement described in the literature as up to 96% reduction in some cohorts.
The sensitivity threshold set for a triage model directly controls how aggressively the worklist re-sorts. A lower threshold catches a higher fraction of true critical cases (higher sensitivity) but also flags more studies that turn out to be normal or non-urgent (lower specificity) — flooding the top of the worklist with false alarms.
A higher threshold produces a cleaner, more trustworthy queue of flags, but risks missing atypical or borderline true-positive cases that fall just under the cutoff. Health systems tune this threshold based on local clinical priorities, radiologist staffing, and tolerance for false positives — there is no universally correct setting, only a trade-off curve that must be chosen deliberately and monitored over time.
This is precisely the trade-off represented by the "Model Sensitivity Threshold" control in this simulation: raising it flags more studies as critical (better recall, more noise); lowering it flags fewer (cleaner queue, higher risk of a missed case).
Re-ranking introduces two well-documented risks that health systems must actively manage:
• Alert fatigue: if false-positive flags occur too frequently, radiologists begin to habitually discount AI flags altogether, eroding the entire benefit of the system — the same phenomenon well documented with clinical decision support alerts and ICU monitor alarms. Vendors and health systems monitor false-positive rates closely and retune thresholds when flagged-study yield drops too low.
• Automation bias: the inverse risk, where radiologists over-trust the AI flag, subconsciously rushing through or under-scrutinizing studies the AI did not flag, on the assumption that "the AI would have caught it." Because these tools are cleared only for triage — not diagnosis — every study, flagged or not, still requires full independent radiologist interpretation; the AI changes read order, not read thoroughness.
Ongoing quality assurance programs — tracking flagged-study yield, radiologist override rates, and missed-case audits — are now considered standard practice for institutions running AI triage in production.
With the worklist re-ordered, the radiologist opens the highest-priority AI-flagged study first — typically within minutes of acquisition rather than after a FIFO wait of an hour or more. The cumulative effect across a hospital system is a measurable reduction in time-to-diagnosis for critical findings, and downstream improvements in time-to-treatment for conditions where minutes matter.
Time-to-diagnosis in this context is measured from image acquisition to the moment a radiologist opens and begins interpreting the study — the interval during which a critical finding sits undiscovered in the queue. This is the interval AI triage directly compresses: it does not make the radiologist read faster, it makes the right study appear at the top of the list sooner.
In published deployments, this translates into dramatic reductions for flagged critical cases: hemorrhage and LVO stroke studies that might otherwise wait 60–180 minutes (or considerably longer overnight) are instead opened within single-digit minutes of acquisition. Because downstream treatment decisions — decompressive surgery for a large hemorrhage, thrombectomy for LVO stroke, chest tube placement for tension pneumothorax — depend directly on this diagnosis time, the clinical benefit compounds through the entire care pathway, not just the radiology department.
GE Healthcare's Critical Care Suite runs directly on the CT scanner itself — analyzing images at the point of acquisition, before they even reach PACS — reportedly notifying a radiologist of a suspected pneumothorax in under 3 minutes from scan completion, one of the fastest on-device triage implementations in current clinical use.
Evidence for AI triage benefit comes from a mix of retrospective before/after deployment studies, multi-site real-world registries, and a growing number of prospective trials. Consistent findings across this literature include:
• Significant reductions in median time-to-notification and time-to-treatment for flagged critical findings, most robustly demonstrated for LVO stroke (where Viz.ai and RapidAI platforms have the longest track record) and intracranial hemorrhage (Aidoc).
• No consistent evidence of degraded diagnostic accuracy when triage AI is layered onto standard radiologist workflow — the tools are additive to, not a replacement for, physician interpretation.
• Benefit is concentrated most heavily during off-hours (nights, weekends) when staffing is thinnest and FIFO queues are longest relative to available radiologist capacity — precisely when a delayed diagnosis is most dangerous.
Limitations in the evidence base remain: many studies are single-institution, vendor-sponsored, or retrospective, and head-to-head comparisons between competing triage products are still relatively rare.
AI triage models are trained on data from specific scanners, protocols, patient populations, and labeling conventions — and their performance can degrade when deployed at a new institution with a different case mix, a phenomenon known as dataset shift. A model validated primarily on adult trauma populations, for example, may perform unpredictably on pediatric studies or on a scanner protocol it has never seen, unless specifically validated for that setting.
Because these tools are cleared for triage, not diagnosis, the FDA labeling explicitly preserves full radiologist responsibility for every study — flagged or not. This is a deliberate regulatory and clinical safeguard against both under-reliance (ignoring useful flags) and over-reliance (skipping careful review of unflagged studies). Ongoing local validation, performance monitoring, and threshold retuning are now widely recommended as a condition of safe, sustained deployment — triage AI is treated as a living clinical tool that requires the same governance as any other high-stakes decision-support system, not a one-time install.
| Product | Indication | Trial Design | Key Result |
|---|---|---|---|
| Viz.ai ContaCT / Viz LVO | Large-vessel occlusion (LVO) stroke | CTA analysis flags vessel cutoff, auto-notifies stroke team via mobile app | First FDA-cleared stroke triage AI (2018); reduces door-to-treatment time |
| Aidoc BriefCase (ICH) | Intracranial hemorrhage | 3D CNN on non-contrast head CT, flags & localizes bleed subtype | Median time-to-diagnosis cut from hours to minutes in multi-site studies |
| Aidoc / Viz PE modules | Pulmonary embolism | CT pulmonary angiography filling-defect detection | Catches peripheral/subsegmental PE easily missed under time pressure |
| GE Critical Care Suite | Pneumothorax | On-scanner edge AI, analyzes chest X-ray/CT before PACS delivery | Sub-3-minute notification; runs at point of acquisition |
| Rib-fracture detection AI | Rib fracture (trauma CT) | Segmentation CNN highlights cortical breaks across rib cage volume | Reduces missed occult fractures in high-volume trauma reads |