What Is Proficiency Testing and Why Is It Vital?

Imagine receiving a medical diagnosis that changes your life, only to find out later the machine that tested you was barely functioning. Proficiency testing is the critical regulatory process where external agencies send blind samples to a lab to verify that their equipment and methods produce accurate results. This "final exam" for laboratories is the thin line between a correct prescription and a catastrophic medical error.

In the high-stakes world of medical diagnostics, laboratories can't simply grade their own homework. External oversight ensures that when a doctor reads your blood report, the numbers reflect reality rather than a glitch in the software. As we saw with the rise and fall of Theranos, bypassing these checks leads to a culture of deception that puts thousands of lives at risk.

What is Proficiency Testing?

Proficiency testing is a quality-control mechanism mandated by federal law under the Clinical Laboratory Improvement Amendments. In the book Bad Blood, John Carreyrou explains how this process works: an accredited body, such as the College of American Pathologists, sends unknown samples to a lab. The lab doesn't know what is in the sample, and they must test it using their routine methods to see if they can match the known values.

This process creates a benchmark for diagnostic accuracy across the entire industry. If a lab's results fall outside of two standard deviations from the target, they've failed the test. It is the most objective way for regulators to ensure that a lab’s internal quality controls aren't just for show.

Without these regular checkups, a laboratory becomes a black box. Doctors and patients rely on the assumption that a lab has passed its most recent proficiency tests. When a company treats these regulations as a nuisance to be managed rather than a standard to be met, the entire healthcare system suffers.

Why Blind Samples Verify Diagnostic Accuracy

Diagnostic accuracy is the foundation of modern medicine. Most healthcare decisions, approximately 70% according to some industry estimates, are based on laboratory results. Proficiency testing ensures these decisions are grounded in hard truth rather than equipment error.

When a lab receives a blind sample, they must treat it exactly like a patient sample. This means using the same machines, the same technicians, and the same chemical reagents they use every day. If the lab uses a different process for the test sample than they do for patients, they are effectively lying to the regulators.

Theranos repeatedly hit a wall because their Edison devices couldn't produce consistent results. Instead of fixing the technology, leadership chose to hide the failures. This undermined the very purpose of the test, as the data reported didn't reflect the actual performance of their proprietary machines.

Why CLIA Compliance Requires Honest Reporting

Maintaining CLIA compliance is a legal requirement for any laboratory operating in the United States. This federal framework ensures that every facility follows the same rigorous standards for testing, personnel, and quality management. Proficiency testing is the most visible part of this compliance.

Regulators expect to see a lab's routine methods in action during these tests. If a lab normally uses a specific proprietary device for a test, they are legally bound to use that same device for the proficiency sample. Switching to a different, more reliable machine just to pass the test is considered a form of regulatory fraud.

In the case of Theranos, the company was caught in a web of its own making. They told the public they were using their "miniLab" technology, but they couldn't trust it to pass a blind test. This created a massive gap between their marketing and their actual clinical capabilities.

Why Consistent Proficiency Testing Saves Lives

Consistent testing acts as an early warning system for laboratory directors. It reveals when reagents have expired, when machines need recalibration, or when technicians need better training. When these errors are caught during a proficiency cycle, they don't harm real people.

In a healthy lab environment, a failed proficiency test is a moment for corrective action. It’s an opportunity to pause, investigate the root cause, and ensure patient safety. However, a culture that fears failure often leads to data manipulation, which is where the real danger begins.

Data from the book suggests that human error accounts for nearly 93% of laboratory mistakes. Automated proficiency testing helps identify where these human or mechanical failures are happening. When a company bypasses this process, they aren't just cheating a test; they’re gambling with the health of every patient who walks through their door.

How Theranos Gamed the System

Theranos provides the ultimate cautionary tale of what happens when a company treats proficiency testing as a hurdle to jump over rather than a standard to uphold. The company’s proprietary Edison devices were notoriously unreliable, often failing internal quality-control checks.

The Siemens Machine Swap

When proficiency samples arrived, Theranos leadership knew their Edisons would fail the test. To hide this, Sunny Balwani and the lab management ordered technicians to run the samples on commercial Siemens ADVIA machines instead. They then reported those results as if they had come from their own proprietary technology.

The Dilution Scandal

Because Theranos insisted on using tiny finger-prick samples, they had to dilute the blood to create enough volume for the Siemens machines to read it. This double-dilution process introduced massive inaccuracies. They were reporting results that were mathematically manipulated, which is a direct violation of laboratory standards.

Ignoring the Whistleblowers

Employees like Tyler Shultz and Erika Cheung realized the company was cheating. Tyler contacted the New York State Health Department after seeing that Edison results for Vitamin D were wildly different from those on Siemens machines. The state officials confirmed that this was a form of "PT cheating," yet the company continued the practice for months.

Three Steps to Protect Lab Integrity

Businesses in the healthcare or tech space must prioritize transparency over optics. If you're involved in managing a laboratory or a medical startup, follow these steps to ensure you remain on the right side of the law.

1. Enforce a "No-Exception" Policy for Test Procedures. Ensure that every sample sent for proficiency testing is handled by the exact same personnel and equipment used for daily patient samples. Any deviation should be documented and reported to the lab director immediately to prevent accidental fraud.

2. Establish an Anonymous Quality-Reporting Channel. Create a secure way for junior technicians and researchers to report quality-control failures without fear of retaliation from management. This prevents the kind of internal silencing that allowed the Theranos deception to persist for years.

3. Conduct Quarterly Internal Audits. Don't wait for the official regulatory samples to arrive once or twice a year. Run your own internal "blind tests" on a regular basis to identify equipment drift or training gaps before they become a liability to your CLIA compliance.

The Flaws in Current Oversight

Critics of the current laboratory regulatory environment argue that the system is too easy to game. Because proficiency samples are sent at predictable intervals, a dishonest lab can prepare for them. This creates a "snapshot" of performance that may not reflect the daily reality of the laboratory's operations.

Furthermore, the Centers for Medicare and Medicaid Services often lack the funding to conduct frequent, unannounced inspections. As noted in Bad Blood, state inspectors sometimes miss entire sections of a lab because they are only shown what the company wants them to see. This allows a laboratory to maintain its certification while hiding its most critical failures behind locked doors.

Some experts suggest that regulators should move toward a more dynamic, unannounced testing model. This would force labs to maintain a high standard of quality every single day, rather than just during their testing windows. While this would increase the cost of oversight, it would significantly reduce the risk of another company following the Theranos playbook.

Proficiency testing is not just a box to be checked for a certificate. It is a vital promise that the results a patient receives are accurate and actionable. If your laboratory fails to meet these standards, it is your responsibility to stop testing patients until the issues are resolved. Conduct a surprise internal audit of your quality control protocols this quarter.