AI drug discovery hits data wall as models need negative results, not just wins

The pharmaceutical industry's embrace of AI as a tool to compress drug discovery timelines and improve success rates has collided with a harsh reality: the data infrastructure that trains these models is fundamentally incomplete. Drug development already operates under enormous cost and time pressure—the average timeline is 10–15 years with R&D costs of $1 billion to $2.5 billion and failure rates exceeding 90%—so any efficiency gain is valuable. AI's early promise lies in hit identification, where it can design molecular candidates computationally and filter out low-quality candidates before physical testing, eliminating the constraint of what human researchers can manually screen. But this shift has created new demand: AI-generated candidates are more numerous and diverse, placing pressure on lab teams to validate and characterize compounds at higher throughput and with richer data than traditional binary screening provides.

The core problem is that the datasets on which AI models are trained were not built for AI. They contain publication bias (almost exclusively positive results), lack structural annotation, and omit the negative data—failed compounds, unsuccessful binding experiments—that would allow models to understand failure modes and make more robust predictions. As researchers joke, there should be "a journal of negative data," but failed experiments are instead buried in lab notebooks and never shared. This creates a machine learning paradox: models cannot be adequately trained to avoid bias without access to a comprehensive range of outcomes. Compounding the risk is that generative AI has made data fabrication trivial, yet almost 4% of biomedical papers already contained duplicated or manipulated images as of 2016, before AI tools became available. The stakes are existential for model reliability when falsified data is used for training.

The path forward requires closing the loop between computational prediction and physical experimentation. Autonomous labs—operating around the clock and cycling through prediction, testing, and optimization while feeding results back into AI models—represent the industry's vision, but realizing it depends on integration: interoperable lab instruments, highly structured and comprehensive datasets, and data flowing freely in and out. Most labs today operate with standalone instruments in closed ecosystems. Until infrastructure enables FAIR data (findable, accessible, interoperable, reusable) generation at scale, the full potential of AI-driven drug discovery will remain constrained.