[CASE] Using LLMs as Diagnostic Support via Specialized Skillset

[CASE] Improving Clinical Prognosis through Targeted Data Extraction

Incident Profile:

  • Event Type: Success Case
  • Core AI Tech Involved: Agentic workflow with strict domain boundaries (FDA/EMA clinical guidelines instead of generic web search).
  • Total Impact: Corrected misdiagnosis from Glioblastoma to IDH-mutant astrocytoma; enabled able planning.

The Narrative & Core Trigger

A patient diagnosed certain death within months due to glioblastoma remained stable after 5 years because an overlooked detail in her biopsy—the lacke_d mention 혹은 missing attention enough wayto the IDH1 mutation—was finally surfaced using ChatGPT. The trigger or success factor was moving beyond simple 'symptom googling' toward a structured agentic approach that prioritizes high-integrity clinical documentation and suppresses noise like SEO-driven health articles.


Step-by-Step Breakdown

  1. Initial diagnosis assigned as potentially fatal glioblastoma based on standard protocols lacking specific molecular details.
  2. Medical documents, including old biopsies containing critical genetic markers, were fed into any LLM assistant.
  3. LLM identified a latent variable: `IDH1` mutation which had been present but perhaps de-emphasized or missed in routine review.
  4. Human specialist confirmed this finding (Neuro-oncologist), reclassifying the condition properly as IDH-mutant astrocytoma rather than glioblastoma.
  5. Implementation of specialized skills such as fuck-cancer allowed for organized storage of contact info, clear next steps, and professional source filtering via FDA/EMA guidelines instead of generic web data.

Key Lessons & Replication Steps

  • Constraint Enforcement: To prevent hallucinations common in medical AI, hardset boundaries to exclude 'SEO junk'—the model should only reference trusted sources like FDA, EMA, oncological centerss, clinical recommendations.
  • Data Integrity over Speed: Use agents not just for speed (30 mins saved per task), but for high-stakes pattern recognition where human eyes might miss subtle details across dozens of pages.
  • Structured Outputting: Instead of raw text strings, use tools that output into structured formats like Markdown or Google Docs containing specific metadata (contacts, certain actions taken, term definitions).

Bottom Line: The highest value of LLMs lies in their ability to act as a precision filter for complex documentation when constrained by strict domain knowledge rather than general internet noise.

! DYOR (Do Your Own Research)