Cloud Blog: Inside the AI-powered assistant helping doctors work faster and better at Seattle Children’s Hospital

Source URL: https://cloud.google.com/blog/topics/healthcare-life-sciences/child-care-how-ai-is-transforming-pediatric-medicine-at-seattle-childrens/
Source: Cloud Blog
Title: Inside the AI-powered assistant helping doctors work faster and better at Seattle Children’s Hospital

Feedly Summary: Though its name may suggest otherwise, Seattle Children’s is the largest pediatric healthcare system in the world. 
While its main campus is in its namesake city, Seattle Children’s also encompasses 47 satellite hospitals across Alaska, Montana, Idaho, and Washington, and patients come from as far away as Hawaii for treatment. For more than 100 years, Seattle Children’s has helped kids across the Western U.S. get healthy and stay healthy, regardless of the ability to pay.
With so much ground to cover and diverse patient populations to treat, Seattle Children’s has always looked to new technologies to bring improved, consistent care to its patients and providers. Generative AI is now the latest advance in their medical toolkit.
It started roughly two decades ago, when Seattle Children’s created its pediatric clinical pathways, a set of standardized protocols designed to help clinicians make quicker and more reliable decisions to address dozens of medical conditions. Such pathways were becoming commonplace across medicine, and Seattle Children’s had developed some of the first for children’s unique medical needs.
Innovative as these were, they still required clinicians to thumb through indexes and long binders of information to find what they needed for a given ailment. And in healthcare, it’s often the case that every second counts. 
Seattle Children’s was already working with Google Cloud on a number of projects, and as we began to explore the potential for generative AI to make the work of our clinicians easier, the clinical pathways seemed like an obvious place to start. Using  Vertex AI and Gemini, we were able to quickly develop our Pathways Assistant, which took training from the clinical pathways documentation and supercharged it with not just searchability but conversationality. 
Instead of flipping pages, we’d flipped the script on how quickly and reliably clinicians could find the lifesaving information they needed.
The pathways to improved healthcare run through Gemini“Clinical pathways” are end-to-end treatment protocols for a specific condition or illness. Seattle Children’s pediatric clinical pathways are widely respected and used by hospitals around the globe, providing information on everything from diagnostic criteria to testing protocols to medication recommendations. 
Previously, these clinical pathways were documented exclusively in PDFs — hundreds of thousands of pages of them. Performing a traditional search of their contents for the answers clinicians needed delayed their ability to provide treatment in an environment where minutes or even seconds can be critical.

Google Cloud engineers worked with Seattle Children’s informatics physicians, who straddle the worlds of healthcare and technology, to create Pathway Assistant. The new multimodal AI chatbot that responds to spoken or written natural-language queries using the information in those PDFs.
After processing a question, Pathway Assistant searches each PDF’s metadata, which contains semi-structured data in JSON format that’s been extracted from the PDFs by Gemini and curated by clinicians. It then selects the most relevant PDFs, parses the information — including any complex flowcharts, diagrams, and illustrations embedded in them — and answers the clinician’s question in just a few seconds. 
Interactive information-finding for accurate decision-makingPathway Assistant becomes more accurate with use. Healthcare providers can “discuss” clinical pathways with the chatbot, which, instead of answering a question, poses questions of its own if it needs clarification, going back and forth until it’s confident it can answer accurately.  The chatbot always displays the specific sections of each PDF that was the source for formulating  its answers, helping clinicians confirm the veracity of responses.
The interface also includes a way for users to provide feedback about the accuracy and appropriateness of the chatbot’s analysis and answers. The feedback is then logged in a BigQuery table for future forensic analysis — both by clinicians, who can query the information using natural language, and by the built-in Gemini models, which processes the feedback and summarizes what clinicians found confusing or how to improve the accuracy of future answers.

This reflexive capability enables Pathway Assistant to update the PDFs based on clinicians’ feedback if the inaccuracy stemmed from the PDF’s content. Clinicians are also finding that the metadata is becoming more accurate and requiring less curation. Pathway Assistant even corrects typos in the documentation automatically. And as new clinical pathways are developed, PDFs containing the latest information are added to the PDF library. 
This growing collection is housed securely in Google Cloud Storage, and the bigger it gets, the more useful it becomes — which wasn’t always the case. Whereas an expanding paper-based collection contained more information, it was also more material to wade through, which is especially challenging in emergency medical situations. Pathway Assistant almost entirely relieves this burden, synthesizing and delivering the most complete information at any time in a matter of seconds.

Seattle Children’s Hospital – chatbot demo

Ultimately, Pathway Assistant is not a decision-making tool but rather an information-finding tool. Research into critical, evidence-based guidelines that used to take hours now takes minutes. 
This speed and effectiveness helps clinicians make the right decisions more quickly at the point of care, drastically reducing research time and improving patient safety and outcomes. Ultimately, clinicians can  spend more time with more patients, not with more PDFs. 
Ask any physician, they’ll tell you that’s what the best medical technology enables them to do — focus on the patient, not paperwork.

AI Summary and Description: Yes

**Summary:** The text discusses how Seattle Children’s Hospital has integrated Generative AI, specifically through the development of the Pathways Assistant, to enhance the efficiency and speed of accessing clinical pathways for patient care. This innovation highlights the intersection of healthcare and AI, showcasing the implications for improved decision-making in critical scenarios.

**Detailed Description:**
The article highlights several important advancements in healthcare technology due to the integration of Generative AI, specifically focusing on the Pathways Assistant developed by Seattle Children’s Hospital in collaboration with Google Cloud. Here are some major points of significance:

– **Generative AI Implementation:**
– The Pathways Assistant uses generative AI tools (Vertex AI and Gemini) to streamline access to pediatric clinical pathways.
– This assistant enables clinicians to retrieve vital information using natural language, effectively replacing traditional PDF searches with a conversational interface.

– **Historical Context and Evolution:**
– Seattle Children’s has been a pioneer in pediatric clinical pathways for over 100 years, previously documenting them in hundreds of thousands of PDF pages.
– The shift from static documents to a dynamic AI assistant represents a significant leap in healthcare technology.

– **Pathway Assistant Functionality:**
– The assistant processes queries, searches through relevant metadata, and delivers precise answers rapidly.
– The chatbot is designed to interactively clarify questions, ensuring accuracy and transparency in responses by referencing specific sections of the source documents.

– **Feedback Loop for Continuous Improvement:**
– Clinicians can provide feedback on the bot’s answers, which informs future AI training and updates to the underlying documents.
– The assistant can even automate corrections in documentation, enhancing the overall quality of information over time.

– **Operational Impact:**
– The use of the Pathways Assistant can drastically reduce the time needed for research, down to minutes rather than hours.
– Improved information access directly leads to better patient outcomes by allowing clinicians to devote more time to patient care rather than administrative tasks.

– **Security and Storage:**
– The integration and development of the Pathways Assistant are housed securely in Google Cloud Storage, ensuring the confidentiality and integrity of sensitive healthcare data.

Overall, the implementation of Generative AI in a pediatric healthcare setting demonstrates a significant advancement in clinical efficiency, with profound implications for patient care, resource management, and medical technology practices. This development is particularly relevant for professionals focused on AI security, healthcare technology, and compliance in data management.