The integration of artificial intelligence (AI) into healthcare is rapidly expanding, driven by persistent primary care provider shortages across the United States. Initiatives such as Mass General Brigham's (MGB) Care Connect program are deploying AI-supported telehealth to improve access to care, while broader discussions continue regarding AI's role in diagnosis, patient empowerment, administrative efficiency, and addressing rural healthcare challenges. This expansion is accompanied by ongoing debates concerning AI's accuracy, potential impact on human connection, data privacy, and the appropriate allocation of healthcare resources.
Primary Care Access Challenges Spur AI Adoption
A national shortage of primary care providers affects approximately 17% of adults in the U.S., with Massachusetts experiencing a faster decline in its primary care workforce than most other states. This scarcity has led to year-long waiting lists for in-person primary care appointments. In response, health networks like Mass General Brigham (MGB) have begun implementing AI-supported solutions.
AI-Supported Telehealth Programs: MGB Care Connect
In September, MGB launched Care Connect, an AI-supported telehealth program aimed at bridging the gap in primary care access. The program allows patients to interact with an AI agent via an app, describing their symptoms. The AI then compiles a summary for a remotely located primary care doctor, who provides care through video appointments, often within one to two days. Care Connect operates 24/7 with a staff of 12 remotely located physicians, serving 15,000 MGB patients who lack a primary care provider.
The program is designed to address common urgent care needs, including colds, rashes, sprains, and mild to moderate mental health concerns, as well as issues related to chronic diseases. The AI tool assists physicians by suggesting diagnoses and treatment plans. MGB has committed $400 million over five years to primary care services, including the Care Connect initiative, and states the program is not intended to replace in-person care. By February, MGB plans to extend Care Connect services to all insured residents of Massachusetts and New Hampshire, with additional doctors to be hired as needed.
Patients can use the service for urgent care or designate a remote doctor as their permanent primary care provider.
Broader AI Applications and Rural Healthcare Initiatives
Beyond direct patient care, AI is being integrated into various routine medical tasks such as note-taking, reviewing diagnostic results, billing, and supply ordering, aiming to reduce administrative workloads and mitigate staff burnout.
In the context of rural healthcare, where over 190 rural hospitals have closed between 2005 and early 2024, Dr. Mehmet Oz, head of the Centers for Medicare and Medicaid Services (CMS), proposed using AI to expand physician reach without increasing burnout. This proposal is part of a broader plan to modernize rural healthcare, which could include digital avatars for basic medical interviews, robotic systems for remote diagnostics, and drones for medication delivery. CMS clarified that these efforts emphasize "responsibly exploring tools" to extend the capabilities of licensed clinicians, not to replace them entirely, supporting evidence-based and patient-centered AI tools under appropriate clinical oversight.
Benefits and Potential of AI in Healthcare
Proponents of AI in healthcare highlight several potential benefits:
- Enhanced Access: AI-supported telehealth can provide rapid access to medical consultations, significantly reducing waiting times compared to traditional in-person appointments.
- Efficiency: AI tools can streamline administrative tasks, potentially freeing up clinicians to focus more on patient care and alleviating staff burnout. AI-generated chat summaries can enhance physician efficiency.
- Patient Empowerment: Patients report using AI for daily well-being and chronic condition management, tracking symptoms, exploring treatment options, and translating complex medical information. AI's capacity for extensive inquiry may help identify rare conditions.
- Personalized Information: Health-focused AI chatbots can offer more personalized and specific information by leveraging user-provided medical history, prescriptions, and age, compared to general internet searches.
- Addressing Shortages: Virtual options offer a practical way for patients to receive care in areas with scarce in-person options.
Concerns and Challenges
Despite the potential benefits, the integration of AI in healthcare raises several concerns:
Accuracy and Safety
-
Misdiagnosis and Misleading Advice: Risks of misdiagnosis, misleading advice, or "hallucinations" (incorrect information generated by AI) have been reported. One instance cited AI incorrectly advising ivermectin for testicular cancer, potentially delaying appropriate treatment. Another involved a patient experiencing paranoia after consulting AI about salt intake.
-
Inconsistent Performance: While some studies indicate large language models can perform competitively with humans in simulated diagnostic tests, their performance in real-world, less structured user interactions is reportedly inconsistent.
-
Emergency Triaging:
Research indicates AI may "under-triage" emergency medical cases, misjudging the urgency for care, particularly in time-sensitive scenarios.
Experts advise against using AI for triaging emergency situations.
Human Element and Trust
-
Loss of Connection:
Critics argue that AI avatars may remove essential human connection, trust, comfort, and continuity from healthcare, as AI tools cannot interpret nuanced human cues like facial expressions or body language.
-
Clinical Oversight: Patients and medical professionals emphasize that AI should not replace doctors and requires clinical oversight to mitigate risks of misdiagnosis or human misunderstanding.
Logistical and Economic Factors
-
Implementation Challenges: In rural areas, logistical challenges such as unreliable broadband, low health literacy, and fragile transportation systems could hinder AI functionality and exacerbate existing disparities.
-
Job Displacement and Investment Priorities: Concerns exist about AI potentially replacing local healthcare jobs.
Some primary care doctors within MGB, including those involved in unionizing efforts, have suggested that investment in AI should instead be directed towards increasing salaries and retaining primary care staff, fearing Care Connect could inadvertently diminish access to in-person primary care over time.
Data Privacy
- HIPAA Applicability: Information shared with AI companies through consumer-facing chatbots is not protected by the federal HIPAA law, which governs sensitive medical data disclosure by healthcare providers. While companies like OpenAI and Anthropic state that user health information is kept separate, subject to additional privacy protections, and not used for model training without user opt-in, consumers are advised to be aware of these differing privacy standards.
Expert Perspectives and Future Outlook
Healthcare leaders and experts offer varied perspectives on AI's role:
- Dr. Steven Lin (Stanford University School of Medicine) suggests that AI tools are safest for acute urgent care issues, while ongoing management of complex chronic conditions benefits significantly from in-person human interaction.
- Carrie Henning-Smith (University of Minnesota's Rural Health Research Center) expressed concerns about implementing unproven technology in underserved populations and hopes that discussions extend beyond cost savings to avoid creating a two-tiered healthcare system.
- Dr. Robert Wachter (University of California, San Francisco), while acknowledging hazards, expressed optimism that AI's benefits may outweigh its risks and views it as a necessary aid for a struggling healthcare system.
- Dr. Adam Rodman (Harvard Medical School) advises against using AI for triaging emergencies but sees value in it for preparing for or following up on doctor visits.
The integration of AI into medicine is described as rapid. Experts anticipate that AI will become more embedded in healthcare, with both humans and AI adapting to work together. There is hope that this technology will enhance human aspects of medicine, such as communication, rather than diminish the doctor-patient relationship. For current users, recommendations include providing detailed information to chatbots, seeking multiple opinions from different platforms, and maintaining a degree of skepticism, especially for significant medical decisions. CMS has not yet confirmed if AI avatars will become a formal part of the agency's rural health strategy.