Tag Archives: Training

AI Can Raise the floor, But People Determine The Ceiling.

AI readiness is often treated as a technical skill, as though one could study for it, take a test, and be done. It is a pitfall particularly in education – what does it even mean to teach residents to be ready for the AI age?

Researchers at UT Austin asked 523 early-career professionals to do client-like work with an AI agent, then compared their results with an AI-only baseline. About half were “AI Amplifiers”: they did better than AI alone. A quarter were “Delegators”: their work was about as good as the AI’s. The rest, “Apprentices,” did worse, even though they were not necessarily less capable.

Yes – about a quarter of the early-career professional appeared to produce worse outputs when using AI compared to than just having it done by AI alone. (The reality is probably that the researchers were better prompt engineers than the apprentices).

Strong users framed the problem, used real domain knowledge, checked the output, and refined it over several rounds. AI was used as a collaborator that needed direction and oversight.

This feels familiar in resident education. An algorithm can produce a useful first pass. Safe clinical value still depends on whether the clinician asks the right question, spots what does not fit, and knows what to do next.

The lesson is not to teach longer prompts. It is to teach judgment in the workflow: frame, check, refine, decide.

AI can raise the floor. People still determine the ceiling.

Source: McCombs School of Business, University of Texas at Austin.

The “Why” Question

When applying to residency, and perhaps to no one’s surprise, I always wanted to be asked during interview, “Why do you want to be a radiologist?” The “Why” question was an easy one to answer. After all, there was plenty to love about radiology – the challenge of solving a clinical diagnostic dilemma, the impact of catching an unsuspected Pancoast tumor, the satisfaction of revascularizing precious cerebral pneumbra. A better qualified medical student than I could discuss her scientific breakthrough, global health endeavor, and political leadership.

Change can unsettle even the best-prepared residents.

As medical students, we loved radiology for all the right reasons and wanted to talk about them. However, my generation of radiology trainees, the medical students who so eagerly entered this profession now grow concerned.

Indeed, my upper class colleagues were among the first to experience the radiology core exam. They were the first to experience the fourth year clinical concentration. They were the first to finish training not as board-certified radiologists, but board eligible. The changes do not end with training. No, the world we graduate residency into is brimming with uncertainty. My generation of radiologists will face evolving hiring trends, increasingly impersonal workflow, and dwindling Medicare reimbursement rates. We will be frontline soldiers in the ongoing battle between on-site radiologists and evolving teleradiology practices. We will comprise the proud new face of our profession, tasked to prove its value.

Change can unsettle even the best-prepared residents. I attended a recent Philadelphia Roentgen Ray Society meeting on the impact of the new American Board of Radiology examination changes followed by a panel discussion. Trainees and established radiologists filled the room, the air thick with uncertainty. I sat in the audience trying to absorb all the changes in the new ABR examination, the curricular changes in the final year of radiology, and the rippling effects they may have on the hiring process. Dazzled, I wondered how a modern radiology resident could expect to succeed when the metrics of success is a moving target. Eager for fresh air, I walked around the city before returning home.

Treading the paved urban sidewalk that evening, I walked past one of the new high-rise apartments in the city. When I began residency training three years ago, it was a construction site, little more than a steel frame wrapped in concrete. A year later, the building stood tall with large glass window panes, its lobby furnished with chiseled marble and glistening tiles. A little further to the east, a fresh construction site broke ground, born from the husk of an old store. Nascent city-sponsored self- service bicycle renting eased busy traffic, and pedestrians hurried past taxicabs in favor of rides hailed from the Internet.

Trainees who joined the profession looking for opportunities to improve care quality will find external change the best platform to introduce innovation.

Our world changes by the day, and it brings a nervous energy that is equal parts uncertainty and excitement. Practice change occurs at all levels in radiology, often for the better. Increasing awareness of radiation exposure in the public brought dose reduction techniques and dual energy systems into the forefront of CT research. The evolving reimbursement patterns fueled the American College of Radiology’s increasing emphasis on value-based imaging. Trainees who joined the profession looking for opportunities to improve care quality will find external change the best platform to introduce innovation.

Finally, some changes are frightening and some exciting, but parts of radiology simply have not changed at all. During a night shift several months ago a neurology resident asked me to review a head CT. The ordering provider did not see an abnormality but, “just wanted to be sure.” On a careful second perusal, a thin sheet of dense material revealed to be layering hemorrhage in the left middle cranial fossa, subtle but unmistakable when viewed from proper projection. The patient received close follow- up and the expanding hematoma expediently managed overnight.

The fulfillment of peering into a clinical problem to make an impact on a person’s life is a constant in radiology. In fact, so are most of those good answers that had compelled us to choose this profession in the first place. Perhaps therein lies the importance of asking ourselves the “Why” question. During this lengthy and rewarding training process, our answers to, “Why did I want to be a radiologist?” too will change. These answers form the compass as we wade through new uncharted waters. They give us the courage to sail ahead knowing the right direction, ready to tackle the thundering clouds that loom ahead.

I would not have a career any other way.

This post originally appeared in the January, 2015 Pennsylvania Radiology Society Newsletter.

The Gorilla Detection Exercises at Dawn – A Theory of Radiology Nightfloat

As a rite of passage as well as part of the regular work schedules of a radiologist, a resident trainee must take on the role of independent interpretation for exams that come into the hospital at night.  I happen to work at a place where attending backup is readily available by phone, but an attending radiologist is not in-house at night.  This provides an abundance of learning opportunities.

After finishing one week of radiology night duties as one of two trainees, I’ve begun to think how the progression of the night always seem to follow some pattern, and what that means for a radiologist trainee on call.

Pareto-Efficient

First, it’s probably useful to introduce the concept of a pareto-efficient curve. The curve explains the relationship between two desirable but partially mutually exclusive qualities.  For example, a radiologist wants to be very fast at interpreting studies.  A radiologist also wants to provide very high quality interpretations.  Alas, we cannot do both at the maximal capacity.  One might imagine the relationship between the two to look like this:

pec1

Standard pareto-efficiency curve

Continue reading