Read on Twitter
1/
Have I ever told y’all how much I loooove to give #feedback?
Here’s why:
1. It adds meaning to my work in #MedEd.
2. It honors the learners and the patients.
3. It informs my final evaluations.
4. It improves the learning climate.
5. It's necessary.
*Shout out to #2.
Have I ever told y’all how much I loooove to give #feedback?
Here’s why:
1. It adds meaning to my work in #MedEd.
2. It honors the learners and the patients.
3. It informs my final evaluations.
4. It improves the learning climate.
5. It's necessary.
*Shout out to #2.
2/
I know lots of experts have written and presented great stuff on this. But if #medtwitter has taught me nothing else, it's that we can always add new ways to look at stuff.
Right?
So with that, here’s my practical approach to feedback on the wards and in clinic. Ready?
I know lots of experts have written and presented great stuff on this. But if #medtwitter has taught me nothing else, it's that we can always add new ways to look at stuff.
Right?
So with that, here’s my practical approach to feedback on the wards and in clinic. Ready?
3/
Okay, so 1st, let’s quickly revisit how feedback was defined in Ende’s classic paper:
“an informed, nonevaluative, objective appraisal of performance intended to improve clinical skills”
(Ende J. Feedback in clinical medical education. JAMA. 1983;250:777–781)
Cool? Cool.
Okay, so 1st, let’s quickly revisit how feedback was defined in Ende’s classic paper:
“an informed, nonevaluative, objective appraisal of performance intended to improve clinical skills”
(Ende J. Feedback in clinical medical education. JAMA. 1983;250:777–781)
Cool? Cool.
4/
In other words:
1. YOU observed the learner. (No hearsay.)
2. You know that feedback & evaluation are different.
3. It's not your random feelings--it’s based on a standard.
4. Your goal is clinical improvement.
Repeating #4 one mo' time for the people in the back row!
In other words:
1. YOU observed the learner. (No hearsay.)
2. You know that feedback & evaluation are different.
3. It's not your random feelings--it’s based on a standard.
4. Your goal is clinical improvement.
Repeating #4 one mo' time for the people in the back row!
5/
Before you pass go: Acknowledge #bias of all kinds—especially your own. Such as but not limited to:
Race
Gender
Gender expression
Sexual orientation
Faith
Age
Weight
Skin shade (yep, that)
Language/How you talk (yes, that)
Because all of that can affect how we see. Right?
Before you pass go: Acknowledge #bias of all kinds—especially your own. Such as but not limited to:
Race
Gender
Gender expression
Sexual orientation
Faith
Age
Weight
Skin shade (yep, that)
Language/How you talk (yes, that)
Because all of that can affect how we see. Right?
6/
So first, I want you to put these 3 words on a mental (or real) post-it note:
EXPECTATIONS
TIMING
INTENTION
These 3 words serve as the foundation of how I approach feedback.
Okay. Let’s start with EXPECTATIONS. . . .
So first, I want you to put these 3 words on a mental (or real) post-it note:
EXPECTATIONS
TIMING
INTENTION
These 3 words serve as the foundation of how I approach feedback.
Okay. Let’s start with EXPECTATIONS. . . .
7/
It’s not rocket science. I mean, how can any learner expect to meet a standard that hasn’t been made clear to them? To be fair, we need to think about required things PLUS our own expectations for learners at each level.
But how?
Stay with me. I’m going somewhere.
It’s not rocket science. I mean, how can any learner expect to meet a standard that hasn’t been made clear to them? To be fair, we need to think about required things PLUS our own expectations for learners at each level.
But how?
Stay with me. I’m going somewhere.
8/
Here's my approach. . .
I give expectations using the 6 ACGME Core Competencies. To refresh you:
Medical Knowledge
Patient Care and Procedural Skills
Practice-based Learning and Improvement
Systems Based Practice
Interpersonal and Communication Skills
Professionalism
Here's my approach. . .
I give expectations using the 6 ACGME Core Competencies. To refresh you:
Medical Knowledge
Patient Care and Procedural Skills
Practice-based Learning and Improvement
Systems Based Practice
Interpersonal and Communication Skills
Professionalism
9/
So, I literally write these on the board or handout. Then, I go one competency at a time with my team.
“Professionalism is defined as.. . . . Our program expects. . . . . On this team, I expect. . . .”
I am explicit.
And I explain expectation by level of training.
Yup.
So, I literally write these on the board or handout. Then, I go one competency at a time with my team.
“Professionalism is defined as.. . . . Our program expects. . . . . On this team, I expect. . . .”
I am explicit.
And I explain expectation by level of training.
Yup.
10/
While the “I expect” piece may sound subjective, I see it as being clear. For example, my husband doesn’t like people eating in his car. My minivan? It could host a buffet for all I care.
Those "you-specific" things should be made transparent—but must be reasonable.
Yup.
While the “I expect” piece may sound subjective, I see it as being clear. For example, my husband doesn’t like people eating in his car. My minivan? It could host a buffet for all I care.
Those "you-specific" things should be made transparent—but must be reasonable.
Yup.
11/
After sharing expectations by each competency. This comes next (which includes timing):
Me: “You will also receive feedback this way—by competency. On the fly, at midpoint, and at the end of our time together.”
Then I tell them concretely how that will look.
Yup.
After sharing expectations by each competency. This comes next (which includes timing):
Me: “You will also receive feedback this way—by competency. On the fly, at midpoint, and at the end of our time together.”
Then I tell them concretely how that will look.
Yup.
12/
On-the-fly:
Me: “I want to give you some feedback. This falls under ‘Medical Knowledge.' On rounds, you checked Mr. Jones feet and backside for petechiae noting that it can be gravity dependent. You integrated your DIC differential with your exam. Great job.”
Make sense?
On-the-fly:
Me: “I want to give you some feedback. This falls under ‘Medical Knowledge.' On rounds, you checked Mr. Jones feet and backside for petechiae noting that it can be gravity dependent. You integrated your DIC differential with your exam. Great job.”
Make sense?
13/
My on-the-fly feedback occurs frequent enough to afford reinforcement of positives and correction of areas to improve. I keep track of it so that I can have examples for my evaluation.
But mostly? I keep track so that I can see how learner responded so we can build on it.
My on-the-fly feedback occurs frequent enough to afford reinforcement of positives and correction of areas to improve. I keep track of it so that I can have examples for my evaluation.
But mostly? I keep track so that I can see how learner responded so we can build on it.
14/
For midpoint and end-of-experience, we return to the 6 competencies. Then, I give explicit feedback just the way we started.
Why I love this:
One can be a rockstar in 2 competencies but need serious remediation in another. It allows honesty. No "sandwiches" needed.
Nope.
For midpoint and end-of-experience, we return to the 6 competencies. Then, I give explicit feedback just the way we started.
Why I love this:
One can be a rockstar in 2 competencies but need serious remediation in another. It allows honesty. No "sandwiches" needed.
Nope.
15/
This allows me to be explicit in each area. And throw out those subjective quirks that don’t fit anywhere. For example—me being slightly annoyed by the way you mash the elevator buttons incessantly on rounds? Yeah. That’s my problem. Not yours.
Got to remember the goal, man.
This allows me to be explicit in each area. And throw out those subjective quirks that don’t fit anywhere. For example—me being slightly annoyed by the way you mash the elevator buttons incessantly on rounds? Yeah. That’s my problem. Not yours.
Got to remember the goal, man.
16/
Another awesome thing is that it helps keep you objective for:
High achieving learners
Learners whom you like a lot
Issues of professionalism
Your own biases
Your own biases
With this framework, learners know what to expect.
And YOU have a guide.
It's win-win, man.
Another awesome thing is that it helps keep you objective for:
High achieving learners
Learners whom you like a lot
Issues of professionalism
Your own biases
Your own biases
With this framework, learners know what to expect.
And YOU have a guide.
It's win-win, man.
17/
Best of all? You started with expectations using the same format. So your learners knew their marching orders.
By the end of rotation, I've racked up examples under each competency. In my mind I arrange it this way:
What I saw
What we discussed
What you did after
Yup.
Best of all? You started with expectations using the same format. So your learners knew their marching orders.
By the end of rotation, I've racked up examples under each competency. In my mind I arrange it this way:
What I saw
What we discussed
What you did after
Yup.
18/
It feels SO good to be able to close a remediation loop because of ongoing, thoughtful feedback.
In sum--it comes down to those 3 words:
EXPECTATIONS (Using 6 competencies)
TIMING (On-the-fly, midpoint, end-of-rotation)
INTENTION (to help you improve)
So easy, right?
It feels SO good to be able to close a remediation loop because of ongoing, thoughtful feedback.
In sum--it comes down to those 3 words:
EXPECTATIONS (Using 6 competencies)
TIMING (On-the-fly, midpoint, end-of-rotation)
INTENTION (to help you improve)
So easy, right?
19/
And yes. We’ve added the Milestones. But the ACGME STILL says this about the competencies:
“The Competencies provide a conceptual framework describing the required domains for a trusted physician to enter autonomous practice.”
They also say this. . .
And yes. We’ve added the Milestones. But the ACGME STILL says this about the competencies:
“The Competencies provide a conceptual framework describing the required domains for a trusted physician to enter autonomous practice.”
They also say this. . .
20/
“These Competencies are core to the practice of all physicians, although the specifics are further defined by each specialty. The developmental trajectories in each of the Competencies are articulated through the Milestones for each specialty.”
Yup. They're still relevant.
“These Competencies are core to the practice of all physicians, although the specifics are further defined by each specialty. The developmental trajectories in each of the Competencies are articulated through the Milestones for each specialty.”
Yup. They're still relevant.
21/
Real talk? This approach has not only lightened my load and made my time with learners more enjoyable, it has also changed my evaluations. The narratives are more meaningful. I think it's because my efforts are more intentional and focused now.
Maybe.
Real talk? This approach has not only lightened my load and made my time with learners more enjoyable, it has also changed my evaluations. The narratives are more meaningful. I think it's because my efforts are more intentional and focused now.
Maybe.
22/
And how can I end this without sharing a great piece of advice from a Grady elder? She said:
“Start the game the way you want to finish it.”
Which, now that I think of it, sums up an entire #tweetorial in one sentence.
#remembertheendgame #thepatients #learnercentered
And how can I end this without sharing a great piece of advice from a Grady elder? She said:
“Start the game the way you want to finish it.”
Which, now that I think of it, sums up an entire #tweetorial in one sentence.
#remembertheendgame #thepatients #learnercentered
