So I will try to, I don't have access, oh, I can share my screen. I'm going to share my screen. And first, Thomas, you led me to believe that what I'm showing you might not answer all your questions, because I think there's a lot of information about the SUP app that is relevant to the content of the SUP app but maybe doesn't explain the impetus for the SUP app. So I'm happy, what I'll do is I'll walk through the supplemental errors application first, and then if there are questions about the background or questions about where to send signals, because I think that that is a really good point, especially for the different specialties, each specialty can have their own decision on whether or not you signal your home or away institution. So that will lead us into a different conversation. But what I'm going to do is walk you through the SUP app first. And please know that you can interrupt me at any time, you can ask questions, just shout them out, and we'll try to answer them as we go. No, that sounds completely reasonable, by the way, and I won't interrupt you all any further. But no, that sounds like a reasonable course of action. So you're good to go. We appreciate any help. Okay. So I have 100 applications open on my screen, so I just need to make sure I open the right one. I'm sure you all deal with that as well. Go ahead. Sorry, before you start, if you're not speaking, because Jamie's going to be speaking for a while, if you could make sure to mute yourself, because we hear some pushing or popping them out, that would be great. Thanks. I had to shut my door, too, in case it was me. So what you're seeing right now, I think, can you see something on the screen that says instructions? Yes. Okay, perfect. So when an applicant starts in MyERIS application, they also get a link to complete the supplemental ERIS application. They'll get the link. This link will take them to this page. For them, they will also see their AAMC ID number here, so it's tied to their application. We ask them to fill out, you know, welcome them. We tell them that these are the sections in the supplemental ERIS application, which is past experiences, geographic preferences, and program signals, or some people call them preference signals. We ask them to read the instructions, which we're not sure that anybody does, but we have them available. And then, depending on which specialty they're applying to, or multiple, they'll select their option. In this case, we're going to select physical medicine and rehabilitation. And let's just also select, where's a good cross-applicant? Is that internal medicine, family med, general surgery? Anyone? Neurology. Neurology. Okay, so we'll click neurology. Well, we'll click, yeah, neurology. So in this case, and the reason why this is important is because you see stars here on emergency medicine and OB-GYN, obstetrics and gynecology. If they were to only select those two options, they would be brought only to preference signals, meaning that OB-GYN and emergency medicine are not participating in experiences section or geographic preferences section. So those students would only be asked questions about program signals, and only OB-GYN and emergency medicine would only see responses for program signals. But in this case, they're applying to two specialties that are participating in all three sections. So they click that, click next, and they are brought to the experiences section of the application. The second part of the application is optional, so they can skip, they can add some experiences, or they can add all experiences. They have up to five experiences that they can select. We request that they provide a title, organizational name, a start and end date, frequency of that participation. I'm happy to click through each of these so that you can see them. Here are all the instructions in the worksheet that I provided in advance, their setting preference, the experience type. And this is what is new for this year, as opposed to last year. We ask them to identify one primary focus area, of which these are the options that our focus groups chose from. Then we ask them to identify a key characteristic that was important to the program directors of our focus groups. And they can only choose one. We ask them to describe that experience, why was it meaningful, and how it influenced them. And we ask them to focus on weaving in the characteristic and the focus area that they selected. This must be done in 300 characters or less. We do, in our instructions, let them know that it can and probably should be weaved in with your MyERIS application right now. That experience section is unlimited. They can have unlimited amount of experiences. And so what we heard from program directors was that there's too much information to read. And so that's why we've narrowed them down to five. And they, in the MyERIS application, don't explain why it was meaningful or how it influenced them. They simply explain what the experience was. This is our job, and this is why I think background is a little bit important. In the SUP app, we call it the Supplemental ERIS Application, but the goal is really to refresh ERIS content. It hasn't been updated since 1996. And so we were testing this content out to see how it helps program directors and how it helps applicants convey their messaging. And our goal is to take all of this content, research, do analysis on it, and then move it into the ERIS application if it survives. So that's why there is some duplicity right now with the experience section. But this gives you an idea. They have the option to select up to five experiences. I'm going to stop on experiences right now and ask if there are any questions specifically about the content of the application for experiences that you wanted to ask. Can I ask a question? I'm sorry. Of course. I just want to be sure. This is my first time, so please excuse my noviceness. But the information provided here in the supplemental application is information that we shouldn't be reviewing information that's already explained or regurgitated. This is more like to provide in-depth, meaningful information that may just correspond with the application, so that we should just not be regurgitating reading, regurgitating information. I just want to be clear. Correct. And I can't tell if you're speaking from an applicant perspective or you're speaking from a coordinator perspective. So what we've advised our applicants to do is to review all of their experiences from the MyERIS application and select the five that are most meaningful to them, and then describe why it's meaningful and how it's impactful. So they really go hand in hand, and they're not repetitive. Does that answer your question? Right. Yes, ma'am. I'm from a coordinator point of view. Thank you. And then I think it'll be helpful to show you how that appears in the program director's workstation after we go through this, because that may connect some dots. So that's the experience section. This is just the five experiences. Again, all optional. Then the applicants select the next tab. And here's where applicants talk about their impactful experiences. We noted last year that around 70% of applicants of the three specialties, so last year was the first year we implemented the supplemental MyERIS application with dermatology, internal medicine, and general surgery. And we noted that 70% of applicants filled out this essay. This year we've tried to make some really clear instructions that this is not intended for everyone to have an impactful experience. It's really intended for people that have had significant challenges or hardships that influence their journey to residency. We specify here on screen, it could be related to family background, financial background, community setting, educational experiences, and or general life experiences. So, you know, last year, and unfortunately for all of us, last year there was a lot of impactful news about COVID and how it impacted their journey to residency. In reality, when we created this, it was really to understand that background of a student and an applicant that they might not be able to provide it elsewhere in their application. So that's what this section is for. And we do think we'll see a little bit of an impact in not seeing as much essays this year. Any questions about the other impactful experience section? Okay. So we have the geographic preferences section. And this section, again, the impetus for this section for some background is that we noted that many applicants wanted to be able to convey that right now their medical school might be in New York, and their hometown might be Maryland, but they weren't able to convey to you and your programs in California, why they would be interested in going to California. And so we see through data that a majority of applicants end up in residency near their medical school or near their hometown, when programs sometimes are just making inferences that these applicants want to be there. And so this allows the applicant the opportunity to explain to programs why they want to be in these locations. And then the medical school, sorry, and the programs can choose to use that information if they'd like. We did notice that applicants last year chose to take advantage of this opportunity. And so the majority of respondents did reply. So we ask applicants to identify up to three census division areas where they're interested in. And so they can select West, South Central, and Pacific. And then they describe in 300 characters, which is about a sentence or two, why they want to be there. Most common, my spouse actually already got a job there. My grandparents live there. I've always wanted to live there. So this gives you a little more context as to why someone that is completely not from or has no indication or you have no indication that they're from that area or want to live in that area, why they might have a preference for that area. What's important about this section is if they've selected your geographic region, you will see in the PDWS, and I'll show you, you will see a response that says, yes, I prefer to be in your region. And you will see their response if they provided a response. But if you happen to be, we'll use New England as an example. If you happen to be in New England and the applicant did not select New England, you simply won't see anything for geographic preferences if they did not select your region. You won't see that they have selected different regions. You just won't see that they have a preference for your region. You can filter by this criteria. And you can see this in their application. I'm going to pause there for questions about geographic preference. The last one is I do not have a division preference. And in this case, if someone selects I do not have a geographic preference, every program that the applicant applies to will see that they do not have a geographic preference. And the applicant can choose to provide a response. And we noticed last year that many of our IMG applicants did not have a division preference. What's important to note also about geographic preferences and experiences as this is not tied to the program. If you're participating, if your program is participating, you will receive geographic preference and experience data. Last with geographic preferences is the setting preference. Some programs, it doesn't really matter to them. We think that for primary care settings, it mattered most. A lot of academic health centers are already in urban areas. But as we try to ensure that applicants can convey their preferences to you all, they can select from their strong preference for rural all the way up to strong preference for urban. They can also, again, skip the question or say they have no preference. Anyone who is participating, any program that's participating will see every response. So different than geographic preference, we don't have any sort of baseline data to say your program's in Baltimore, Maryland. We know that that's urban. So we're only going to provide you with applicant information if they selected urban. We don't have that. So we provide everyone with that information. The next section, which I think is where a lot of the questions end up falling, is program signals. So in this case, the applicant, again, chooses which specialties they're interested in applying to. And in this case, we're applying to, sorry, PM&R and adult neurology. So here, neurology has said that you can have three preference signals for adult neurology. And all that we've done is every participating program for adult neurology is listed here. Only the participating programs are listed. So the applicant can select for the programs that they're interested in applying. In this case, they're going to apply to VCU, Baylor, and Cleveland Clinic. And PM&R has indicated that they want applicants to have up to four signals. So in this case, the applicant can select from the participating programs which programs they are interested in setting a program signal to. I'm going to show you one more just because I think that there are a lot of questions about this. Let's go to... So if you see here on screen, psychiatry has said that they they specified that a home program, meaning your medical school, if they have a psychiatry program, might not want you to signal them. For PM&R and adult neurology, you guys didn't differentiate. It is important to convey where you're interested in, regardless of whether that is your home or your way institution. That was ideally what AAMC had suggested that all specialties do, but not all specialties wanted to do that. So we allowed specialties to make independent decisions. So for PM&R, that means that if you happen to have, so Albany Medical Center is a good Medical Center, if the student had gone to that home institution, even if they're interested in their home institution, they would still want to send a signal so that Albany knows that they want to go there, whether that's their home or away institution. So for PM&R, your applicant should be signaling everywhere they want to go. And that does include their home institution or any institution that they have done an away rotation at. The reason why some specialties decided not to do that was ENT had done that the first year. And I don't know how much history you guys have, but ENT was the first one to do program signals three years ago now. And they were a little concerned with programs that were at the home institution, giving students a hard time if they chose not to signal their own home institution. So they decided it's kind of a wash. So they would consider, what they said is they would consider everybody from their home institution, which is really a small number to quote unquote, even though they didn't send a signal, it allows them to get a look anyway. Most of the other specialties, especially when they're smaller specialties, they really want to know, are you interested in my school? Are you interested in my program? And so that's why it was important for the applicant to signal. Also, when you go in the PDWS, when you and your program directors utilize the PDWS, it's much easier to filter and sort if you have all of the information housed there rather than, oh, I have to remember that only people that are not home have signaled. And if they are home, I've got to run a different filter to figure out how to put them in the same group as these other applicants. So it was built from a logistical process and to ensure that applicants are really utilizing all their signals appropriately. It is to allow them to say, I have a preference for this institution. I know I've spoken a lot, but I know program signals is probably where the most questions lie in. Let's ask if there's any questions specifically about program and preference signals right now. I have a question. Sure. So is it not advised if like our program, even though the specialty has said, you know, all students should be signaling even if it's their home institution or rotating, can we still as a program, like choose to tell our students, our home institution students, like we don't need you to use a signal if you, like we will consider you the same. I just, I mean, we want to do that. I know some other, I've heard some other programs that are also doing that. And I'm getting questions from our rotating students, if we're going to require it or not, which we don't want to, but we also don't want to like break any rules by telling people we don't use a signal. I mean, in terms of rules, you know, like we're, we're, we're not enforcing any rules to the, to you or to the applicants. Here's why it's important. If you've told five of your students that, and seven of them don't know you're, you're putting some of these students at a disadvantage because they could have signaled other programs and utilize that signal differently. And your specialty made a choice to try to do that collectively so that there's not misunderstanding or misinterpretation of how to use those signals. So it would be against, you know, our advice to do something that's different from what we tell every applicant to do on the instruction guide. That's why we asked them to, you know, make that decision for the specialty. But I, I can't enforce that for you. I just think in terms of, you know, our, our job is to always look at fairness. Are we being fair to all applicants across all boards? And in that case, you, you are in a sense, you could be putting some applicants at a disadvantage. You're also in that case, you know, another, you know, if, if you are really their top choice, but they have this extra signal, you're, you're, you might be putting another program at a disadvantage, your own, you know, specialty, another program at a disadvantage because they think, oh, I'm one of their four, but really they're one of their five or six or whoever has decided differently than what the specialty decided, depending how many of you say, well, I'm going to deviate from this process. So that's where, you know, I think that's where fairness comes into play. And just trying to communicate the same message across the board to all the applicants that are applying in your specialty. Thank you. Okay. I just want to confirm again, this is my first year doing this. So signals is really my understanding just for us to understand who really wants to come to our program. Like it's, it's for the program coordinator, it's for the program director to really understand, get a better gauge of like, oh, wow, they, they signal to us. So they really want to know. They really want us to know that they want to come here, but we cannot use someone who did not signal. Like we can't use that against them. Correct. You wouldn't want to, right? Because I don't have this off of the top of my head. I could pull this, but it looks like there's at least a hundred programs participating. I could be wrong, but I do have that written down somewhere. Of those, you only get, you know, you only get four. And so that, what we tried to do is make sure that's around 5% of the total number of average applications and applicants said that's where the four came from. So that's what we advise every specialty to, to be around that number. So you wouldn't want to say, well, everyone that hasn't signaled me, I'm not going to look at, because one, depending on where your location is, depending on what your, you know, what your program attributes are, you might not have enough signals to your program in order to say, I'm only going to look at these individuals. It also doesn't mean that by someone sending you a signal that they're qualified to go to your institution, you might have other qualifications that you're looking for. So a signal doesn't mean that they're qualified. It just means that they're very, very interested. So it just gives you another layer of information about that applicant to say, maybe I wouldn't have looked at them because they're in California or because, you know, they're not from a school that I normally look at. It allows you just an extra piece of information, but we would never encourage you to not look at other candidates. We just want to give you another layer of information when the applicants are applying to an app, you know, the high average of programs, it's hard to discern what their real, what their real interest is. So it's just giving you another layer of information. Right. And we can, you said we can also see who else they signaled as well? You cannot. You can only see that they signaled your institution. You can't see that they have signaled other institutions. And remember that this is voluntary for all applicants. And some, so some applicants might choose not even to fill out the Supplemental Heiress application. I will tell you that the majority of applicants last year, which was the first year with only those three specialties did fill out the Supplemental Heiress application, but it's possible that you don't see a program signal because that applicant simply didn't, didn't fill out the application. So there's a lot of, you know, there's a lot of reasons why an applicant might not have signaled you. Other questions? So just for clarification, so I see that it has like the adult neurology programs and then, you know, the PM&R programs. So can they put the same signals for like another program then? So, so the first one has Virginia, Baylor and Cleveland Clinic. Could they put that for PM&R and just like leave one blank or can they only do that once? They can only do the signal once. I'm not sure I understand that these, these numbers right here are their ACGME IDs. So these, these, these dropdowns are only, only for programs that, that are participating from adult neurology. These programs right here are only programs from PM&R. So they can't use, if they, they can't use like seven signals for one specialty. So yeah, not, not consider, okay, so per specialty. So the first one, if they, they've got Virginia, Baylor, Cleveland Clinic for PM&R, could they put Virginia, Baylor, Cleveland Clinic, and then if they don't want to signal a fourth one or? Yeah, they could put whatever they could. If Virginia is participating, which it looks like Virginia is participating here, they could put nothing. Sorry, that did not change back. They could put nothing. They could put Cleveland Clinic here, but you see this. So it depends like, you know, if you're a program coordinator for multiple specialties, you'll be able to log in and see the applicant twice, but you'll never be able to see the applicant together. So, so this Cleveland Clinic, this ACGME ID is just for adult neurology. So that's where this signal will go. When you open up the application, this applicant, you'll, you'll be in adult neurology. You'll only see that they have signaled your specialty and your program. If then you'll have to re-log in or, or toggle your system to be in PM&R if, if you have access to both, and you could see that the applicant also signaled or did not signal your program for PM&R. It's not as common as, or we don't think that's as common. Perhaps it is, but, but yes, an applicant can choose to signal different specialties differently and not have the same. And like, here's an example. I know that Emory is participating for one specialty, but they've decided not to participate for another specialty. So not all of them chose to participate because it was up to the program, not, it was up to each program to decide to participate. Okay. You definitely answered my question. Thank you very much. Other questions? There was a question in the chat. That was good. Let me try to see if I can. So this one just says our medical school did that. Students do not have to signal us. I think the question was, where do we see the signal? Okay. Where do we see the signal? Richard, are you on this call yet? Yeah, I am online. I don't know if you were here when I said that you would be joining us and give us access to the PDWS because I thought it would be also helpful to see where they could see things. So Richard, I'm going to stop sharing my screen and unless you want me to open it on staging in mine. I can open it up on my end. Perfect. So Richard works with our team in ARIS and he is going to walk through a couple pieces of the program director's workstation while he pulls that up. Just like I explained, we don't have a lot of data in staging, so we're showing you where it lives, but you're not going to see a lot of data. Yep. Thank you, Jamie. And it's good to see you all again. I think I presented for you a couple of years ago for an ARIS update. So I'm glad that I can provide this little overview for you all. So I'm probably going to mirror a little bit of what Jamie's already talked about on the applicant perspective, but show it on the program's perspective instead. So you're going to see a lot of mirroring as far as the features that are available that the applicants provided and the data that they provided. So let's go ahead and just start with a demo and get right into it. So if you can see my screen right now, this is probably what you're familiar with in the program director's workstation. I skipped a lot of the extra stuff in the beginning just because I'm assuming that you know how to get into the PDWS and open up an application in the PDWS. So typically what you'll see on the applicant's page, as usual on the top left hand side, this is where you're going to see the usual applicant's data or details. You have their AMC ID, you have their first name, you have their contact information, even the tracks and education. It's also where you will see the embedded information for the program signal and the information for geographic preference and setting reference to as well. Just in case of you're new, I think somebody mentioned that this is their first year in the PDWS. So let me go ahead and backtrack actually and show you how I got to this page. When you first log into the PDWS or the program director's workstation, this is the dashboard. To get to an individual's application, you go to the applications tab. If you hover over it, you can go directly to current results. The current results will give you a full list of applicants that apply to your program. Let me go ahead and find that applicant that I heard earlier. If you want to see the applicant's page, you can just click on their name. As you can see, just to kind of highlight little bits here, you'll see that new applications will be highlighted. It means that you're looking at them at an individual level. So firstly, for the program signal and the geographic preferences, as Jamie mentioned, for your program, typically you'll see kind of three different options here. Sorry, two options here. Either they signal your program with a yes and it'll say yes, or it won't show any information to indicate that either they did not signal your program or they opted to skip the section. So the program signal is fairly straightforward in how they display here. Below that, we have the geographic preference. And the geographic preference has two sections in it. It has the division preference that Jamie mentioned earlier. It allows them to select the specific division or census division. In this case, it's Middle Atlantic. It gives them a little blurb to explain why that's the case. And the second piece here is they're also able to indicate their setting preference, too, as well. So you'll see here in this case, it says slightly prefer rural. The other options, of course, are if they're preferring urban environments or urban urban settings. Same thing as the division preference. There's a little blurb here that allows them to explain that selection. I'm going to actually take a moment here to share two links into the chat. And Jamie may have already shared this with you all, or maybe your specialty leadership has already shared this, or maybe you've seen this in our communications. These are two very useful guides that Jamie's team was able to develop. The first one explains the whole shebang, like just from top to bottom of why we're doing it, what it is, what to expect. And the second link there is an appendix of sorts. So for example, Middle Atlantic, what are the other options in there for division preference? I'm sure you're not going to be able to memorize all that. Same thing with the setting preference. If you go to the appendix guide, it goes through each of these sections and tells you all of the options that the applicants were able to select. So what Jamie was showing you earlier for the application view, the drop down, all those options and selections, it's in that appendix for you to kind of scope out and see what were the options that the applicants were able to choose. So I just linked those two guides in the chat. So feel free to spend some time to review those outside of today's presentation. Now, you'll see the program signal right now is showing a blank, which typically indicates that the applicant did not indicate your program as a program signal, or they skipped this section. As Jamie mentioned, there's kind of missing data in our demoing environments right now. So I'm going to go ahead and switch over to a screenshot. Sorry, I couldn't quite catch that question. Oh, I assume it was a question. I think they muted themselves. It might have not been meant for this conversation. Oh, my apologies. If there is a question I didn't quite catch it, throw it in the chat. I'm monitoring that too, as well. So in this case, you can see here the program says, yes, ignore the categorical that's specifically for other specialties. But yes, in this case, indicates that this applicant sent a signal to this particular program. Similarly, below that you can see the division preference. What I showed earlier, it gives you the division preference. Maybe they had a response to why, maybe they didn't. Below is another, just a good example what it looks like too as well. Okay, so those are the program signals and the geographic preference in the application view. I'm going to go ahead and shift gears here. If you direct your attention below that applicant detail section, this part is probably familiar to you all. This is where you find the personal information, education experience. There's also going to be an extra sub app tab here for your specialty. This is for applicants who have provided extra past experience information, that past experience that Jamie showed earlier from the applicant's perspective. The top side here, you'll see impactful experiences. This is that 750 character life experiences that Jamie was talking about. She mentioned last year, many of the applicants talked about their COVID experience. But of course, as she mentioned, there's other things that they can talk about with regards to their family background, their financial background, anything that really impacted their experiences that they want to share with the programs that they apply to. That's just an essay. It's 750 characters. Below that, we have the meaningful experiences. Earlier, there was a question of whether or not there'd be overlap of information. Is this the same ARIS experiences? You'll see there's some overlap in details because they're picking their top five experiences. You'll see your details around the experience, like the start date, end date, whether it's ongoing, the frequency. The frequency is similar where it's asking you how often are they engaging with this experience. The other piece that Jamie mentioned was new for this year are these three rows here, the experience type, the focus area, and the key characteristic. You can think of these just as labels that applicants can choose for these past experiences or these meaningful experiences to give you a quick insight as to what kind of experience it is. Before you even read it or their essays describing why it's special to them, that's your quick shortcut to being like, oh, this is a experience about X, Y, and Z. I do also, again, just want to take a moment to highlight that appendix again. Right now, you'll see that the experience type is volunteer service advocacy. Below that, another experience type is professional organization. Again, that appendix, I think it's pages, yeah, page three to five for the second guide link that is sent. It goes over each of the different options that are available and what they entail. What did we tell the applicants? Hey, this is what this experience means. It's just a great key to deciphering what those tags are. Again, those are three really just quick ways or tags that let you know what the experience entails. Then finally, below that, there is a short 300-character, or it might be 250. Sorry, Jamie, if you can correct me on that one. 300-characters limited essay just telling you why did they pick this as their top five. Again, it just, it might be overlapping information because they're picking five of the experience from their MyRS application, but really hones in onto the important aspects of that meaningful experience. I'm going to pause for a moment here just to see if there's any questions around the program signal, how it's displayed, the geographic preference, or even the meaningful experiences below that. Richard, there was some questions both related to filters and exports. I don't know if you're going to touch on that next, but for geo and program signals, but I think that those are two of the questions. I will tell you that the answer is yes, you can run those filters and Richard could walk through those. Right now, this cycle, you will not be able to filter and export via filter to search for, let's say your mission of your institution is advocacy. You cannot sort by experience type in your filters. We hope that that's an integration that we'll do in a future cycle so that you can really get to hone in on applicants who have experiences or attributes that are like your institutions, but that's just something we could not do this cycle. You can filter by geographic preferences and program signals and Richard can walk through that process when he's ready. Yep. Awesome. Thanks, Jamie. I'm actually going to start from the bottom and I'll work my way up for the questions because the last questions, the most relevant. The question goes, if we both print applications, what is the process to include all the information from the program signal? So to Jamie's point, this is going to be the second year of the pilot and the first year that we're integrating it. So there are still some features that we have to build out just to level set everybody. There is an option in the PWS to print the application in this or even bull printed, meaning print multiple applications at a time. Unfortunately, that's not available. So if I click on this print option up here, you'll see that this is probably what B. B. Bulger is referring to, which is the application material. You can select the MyERS application, you can select other documents that are available, and then you can kind of generate an application document of the applicants. So unfortunately, that is not available for the supplemental application. And just to kind of knock that out first. However, there are alternatives to pulling that information, which is where I'll go ahead and transition to the next piece, which is how you might filter for the information. Following that, I'll talk about exports. So for the filters, you can, there's, we added a few criteria on that in the system. For those of you who are in the first year of using the PWS, if you're in the current results page, this is your list of applicants. This is where your main area is to kind of slice and dice and pull applicants. If I click on this panel at the top for modify filter criteria, again, I just clicked on it to expand the section. This will pull up the filter criteria, like what you, the kind of criteria that you want to run the filters for. Within the section, let's go ahead and just start with one group. I'll go ahead and click on the green Add New Criteria button. This is where you're going to be able to select the kinds of filters that you want to filter out the applicants by. You'll notice for this season, there's a new option for supplemental application. It's alphabetical order, so you'll find that near the bottom. When you click on category, you'll see the options that are available for filtering. You'll see, again, as Jamie mentioned, there's, it's fairly rudimentary right now, but it cuts right to the chase. The two things that are available is the program signal and the division preference. For program signals, it's pretty straightforward. You can set the condition equals to, to look for whatever you're looking in this case. In this case, it's whether or not they signal you. Again, you won't see the categorical, you'll just see the option for yes. If I go ahead and read this out, for this particular filter, I'm looking for applicants who did have a yes for the program signal. Alternatively, if you want to look for division preference filters, you would just select that. In this case, you'll see the respective options that are here. Either they did signal your division with the yes, or as Jamie mentioned, if they did not have a preference, meaning they didn't select any of the division preferences, they'll have no preferences here. This is just a caveat to that. They have to actively select no preference. If they left it blank, it does not show no preference. If they left it blank, skip the question, they wouldn't fall into this no preference category. Yep, exactly. Just to kind of, again, it's hard to kind of keep this all in the head right now because you're seeing it for the first time, so I recommend the guide or the appendix to kind of just find out or have that resource on hand to show what does no preference mean, what does yes mean, what if there's no, if they didn't select either of those, what does that mean? So those are great resources there. Once you have these filters that you selected, you can click on the green save criteria, and then once you apply it, it'll pull the applicant that fits that particular criteria. Okay, so that's a quick run through of the new filter criterias that are available. If you're still not sure how to do filters in general, I definitely recommend our resources on our community site. Jamie, did you have anything to add in this section before, I don't see any other questions. We can also pause for questions before I hop into exports. Nope. Okay, then the last piece here then is, you know, how do you tease this, export this information out? Straightforwardly, there are the CSV exports. So while I can't bulk print the applications with the supplemental application data, I can export it out in Excel file or CSV file format. So let me go ahead and shift over at the top side here, you'll see exports. This is where you would go to export any sort of data in CSV format. If you're familiar with this, you've used it, and you can potentially have templates in the past. I'll go ahead and start a new one just to show the supplemental application filter options. So once you get to this page, you can create a new export. You'll see there's the export name at the top to label it. Below that, for the type of data to export, you'll notice that, again, there's a new option here for a supplemental application. Within the supplemental application, you have all the different supplemental application data that you can export. So remember, there's that division preference, whichever census division that they selected. You have the essays. Below that, you have those tags that I mentioned earlier, or those labels, focus area, key characteristic. A lot of information is pretty much exportable in this way. So you just click on the particular fields that you want. A shortcut here, if you want all of it, is you can press shift on the keyboard and select multiple fields at a time. And the key here is to just move them over to fields to export. When you're ready and you're sure of what you want to include in here, go ahead and click the run button. And it should populate on the bottom right-hand side for the CSV exports. And let me go ahead and just pull this open here. I don't think you'll see the... Let me see if I can share. New share, Excel. Okay. So again, this is just for one applicant. Hopefully, you can see the Excel document. But you can see that each column correlates to each of the fields that you selected to populate for that applicant. So this is one way that either you can pull that information. If you're familiar with Excel, this is very powerful in the sense that you can use it to kind of quickly identify applicants with information in this format. Any questions here on exporting? I'll switch back. So one question, Lauren. You can only export CSV files for supplemental application info, no bulk print at this time? Yes. That goes to that question earlier. Again, for those of you who are new, bulk printing means... Let me go ahead and pull up more applicants. Bulk printing indicates that if you want to pull the application material for multiple applicants at a time, there's another format to pull the information. There's a bulk action at the bottom. I can use the bulk view slash print application, click on the green Go button. And you'll notice, like as I'm going through all the available documents that are available, or the other, you won't see the supplemental application as an option for this year, just because it's not been built in. Yeah. And hopefully, this visual helps those of you who are new and you're not sure what we're talking about with regards to bulk print. Any other questions? I don't see anything in the chat, Jamie. Are there any other parts that you wanted me to highlight other than those that I have so far? If not, I can go ahead and turn it right back over to you. Actually, one thing I do want to go ahead and just share, show you what I'm talking about. If for some reason you lose the links I shared in the chat, remember, you can just go directly to our community site. It's connect.aamc.org. There's kind of two places that I want to highlight on this page specifically for you program users. Within the resources section, A, there's a dedicated page for supplemental errors application resources. This is a general overview that we just created for you to quickly see and glean information from. It's just kind of the intro page. More importantly, in the resources library, and how I got to there was just click on resources at the top and click on resources library. If I scroll down, there's kind of two sections. One section is the job aids. You'll see for the file folder on the left-hand side, there's one specifically for programs around the supplemental application. This is the guides that I shared in the link. The first one is a general guide. The second one is an appendix. Lastly, below that, if you take a look at the AIRS 2023 webinars, we do have our regularly run webinar series that walks you through everything. If you're new, I highly recommend those. More importantly, there's the supplemental AIRS application for program directors webinar. I know many of you may be coordinators, but this would give you a lot of verbal context as to why we're doing this, what it's about, and so on and so forth. Will you drop up that link in the... Yeah, let me go ahead and do that. And then secondly, I will go ahead and drop the resources library. Here we go. And if you need to sign into this page, it's the same sign-in login as the one that you use to sign into the PDWS. Richard, the only thing that I think would also be valuable, especially as it seems like you all as coordinators are probably the most important part of this role, is we have also asked all our participating specialties to provide selected for interview information via the PDWS so that we can continue to ensure that our program signals actually make a difference for... And that we continue utilizing them into the future. And so we've asked all of our specialty leaders to convey that message to all of their programs. But that is, again, this option here that Richard's about to click under interview status so that if you do move candidates forward, regardless of whether or not they participated in the SUP app or not, this option right here allows the AAMC a view into whether or not we can tie selected to interview with the supplemental areas application. Again, the goal is, does it change who you're inviting to interview? Do program signals, do geographic preferences give you different or more information to allow you to make different or more educated decisions about who you are selecting for interview? So over time, it allows us to do that analysis. So we have asked that everybody utilize that option if you do choose to select applicants for interview this cycle. So we're coming up to the top of the hour. It's 1256. Does anyone have any last minute questions that they would like to ask? Or if you don't have any right now, you can also email me and I can get those off to Jamie and Richard as well. But I want to thank Jamie and Richard for going over all of this information. I think it was very helpful and help everyone see both sides of the process. So again, thank you to Jamie and Richard. And we really appreciate the time that you took today to fill us in. And if anyone has questions, let me know and I will get them to Jamie and Richard. Thank you for having us. And we appreciate all that you do for applicants and your future students. Or residents, really. Thank you so much, everyone. Thank you.

supplemental ERAS application

medical students

residency programs

program signals

geographic preferences

experiences section

filters

export options

program director's workstation