{"id":692,"date":"2021-09-07T14:59:07","date_gmt":"2021-09-07T19:59:07","guid":{"rendered":"https:\/\/meazure.local\/?p=692"},"modified":"2023-11-02T07:55:21","modified_gmt":"2023-11-02T12:55:21","slug":"the-future-is-now-change-and-innovation-in-exam-delivery","status":"publish","type":"post","link":"https:\/\/www.meazurelearning.com\/fr\/resources\/the-future-is-now-change-and-innovation-in-exam-delivery","title":{"rendered":"[Webinar] The Future is Now: Change and Innovation in Exam Delivery"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\"><meta charset=\"utf-8\"><meta charset=\"utf-8\">Now that more than a year has passed since the onset of the pandemic, testing programs are evaluating the impact of pandemic-era changes on their security, performance, accessibility, and reach. Join four industry leaders from high-stakes testing programs in a panel discussion as they share how they\u2019ve turned innovative pandemic changes into long-term solutions. Panelists from the Educational Testing Service (ETS), Law School Admission Council (LSAC), Global Information Assurance Certification (GIAC), and National Restaurant Association (NRA) discuss their data points and industry stories in critical areas, like exam security, modality equivalencies, validity, reliability, accessibility, equity, and user experience. Finally, they consider where they see the future of testing going, what\u2019s here to stay, and what might come next.<br><br><strong>Panelists: <\/strong><br>Ray Nicosia, Executive Director, Office of Testing Integrity, ETS <br>Faisel Alam, Manager, Office of Test Security, LSAC<br>Larry Lynch, Senior Vice President of Certification and Operations, NRA <br>Jeff Frisk, Director, GIAC <br><br><strong>Moderator: <\/strong>Jarrod Morgan, Founder and Chief Strategy Officer, Meazure Learning<\/p>\n\n\n\n<script src=\"https:\/\/fast.wistia.com\/embed\/medias\/icna6baedm.jsonp\" async><\/script><script src=\"https:\/\/fast.wistia.com\/assets\/external\/E-v1.js\" async><\/script><div class=\"wistia_responsive_padding\" style=\"padding:56.25% 0 0 0;position:relative;\"><div class=\"wistia_responsive_wrapper\" style=\"height:100%;left:0;position:absolute;top:0;width:100%;\"><div class=\"wistia_embed wistia_async_icna6baedm seo=false videoFoam=true\" style=\"height:100%;position:relative;width:100%\"><div class=\"wistia_swatch\" style=\"height:100%;left:0;opacity:0;overflow:hidden;position:absolute;top:0;transition:opacity 200ms;width:100%;\"><img decoding=\"async\" src=\"https:\/\/fast.wistia.com\/embed\/medias\/icna6baedm\/swatch\" style=\"filter:blur(5px);height:100%;object-fit:contain;width:100%;\" alt=\"\" aria-hidden=\"true\" onload=\"this.parentNode.style.opacity=1;\" \/><\/div><\/div><\/div><\/div>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Transcript<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker: <\/strong>Jarrod Morgan<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Well good morning or good afternoon everybody. Can everybody hear me okay? Looks good, looks like the panelists can hear me, hopefully everybody out there can as well. Thank you for joining us today at our panel with ATP. We\u2019re really excited to bring kind of an all-star cast here of really smart people who have gone through some really challenging times as we all have and have a lot to share about some of the things that they\u2019ve done. So sort of a broad thank you to everyone out in in our panel now and thank you to everybody for showing up. Looks like we\u2019ve got a great set of attendees here today. So, with that, I\u2019d love to get started by first kind of introducing everybody that we have on our panel today. Everybody with a nice freshly branded background so thank you guys for that. We all know who they are, we\u2019ll first start with Faisel Alam who is the manager of the Office of Test Security at the Law School Admissions Council. He\u2019s served in that role for over 10 years and helped coordinate the council\u2019s transition from paper and pencil to a digital tablet-based assessment and then ultimately to remotely proctored exams. The Law School Admissions Council\u2019s mission is to advance law and justice by encouraging diverse and talented individuals to study law and by supporting their enrollment and learning journeys from pre-law to practice LSAC. They administer over 150,000 high-stakes tests a year and [are] home to the well-known law school admissions test, so thank you for joining us today, Faisel, and bringing your expertise on the call. Can you tell us a little bit about how the online proctored version of your exam came to be?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Faisel Alam<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Thanks for having me, Jarrod, and hello to my fellow panelists as well and to all of you out there. LSAC has been thought of, up until probably about three years ago, as a paper-based testing company, so we had a huge shift. When considering the move to an online test and really, you know, I think a lot of us were caught in this situation, you know, prior to the pandemic. We were exclusively an in-person testing company. We had no online testing capability whatsoever. When the pandemic made in-person testing possible, we moved really quickly. And we were in the middle of a law school application cycle, so candidates and schools were really depending upon us. And one of the best decisions we made was to actually go with live proctored and not Record and Review. That was a key component in our decision. We didn\u2019t want to go Record and Review with AI flagging issues and things like that and the problems that are presented. So what we\u2019ve been able to do is utilize the live proctoring, remotely proctored assessments to help us avoid some of the issues that are associated with AI bias or test-takers being blocked from testing due to something that AI flagged. Live proctoring is certainly harder and more expensive but it\u2019s worth it for us, and that\u2019s one of the key reasons we actually want to talk to you is for that live proctoring and it\u2019s consistent with our commitment to diversity, equity, and access.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Jarrod Morgan<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Thank you, Faisel. Up next on our panel we have Jeff Frisk, who is the Director of the Global Information Assurance certification program or GIAC. He\u2019s been in that role since 2005. GIAC was founded in 1999 and provides more than 45 skill-specific certifications that are directly aligned with critical info sec and cybersecurity job duties are offering a wide range of certification disciplines. They target hands-on skills required for mastery of many important cybersecurity job duties and technologies. GIAC exams validate real-world competency by testing hands-on concepts and pragmatics versus just theory. Jeff was also a SANS course author and a certified SANS instructor. Jeff has more than 25 years of experience in IT projects with computer systems and business development initiatives, centered on cybersecurity. He\u2019s also a founding board of directors member and current officer for the cybersecurity credentials collaborative. GIAC leads the cybersecurity certification industry with 11 ISO 1702 for accredited certifications. They earned conditional and seek approval for using remote proctoring on June 3 of 2020. And so, Jeff, thank you very much for bringing your vast experience and perspective to the discussion today. Can you tell us a little bit about how that remote proctored program came about?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Jeff Frisk&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Likewise, thanks for having me. Good to see you all here as well. You know, I think for us being a technology-based company and dealing with cybersecurity type of things, a lot of our candidates for certification have high technical skills. So that was something when we came in, we and me personally, I&#8217;ve always been aware of remote proctoring but it wasn\u2019t ever something that was high on my list to be one of the first people in doing that. We were very comfortable in our brick and mortar, you know, testing center approach. Now, our exams are all internet-based and delivered through computers. So, you know, maybe a little bit different from what Faisel had going on that we weren\u2019t paper and pencil based where we haven\u2019t been for a long time, but we really hadn\u2019t been thinking about making that jump to remote proctoring. As many of us probably are here because of the, you know, pandemic being the advent of necessary remote proctoring for our organization. Anyway, I kind of got dragged kicking and screaming into the remote proctoring boat here. It is something that has enabled us right to maintain business continuity throughout the pandemic, and I think now, once the cat\u2019s out of the bag, it\u2019s kind of here to stay. So, we have a blended solution of brick and mortar proctored locations, as well as remote proctoring, and for us and for me personally being very security conscious and having our candidates be well versed in technology, it was a little rough when we started out, right? People were not used to having the setups that they needed and some of the security settings on computers and other things, and I guess for our organization personally, there was a lot of data overload versus brick and mortar testing locations. We had a lot more data presented to us and there\u2019s that kind of ever-present dance or balance of exam security versus data privacy and kind of this data overload thing. So for us it wasn\u2019t the easiest thing to do. It wasn\u2019t my first choice but ProctorU has been a great partner and we\u2019ve been able to work through many of the difficulties and I think, here we are, a year and a half later or so since we initially introduced remote proctoring. We were very quick to market, working with you to kind of get up to speed very, very quickly. And I think, although there were some kinks, it\u2019s been something that our candidates have grown used to and that\u2019s a real benefit, and it\u2019s advantageous for our program again to remain delivering tests and having candidates take tests throughout this whole time. So it\u2019s been a real pleasure working with ProctorU, and I think our experiences might be a little bit different, maybe than some of the other panelists here and it\u2019s great to see such a diverse group of folks. So thanks.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Jarrod Morgan<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Thank you, Jeff. And that\u2019s really the idea here is trying to bring a lot of different perspectives and a lot of different kind of need sets into the conversation so your perspective is valuable. Next on the panel we have Mr. Larry Lynch, who is the Senior VP of Certification and Operations at the National Restaurant Association. The National Restaurant Association represents more than 380,000 restaurant locations and is the organization behind, among many things, the ServSafe exam, a widely used food safety certification in the country. Larry oversees the organization\u2019s credentials programs, is responsible for program accreditation, customer operations, state food safety compliance, food safety instructor quality, and overseas business operations for their multiple offices. In addition to all this, he serves as a public liaison with the food industry and regulatory bodies to ensure the industry retains that policy and science voice as it relates to food science and safety, which is obviously very important in these crazy times. Larry, thank you for bringing your decades of experience to this presentation. We\u2019d love to hear from you on how the ServSafe exam and all the different programs that the association came to be using online proctored exams.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Larry Lynch<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Sure, Jarrod, thanks. And thanks for having me this morning. There are a couple pieces to this, and I think it differentiates us a little bit from my fellow panelists and as much as our audience is a little bit different. These are typically frontline workers and frontline managers working in restaurants in some cases, the restaurant workers themselves that we\u2019re addressing with our credentials. But the other thing that\u2019s a little bit different about us is our programs are in a competitive set, so it\u2019s not just us offering a food safety manager certification exam. We have competitors. So for me, what was very important was trying to figure out what differentiates us in terms of giving an exam. It\u2019s much like what other companies give, and it really came down to how can we be convenient to our customers because if you think about restaurant workers, they don\u2019t have the kind of daytime hours of the rest of the staff. They can\u2019t sit down and take an exam. We needed to be where they were, when they were. And so, several years ago, and I know I didn\u2019t put this in my bio, but the National Registry of Food Safety Professionals still exists as a wholly owned subsidiary of the National Restaurant Association now. Early on, we used a remote kiosk system, and we managed to get approved by entities several years ago with the same idea in mind that we could put those kiosks in places and that would start. So it gave us that head start in doing it. So, when we were acquired by the Restaurant Association, that same mindset was &#8220;Okay, now we&#8217;ve got a bigger program, a bigger footprint. How can we make sure that we\u2019re more places now we have an academic audience?&#8221; We have the frontline workers have we make this play, and so early on we started talking with your group. Of course we talked to other companies as well. It really came down to the integrity and the support and the work that that you guys did, the fact that we were addressing things like data security. So we understood that\u2019s the GDPR and those questions and issues that we have to address with our candidate data is critical to making sure that our program is safe. And much like the LSATs, and by the way I did take LSATs and I plan on never having to take them again. But I never had the advantage of doing them remotely. But for us, we were also heavy paper and pencil. And part of that just addresses the broad ways that we were offering exams we had online. But everything was live proctored, and later on we\u2019ll talk a little bit about accreditation and some of the headaches that that we faced with that. But putting that aside for a moment, that ability to get to be convenient, be where people were, and begin to shift to a more technologically-driven solution makes sense for us. And so again, you know, try working with your team, making sure that we\u2019re tying in the top technology components, making sure we\u2019re addressing security. It all fell together perfectly. Then of course the pandemic took us from &#8220;let\u2019s begin to work through this slowly&#8221; to accelerating that process pretty quickly.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Jarrod Morgan<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Thanks very much, Larry. And finally we have Mr. Ray Nicosia, the Executive Director of the Office of Test Integrity for Educational Testing Service, or ETS. ETS was founded in 1947 and is the world\u2019s largest private nonprofit educational testing and assessment organization and is home to the GRE and TOEFL exams as well as a numerous other well-known high-stakes examination programs. He oversees a staff of 50 that is responsible for the security of all high-stakes paper- and computer-based testing programs for ETS across 192 countries. In the 26 years since assuming his current responsibilities, Mr. Nicosia has been a leader in the industry, implementing multiple prevention and detection test security techniques to better serve ETS and its clients. His investigations have resulted in actions taken by federal and local law enforcement agencies, civil prosecutions, and the closing of test centers. Ray is frequently quoted by the media as an expert in academic integrity issues and has represented ETS and business development matters on six continents. Ray, thank you for bringing your 30-plus years of experience to our discussion today. I know 2020 was quite a year for ETS as it was for everybody. Can you tell us a little bit about how ETS came to use online proctoring for its high-stakes programs?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Ray Nicosia<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Sure, Jarrod, thanks for having me here today. My experience with remote proctoring goes back about 20 years, where I testified against the idea of testing at home in a military tribunal case. At the time, it was not that developed or a secure way to give tests. I attended ATP conferences, got to see the industry grow, got to see the changes in remote proctoring. About five years ago, ETS picked up a low-stakes test, put it in a remote proctoring environment, got to see how that works, and dip our toes in the water a little bit. And with the very talented colleagues at ETS, we started looking at different options for, could we do this with our high-stakes testing programs. We had areas of concern where there were security issues. Some of our test centers we thought, \u201cYou know, could remote proctoring be better for us?\u201d We had to ask those questions. We had customer service issues where people were located. Could remote proctoring better serve our testers? We were looking at those issues. In 2019, we began interviewing different vendors to look at the option of potentially moving some high-stakes programs into the at-home testing model, and next thing you know, 2020 hits and COVID starts creeping up, and I found myself in Asia, back in January and I asked if I could go visit the ProctorU facility in Manila. And that gave me the bird\u2019s eye view and how it operates. It\u2019s one thing to sit in a meeting room and get a presentation about how things operate, but it\u2019s another thing to walk in the door of the proctoring facility out there in the Philippines and see the operations for a day and observe everything and ask them questions that gave us a sense of security and, you know, we feel comfortable going forward. As COVID began closing more and more of our test centers, ETS was able to hit the ground running. So we did sign on with ProctorU and we were the first high-stakes program out the door on March 28 last year, with our TOEFL in theory and practice programs. That\u2019s sort of our journey that got us to where we are today.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Jarrod Morgan<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Yeah, not a lot of people call me and say, \u201cHey I&#8217;m in the neighborhood,\u201d when the neighborhood is in Manila. So, we\u2019re glad you got to see one of our facilities and glad I could share some of that story. Okay, so we\u2019ve gotten to know our panel here. We\u2019ve got some questions that we\u2019ve queued up for everybody. We want to keep this very kind of conversational, very fact based, pros and cons, and the real story of what\u2019s going on. I\u2019ve already had a couple of people jump into the chat function down there. If you\u2019d like to use that chat function to send in some specific questions, we\u2019ll try to get through as many of those as we can as we\u2019re going through our discussion. So feel free to chime in there. We have our first question coming up. The first question is:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>You were all delivering exams pre-COVID in different ways, and today you\u2019re using online proctoring for some or all of your exams. What results have you seen from an exam performance perspective since introducing online exam delivery?<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">So we\u2019ll start with Larry from the National Restaurant Association. Larry, what kind of results have you seen from a candidate performance perspective?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Larry Lynch<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The good news is one of the things we have to do as part of our standards and accreditation requirement is comparability studies. We just did complete a comparability study with remote exams against our paper-and-pencil exams and found them to be perfectly comparable, and that\u2019s clearly something that was a concern to us and of concern to our accrediting body. So for us, that was just mission number one, to make sure that we had an exam program that we felt comfortable with being delivered in the right way and it\u2019s proving that.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Jarrod Morgan<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">That\u2019s great. And I\u2019ve just been, you know, I don\u2019t do Zoom presentations as often as I should. So you can ask people questions into the Q&amp;A or the chat. Either would be fine. I know we\u2019ve got some Q&amp;A in there so thank you for keeping me on the straight and narrow, my friends from designing events. I\u2019d like to ask Faisel to sort of chime in there. What kind of performance differences have you guys seen from LSAC and your users there when they started using the online version?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Faisel Alam<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">I think we\u2019ve seen some scoring differences. You know, I&#8217;m not a psychometrician to really jump into a bunch of the scoring in the performance indicators. I can give you a couple of data points about this. Overall, if we compare a full year of the pre-COVID LSAT to a full year of LSAT-Flex, which was our online three-section test that we were offering, we saw an average score increase of about .9 points. And there are a lot of theories out there why that might have happened and a lot of it has to do with the way that test-takers were able to prepare in the middle of the pandemic where. What else were you really going to do? So they had a lot more time to spend preparing for it. We have a lot of low cost or free options for prep out there like Khan Academy. We have our own law hub prep test that they can practice on. We have a score preview program that allows people to see what their score is before deciding whether to cancel it. I think a lot of those things played into helping reduce stress and the anxiety that goes into preparing for a test and what may be a completely different modality. If they tested prior to COVID, I think all those played into it. People are comfortable testing at home. I think those all sort of helped and it\u2019s pretty interesting. But you know what we found from our research was that people during the pandemic actually ended up spending 25 to 30% more time preparing for the LSAT. And they\u2019d spent months preparing for it before but now that they were actually able to focus on it rather than having to worry about other things, I think we saw some positive results in that. But I would like to tackle another part of this. The big change for us is we\u2019ve only done in-person tests. So, we talked about performance. I think it was Jeff that talked about business continuity and that was a huge issue for us because our business continuity really refers to law school dreams, people that are dreaming of a legal education. If we\u2019re not able to continue that business, we\u2019re not providing the service to our member organizations of law schools and people that want to pursue a career in law. Not to minimize anyone else, but that is a huge responsibility that we carry and we try to fulfill as faithfully as possible. When the pandemic made it really impossible to test in person, we had to cancel three exam administrations. So, March 2020, April 2020, June 2020 \u2013 and that represents about 40,000 candidates that have signed up to take those three tests. Huge numbers. So you can imagine. Law schools were freaking out. Candidates were freaking out. People were predicting as much as a 10% drop in law school applicants, but because we were able to pivot very quickly and go into an online testing model. And that wasn\u2019t without a lot of work. People across the organization pitched in and when we made the decision, we really flipped the switch in a little over two months to made it possible, which is just an incredible effort in my organization, if I can toot our own horn for a second. What we were able to do with the online tests for May, June, July, and August, we ended up seeing instead of a 10% drop in applicants, we actually saw a 1.5% increase overall. And in traditionally underrepresented groups, big increases as well. We saw African American applicants were up by 2.5%. Hispanic\/Latino applicants were up 4%. And I\u2019d love to place that in the lap of moving to a super convenient and accessible test modality. But I think there are a lot of other factors that are involved and not the least of which is the national conversation we\u2019re having about systemic injustice inequities felt by marginalized identities, so I think all that played into it and saw some real positive outcomes, not just in scoring but also overall for our industry\u2019s climate.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Jarrod Morgan<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">I was actually hoping you were going to tell that story because I think it\u2019s so interesting to watch, not just how remote proctoring is changing but just how changes in society are affecting what the candidate pool looks like and how we\u2019re all reacting to that and making sure that we\u2019re welcoming as many people as we can. So thank you for sharing that perspective. Now our next question is from a security standpoint. We\u2019ve got a lot of questions coming into the Q&amp;A chat about security and stopping different things, so we\u2019re trying to roll all that up into this question:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>From a security standpoint, online proctoring changes the way people cheat while introducing new tools to detect cheating at the same time. Can you guys share some of your thoughts on exam security and examples of how you or we have identified cheaters in this modality?<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We\u2019ll start with Ray since he sort of lives and breathes these types of things. Ray from ETS, talk a little bit about security and how you guys have caught some cheaters this way.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Ray Nicosia<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Sure. Well, one of the things I advocated for remote practicing is that it really helps eliminate some of the forms of cheating, and some of the rare forms and some of the more ugly forms. For instance, you cannot bribe a proctor in remote proctoring, so people are familiar with the Varsity Blues case. Most cases are very, very rare when a testing staff member would take a bribe to help someone cheat \u2013 you can\u2019t do that in this environment. We also have rare situations in some parts of the world where our testing staff are physically confronted and physically intimidated to help people cheat or turn over test materials, things of that nature. You can\u2019t do that, that\u2019s not a concern in the remote proctoring environment, because you can\u2019t get to the person proctoring the test. So that\u2019s a really big upgrade, a really good preventive technique with the at-home testing model. Also impersonation. It\u2019s really helped because we are now getting videos of the test-takers throughout the test. So, it is not just a matter of checking an ID and taking a photo, but we\u2019re actually getting the video throughout the actual exam process. So on rare occasions, you might have someone do what we call a seat switch, where they would have someone check into a test center and then someone else would come in to take a test. In this environment with the artificial intelligence, just for the testing at-home model, we\u2019re making sure that it\u2019s the same person who checks in. If I check in to take it and it\u2019s me sitting there for the next three hours, it\u2019s not someone who kind of looks like me to come in and sit there and take the test for me. So these are some of the really big enhancements at-home proctoring gives us that we use and we can see a nice effect on how we\u2019re preventing and stopping some of these forms of cheating from actually taking place.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Jarrod Morgan<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Thank you, Ray. I&#8217;ll call in Jeff from GIAC now. Jeff, what kind of things have you guys seen in your programs as it pertains to cheating?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Jeff Frisk<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">First of all, we don\u2019t really like to use the word \u201ccheater.\u201d More like, I don\u2019t know, an anomalous exam data creator or something. Sorry that that\u2019s kind of a joke. But you have to be careful about accusing people of cheating versus having anomalous results, and as Ray mentioned, I think the advent of remote proctoring brings in new types of challenges, but it also helps us with some of the things that you talked about. Like our exams are a little bit longer. And if people take a break in the middle of the exam, they must get re-checked in afterward, their IDs checked again, that the room is scanned. I also feel a little bit more confident in that just being able to compare. Now another thing is, you know, as I mentioned before, we\u2019re inundated with data, when we started doing this and having recorded videos of the sessions and the room pans and things like that has been a lot of data for us, but also I think it really helps with some of the security aspects as well there, to be able to review sessions and see the things that are happening. And for us to, and I know a number of people mentioned this, having live proctors versus AI or some computer-based algorithm or after-the-fact proctors, that\u2019s really where we\u2019re centered as well as having a live human proctored exam, so that if something weird is going on they can stop the candidate and say, \u201cHey, why are you looking over here so much or what just happened over here that something changed in your condition?\u201d I\u2019m seeing a couple of the questions that are rolling in the Q&amp;A chat room about high-stakes testing and performance-based things. Our program has those integrated in our exams, actual virtual machine-based performance, and I haven&#8217;t seen any material difference at all. And echoing I think what Larry had mentioned, for our accreditation we also have to do comparisons between live\/remote proctoring and brick-and-mortar proctoring, and we haven&#8217;t seen any material difference at all in scoring. This is not a challenge to anybody, for cheaters out there. But we\u2019re heavily focused on security in the high-stakes business, and I haven\u2019t really seen any difference in types of cheating or different things. There\u2019s always going to be a bad egg here or there regardless of what happens, but I have not seen any systemic differences. Maybe some different types of things as you all mentioned, instead of someone colluding at a test center to pay someone to get a copy of that test, maybe there are different things that happen with remote proctoring. Some of the modalities of cheating have changed, potentially, but I guess for us, I haven\u2019t seen any big difference in huge breaches or issues. Even as far as candidate acceptance as well. I know we\u2019re going to get to that a little bit later, Jarrod, but I haven\u2019t seen any big differences in feedback from how different candidates are accepting the transition that we made to remote proctoring. Larry, did you have something you wanted to chime in on?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Larry Lynch<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">I think one of the things that\u2019s unique about our program is the fact that trainers are also the proctors for the exam in many cases. Most of us operate in paper-or-pencil world. We\u2019re shipping thousands of exams around the country during the year. We don\u2019t know what happens at the location and quite frankly at the end of the day, if your business is training people in food safety, there is an incentive whether it\u2019s right or wrong for people to pass the exam. That\u2019s your basis for success. For us to monitor all those locations is extraordinarily difficult. Obviously we invest a lot of money in cheating detection when exams come back and try and make a determination, but over the years \u2013 I\u2019ve been doing this for almost 20 years \u2013 we\u2019ve clearly seen all kinds of different ways that people find to cheat in a paper-and-pencil environment like that with that level of incentive. And what we found with remote, every day, almost every day, I\u2019ll get two or three videos and our numbers have gone up dramatically in terms of the number of people who take remote exams. And so to me, getting an opportunity to see that assessment, from a proctor who actually has no incentive to cheat, the integrity of the proctor can\u2019t be compromised. I know that the integrity of our exam isn\u2019t compromised, so we feel very comfortable right now that what we\u2019re seeing in terms of the exam takers is legitimate. And while it hasn\u2019t eliminated, our goal was to be convenient to try and be where test-takers need to be. But the fact that we can get data back now that really positively identifies issues of questionable integrity, how\u2019s that rather than cheating questionable integrity, allows us to do the due diligence that we have to do to make sure that the candidates are getting the right due process that they need for follow-up. We have all kinds of follow-up that we can\u2019t always do in a paper-and-pencil environment.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Jarrod Morgan<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Thank you, Larry. The next question I have is specifically for Faisel at LSAC. I know that you guys have made some changes to your program to mitigate cheating. Several questions kind of coming in about specific ways to mitigate different things, item theft, and whatnot. Can you share a little bit about what you guys did with your program?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Faisel Alam<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">First of all, I don\u2019t want to give away all the secrets because I don\u2019t know who\u2019s posting the questions. I don\u2019t know if we\u2019ve got any moles in the audience, per se, so let\u2019s just talk in some generalities and I\u2019ll bring in a couple of specifics. We\u2019re always trying to stay one step ahead of certain people. One thing that I\u2019m proud of and you probably got this from my previous responses: it\u2019s just a concerted group effort, how we manage the change from what was our single-day event testing model that was given whether it was on a tablet or it was paper-based and in-person. And then, shifting that to one where it\u2019s a testing window. I noticed quickly trying to look at some of the chat there, Jarrod, and looking at some of the questions about item exposure and harvesting and things like that. Let me touch on that because I think that\u2019s one of the biggest issues that comes with possible remote proctoring. So going from one of the best things we can do. If you have one of the most secure tests in the world and always protect your items, then we\u2019ll test one person at a time in a secure room who\u2019s got to be naked when we control the computer, right? But that\u2019s not realistic. That\u2019s not scalable. Well, maybe it\u2019s scalable for some people. I don&#8217;t know, certainly not in my world. Our exam is given in one sitting to over 30,000 people at a time, and there\u2019s simply not enough computer-based testing centers to be able to handle that with upgraded security. So remote proctoring was the way to go. We still couldn\u2019t just do one event because, even with no proctor and you have 35,000 people at one time on a Saturday morning, and all the bandwidth for one organization to be able to handle all that became untenable. So we had to start looking at multiple testing windows, and in fact, we went to multiple testing days. With the in-person testing model we gave one or two forms per admin so it\u2019s difficult for anyone to get any pre-knowledge unless you were manipulating time zones or had an in with the TV with online testing. It required us to move to that multiple-day model, and so we\u2019re using so many more forms now and we have incorporated variable sections as well. So if anyone\u2019s trying to game the system, they\u2019re most likely going to be guessing incorrectly and fall flat on their face on their variable section or what they\u2019ve heard from somebody else that\u2019s going to be on their test. So it\u2019s not using either bank, and our development folks have worked their tails off to get us in a great position to use these tools against individual cheaters. And so that form rotation, introducing the variables section, has changed what any one person is going to see on our test prep. When people in test prep talked about our test and he said it\u2019s all but impossible to cheat by trying to gather information on what forms might be used due to the number of forms and the way that we mix and match them. But of course, as I mentioned previously, what really keeps me up at night is these item harvesters right and that\u2019s sort of been the Achilles heel, if you will, of remotely proctored tests. But with a little bit of innovation and in some investigation, we are able to catch these people. Video was huge for us, being able to have that when we were paper-and-pencil or a tablet-based administration where we were in person, we were able to go back and review video and stop and figure out what kind of suspicious behaviors were happening. Certain AI flags are helpful. They can\u2019t make the determination, but they can point us in the right direction. Exam item response time, things like that are helpful to us, and one of the biggest things is because we are able to stop a session if we see suspicious activity. Before when it was a paper- or tablet-based exam, people that were harvesting could harvest an entire form, especially in paper-based. You lose one paper-based paper booklet, the form is gone. Here, we\u2019re able to limit the exposure of those items. If something is compromised, it\u2019s on a minimal basis. We can throw those items out. We can rotate things. So a lot of innovative ways to look at things. Risk mitigation, you know. And so we\u2019ve incorporated those things. Again I can\u2019t get into too many specifics about what we\u2019ve really done, just for fear of divulging too much.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Jarrod Morgan<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Really, really helpful. Thank you. Our next question is one that comes up a lot, and I think is one of the key drivers of the growth of online programs, which is about candidate satisfaction.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">So, you know, Larry. We\u2019ll start with you on this one.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>What have you guys seen from a candidate test-taker satisfaction perspective, as you\u2019ve moved and had an online format available?<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Larry Lynch<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">And maybe a little history with this, too, I think helps, Jarrod, because we were going down this path with you and trying to figure out where do we tie in our existing systems with ProctorU\u2019s systems and of course with the pandemic last year, it kind of forced us to rethink that model, simply because, as the pandemic was hitting, the academic community was going into test-taking time, particularly for us. High school students take our ProStart Program. ProStart requires a service AP exam, and high schools had no way of face-to-face proctored exams, and so we came up with an innovative way to move faster. Our intention of course was always to offer this to our broader audience and to me it was that acceptance, once we got past the academic piece and then offered it in general to our total population was the shift, we\u2019ve seen high double-digit growth in our remote proctored exams. So that\u2019s incremental, which is great. And there\u2019s some of that as a shift as we watch our paper-and-pencil numbers drop but then equally, our remote proctoring numbers increase. The adoption has been extremely strong on the satisfaction side. You know what we\u2019re seeing is good. The technology works. Obviously, our customer service teams on my end and your end communicate well, so if there are technological issues, we can resolve them pretty quickly. I think the most important thing that we hear from test-takers is the convenience part. Now I haven\u2019t seen anybody worry about the integrity of the exam or the concerns there. I mean obviously the proctors do a fantastic job of holding them accountable, and we certainly see that in the videos that you send us when there is something questionable that takes place during an exam. But our customer feedback is positive. I don\u2019t have exact numbers on that, but like I said that high double-digit growth for us in the remote proctoring by itself, so that being the shift from paper and pencil, but some of that being incremental, tells us that this is a modality that\u2019s going to work for us.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Jarrod Morgan<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Thank you, Larry. Ray, I\u2019d love to get your perspective on that too. You guys have got a global audience. ETS has different programs. How have you seen the kind of feedback when you introduce this option? It\u2019s remained an option for people and then sort of what\u2019s the sense of how many people are using that versus the old way?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Ray Nicosia<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Well, obviously we were happy to be able to launch it last March, we\u2019ve seen a lot of our test-takers throughout our 192 countries have been taking it online at home. The satisfaction is very high. We\u2019ve actually been able to offer the test more frequently. We have one of our testing programs that used to be 10 times a year paper-based and then maybe three times a month in the computer-based model, but now we\u2019re 24\/5. So you could take a test 24 hours a day, five days a week whenever. Other testing programs is 24\/7. We have people who are students who would like to take tests late at night, where people don\u2019t want to take off work during the day. We have people with issues getting into a crowded test center on a Saturday for instance. So it\u2019s usually a prime time to get into a test center but people could take the test at their leisure around their schedule. They could take it at their home, dorm room, an office. So we don\u2019t have the physical limitations of the tests and are we are still operating our test centers. Over three-quarters of our test centers are still open right now and testing, but that we are going to this modality and we\u2019re giving the students a choice \u2013 where do you want to go: at home or go to one of the test centers? We are in that mode right now and will continue to do that for the foreseeable future.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Jeff Frisk<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Hey, Jarrod. Do you mind if I add something? And I think this will address a couple of the questions that I see rolling in in the chat window as well about, you know, technology differences with different people\u2019s computers and settings and things like that. Bridging into the satisfaction or do people dig it or not dig it. The 24\/7 thing raises huge flags for us as well. We have people that are all across the world taking tests at different times and remote proctoring really helps with that. And I think for us, there were definitely some technology or adoption hurdles at first when we went out of the gate. And what I found is really made a difference is getting information out to the candidates in advance. Folks have to know what their computer setup is going to be, what they have to do with their desk and clear things off and not have a bunch of other video cameras and things in the room taking pictures of the test questions. So I think we struggled with that a little bit at first, from a satisfaction or technology point of view, but we found really by getting the right information out to people and making sure they could be aware of what the conditions needed to be both from a computer setup in a room and what they needed to do in advance. That\u2019s really helped us and although when we first started, there were more complaints and people not being familiar in our program with remote testing, that\u2019s really evened out for us. And we found by getting the right information in advance, we\u2019ve taken care of almost all of those issues. So I think that bridges the gap between a couple of the questions I saw rolling in the chat window too, Jarrod.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker<\/strong>: Larry Lynch<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We\u2019ve had kind of same situation with ours where restaurant workers, you know don\u2019t have the nine-to-five hours that many people do to go down and sit down and take a test after hours is important. Some people are already well-versed in food safety, so they don\u2019t need to get the training. So it\u2019s a great option for them but even if you\u2019re not, again that multiple modality \u2013 that to us is important. You can still take a course online if you want to and then turn around and take the exam at your convenience. Again, I think to me more than anything else, the convenience is most important but convenience locked into a secure environment, just adds to the value of what we&#8217;re doing.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Speaker: Ray Nicosia<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">And if I can jump in a little bit. It\u2019s kind of crossover. Jeff brought up some of the questions that are coming on the security side. As we were the first ones out there with ProctorU in the high stakes world last March, and there were things we did at our test center that ProctorU was not doing at the time. So we worked with ProctorU. We said, &#8220;This is how we think secure administration should take place. There were some changes to the flight path, as it\u2019s called for the check-in for the test-takers. We\u2019ve heard you\u2019re cleaning up the test but also just looking to see, you know, is someone trying to remove test content during the test?&#8221; There are certain things that are done before the test is even launched to check for that option and then, ProctorU, you did develop a ETS-specific proctored exam, that the staff had to take in order to give the proctor one of our ETS tests. It\u2019s our tests tend to be more unique with different sections and speaking components. So there was a special ProctorU test you did develop for us. And the proctors have done a much better job there now picking up the test-takers who are trying to bring in the cheat sheets or are trying to, you know, have an answer key written down on something or trying to sneak in a cell phone. So, the staff does a good job picking up these little cheating techniques and are able to confront the test-taker online and stop a test.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Jarrod Morgan<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Yeah, for sure. This is a really good, I mean that\u2019s a key question right? What&#8217;s the reaction been to and I think most of the people that were attending here today wanted to hear that. Now in the interest of time, I&#8217;m actually going to skip over the next question. And we had some information about accessibility we\u2019ll share with all the questions that are coming in that are not getting answered, we\u2019re going to gather them together and try to send out some of these things digitally afterward so we\u2019ll put some stuff in for accessibility there. But I wanted to jump to one that I think is a really important question and it\u2019s about accreditation. It\u2019s very important for programs and online proctoring, you know, to consider that if you\u2019ve got a program that\u2019s accredited and how does that work. We\u2019re lucky enough on the panel here we\u2019ve got two different organizations that have gone through that process. So I\u2019ll start with Jeff from GIAC. Can you share a little bit about what that experience was like to get accreditors to see this and understand it and allow you to use it?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Jeff Fisk<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Yeah, and you know it\u2019s very timely for better or worse. This is our week that all of our ISO NC 17024 annual audit paperwork is due. So, I am neck-deep currently in finalizing some of the thousands of pages of paperwork that we turn in for the soon-to-be 13 accredited exams that we have, but that\u2019s a huge thing for us right? Our program is high-stakes as well, probably a different way than other people\u2019s programs where a lot of times to have a specific job in cybersecurity you need to hold a credential in the US government or other places. And so it\u2019s a big deal. I\u2019m not only the ISO NC 17024 standards, you know, focused on validity and fairness, and all different kinds of things. And that\u2019s regardless of if it\u2019s a paper-based or computer-based or remote-proctored exam, but as part of that, the standard has developed very quickly with the advent of our pandemic state. A special remote proctoring additional section that you have to fill out or whatnot and so that also bridges some of the stuff that we do anyway. When we talk about our scores going up or down, are there more or less cheaters or are we seeing item leak or be looking at data forensics at incorrect answer option patterns? For us, we kind of look at that with blinders on, but then we also specifically look at it with brick and mortar proctoring versus remote proctoring. And for us, having run all the numbers and I think Larry mentioned some of this stuff too. We haven\u2019t seen any material difference in scores or, you know, cheaters that we\u2019ve caught one way or the other. I do think it really helps to be able to stop an exam midstream or real-time to have a proctor ask a candidate to pan the room again or do this or let\u2019s check out why, you know, whatever is happening. But for us, accreditation wise, there were some additional things that we had to do, and we had to make sure we were comfortable with the security of ProctorU\u2019s proctors and the processes, but as I think Ray mentioned as well, updating the flight path so it\u2019s called or the steps that a proctor would go through for a specific exam. We found some of those things had to be updated after our initial kind of beta launch, but I haven\u2019t seen any real material differences in our accreditation aspect and I think most of that has been centered for us on: are we delivering exams in a fair and reliable and valid way, and then do we stand behind the results? The same way, when we dissect things and look at it as a whole, and then separated out for brick and mortar, or live in-person testing, or remote-proctored testing, we haven&#8217;t really seen any noticeable difference in any of the metrics that we use to look at our exams \u2013&nbsp;&nbsp;the same fair, valid, and reliable kind of things.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Jarrod Morgan<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">And of course, you know, Jeff\u2019s got that perspective, and you guys have got 11 different programs that go through the 17024 process. Larry has the distinct pleasure of having two different accreditation standards to adhere to not just 17024 but the food safety standards. Larry, talk a little bit about what that was like.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Speaker: Larry Lynch<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">I mean obviously, you know, the good news is that the standard that we operate under the most which is developed by the conference with food protection. We tried to build to at least get close to mirroring ISO 17024 and that\u2019s been something we\u2019ve been working on for a lot of years. You know with that said, however, we always have to remember that when it comes to the accreditation part, they\u2019re approving us to use ProctorU, they\u2019re approving us to use another vendor. So we have to go through a lot in terms of what we report at the outset, and application process is pretty onerous and it was relatively new because the conference with Food Protection standards was never designed for remote proctoring early on. Just paper and pencil because that was the modality that was created many years ago. It shifted a little bit to the online delivery, but never addressed some of the other security concerns they had to worry about. So I do have to give kudos to answer, they pretty much pivoted fast when they recognize that the early stages of the pandemic that a lot of us are going to have to find a solution that we needed. But clearly, I think, what it does is it also reassures the public with that accreditation, that we\u2019re still held accountable to the security and the integrity of our exam programs, the fundamental fairness to our candidates is the thing that we should be most concerned about. They\u2019re holding us accountable to so it\u2019s not as though we woke up one day and say that we\u2019re just going to throw out this new remote prospering program and life is going to be good. We do have to do those studies like Jeff, we\u2019re right now in the midst of our assessment accreditation process which is why we have this data on comparability. But it was great news when our exam team called me and said, \u201cHey, great news! We just discovered that there are no comparability issues, that these exams work well together.\u201d And I think it continues to build the case for the integrity of the program. To me, the most important thing of all is that public perception that we are doing the right things for our programs, are doing the right things for our candidates, are we seeing data that says that there was a problem, and we\u2019re not seeing any of that. And so, that accreditation process to me more than anything else, there\u2019s a lot more data work that we have to do the applications, but to me, it just speaks volumes on the integrity of exactly what it is that we\u2019re doing.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Jarrod Morgan<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Thank you, guys, and I want to jump to the next question in the interest of time. This next question was about, you know, reaching a diverse candidate pool and kind of the feedback you&#8217;ve gotten. I think we got some really good feedback from Ray and Larry about the candidate reaction. And you guys talk a little bit about how to open up a new pool, specifically Faisel with LSAC, can you talk a little bit about, you know, you&#8217;ve talked about its kind of core to your mission to open up your exams to a diverse candidate base. How does this process helps in that effort?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Faisel Alam<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We\u2019ve roughly administered over 170,000 tests, and before you know that\u2019s sort of reaching our high-water marks when back in 2000, lagging on the years now, but it was like late-2000s, like 2008\/2009 cycle. And so, you know, we\u2019re starting to see some applications really in this current cycle. Overall, application applicants are up 12.6% compared to last year, which was trending to be a decrease but it actually increased. African American applicants are up 11.5%. Hispanic\/LatinX applicants are up close to 13%. So, you know, we wanted to make sure that we were reaching . . . core to our mission was making sure that we were accessible to anybody who wants to take this and making the test available. Reducing the barriers to get to testing, rather than driving to a physical center and worrying about the other things that come with in-person testing, we really focused hard when we were going to pivot to online that we can create new barriers in the shift. So one of the things that I think we\u2019ll talk about it, I don\u2019t know how much we\u2019re pressed for time, but I mentioned one of the big things for us was about the technology. I see some comments about technology that\u2019s being required. So, you know, look, if you didn\u2019t have a tablet, if you didn\u2019t have a computer or a laptop to take the test, it didn\u2019t matter if you didn\u2019t have it. We wanted to make sure that you had one that worked. So we shipped you a tablet if you requested it. We didn\u2019t check to see if you had a laptop or anything, we would ship your tablet. And to date we\u2019ve shipped out nearly 4,000 of them to test-takers so they\u2019ll be able to take the test. If your house is anything like mine, it\u2019s not a distraction-free environment. It\u2019s kind of like that frictionless plane in physics class, right? Doesn&#8217;t exist. Well, hey, then let\u2019s take you out of your house, let\u2019s give you a place where you can have a quiet space. So, a lot of test-takers face this. People with children, things like that. So what we did was we said, \u201cWell, you know, what if they didn\u2019t have reliable as well you know other, there\u2019s not just distractions, but we can be reimbursed for rental fees for quiet space.\u201d And today we\u2019ve reimbursed hotel costs for up to about 2,000 test-takers, so we\u2019re starting to see a lot of this. So we want to make sure that there are no new barriers created by going to this modality. And in fact, in core to our mission about accessibility, you know, 70% of the test-takers who have taken us up on these forms of assistance are people of color, so that is core to our mission of diversity, inclusion, and equity.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Jarrod Morgan<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Yes, pretty unique to you guys and a really cool effort that you guys do to tear down any barriers that pop up and it\u2019s actually a great segue into the next question which we have, which is the one that comes up a lot. Technology issues people are concerned about it. They\u2019re concerned about how it sort of, you know, affects the candidates and what they say. So we\u2019re gonna have Jeff and Larry talk about these two very different candidate populations. Jeff, what\u2019s your take on technical issues and how they\u2019ve affected the candidates?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Jeff Frisk<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">I think it\u2019s interesting, you know, you probably look at the dichotomy of Larry\u2019s typical candidate and then our typical candidate. Someone, and again not painting any broad brushstrokes, but just maybe not, you know, as computer savvy as some of our people who that\u2019s all that they do is computer circuits, security stuff. So very different. And I think from our side, I saw one question in the chat window as well about the people using virtual machines. I think, as far as I understand, no, you can\u2019t be on a virtual machine and take a test with ProctorU, and there are just security concerns with that so that was different for some of our candidates. They say, \u201cWell, I have 14 virtual machines running all the time.\u201d You say, \u201cWell, you need to turn all those off before you go take one of these tests.\u201d And I think we did a couple of kind of loaner programs, but a lot of times, the way that we\u2019ve talked to our candidates, and it&#8217;s not from a \u201cyou don&#8217;t have a computer,\u201d it\u2019s the \u201cmy computer has top-secret data on it or my company won&#8217;t allow me to do this.\u201d So it took us a little while to work with. Well, let&#8217;s get a guest profile set up, and you can have a corporate solution where you can push out from the security team or operations center, a guest profile that you would use only to take a test and then burn it down afterward. And clearly, having some of the intrusive types of things that you need to do with remote proxy, I need to take over. Not me but the ProctorU proctors need to take over your webcam, they need to take over your keyboard to shut down applications that are running like whatever instant messenger and stop, things that you shouldn\u2019t have. So for us, that was a challenge just insofar as people weren\u2019t used to it, but I think once we had that right out front, that this is going to be different, you probably shouldn\u2019t be taking the test from your top-secret work computer, or whatever else, right? And I often jokingly say, \u201cIf you have children, what computer do your children use to go online or, you know, check their email or watch Netflix, right?\u201d You probably aren\u2019t using your corporate-sponsored, security-enabled device. For us, it was a learning curve, but we found when we get the right information out to people and we let people know in advance what the requirements are going to be both with the ProctorU test-it-out kind of program or showing up in advance the day before to make sure you check bandwidth right and other things. That\u2019s really been a game-changer for us. The first time someone went and tried it without doing those pre-checks, yeah, there were issues. But we\u2019ve kind of brought that problem forward. I\u2019d rather you have connectivity or technical issues a couple days before you test so we can work that out versus on test day. So that\u2019s been the biggest thing for us is just moving the issues forward in time so that we can deal with them.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Jarrod Morgan<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">To Larry in about, you know, 30 seconds. Give me an idea of like what\u2019s your &#8230;&nbsp;That was super good stuff from everybody.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong> Larry Lynch<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Just ditto, Jeff. No, you know I think for us, it\u2019s really a couple of things. We recognize economically and geographically we may have candidates where this might not be the best choice and so for us the solution was, make sure we have other modalities available. Oftentimes people do need the training. We do have live classes around the country so there were options for people. Where we have done the remote practice, we haven\u2019t seen too many technological challenges and, more often than not, they can be addressed. And so for us, again, the constant concern is just making sure that we\u2019re making our test as accessible as we can, recognize that our population is broad-based both geographically and demographically, and we have to be able to address that. And we can address it with remote proctoring, at least have options for people to select otherwise.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Jarrod Morgan<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">All right, so final question. This one\u2019s for everybody on the panel and we\u2019ll go kind of in order here. Everybody wants to know what the future of testing looks like, right? So I&#8217;m not asking for a full crystal ball, you know, analysis here but, pick a date in the future at five years from now. What does testing look like? Is it hybrid? Do you still see online? Do we somehow snap back to, you know, 2005? What is the future? I&#8217;ll start with Ray since you\u2019ve spent a lot of time watching the industry evolve. What do you think about the future of testing?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Ray Nicosia<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">I don\u2019t think we could put the toothpaste back in the tube. I think you know the remote proctoring is going to be here to stay. ETS is committed to keeping some physical test centers open for people who need to go to a test center, whether you have something at your house that prohibits you from taking the test there, but I can see both models being in play for a long time. We launched computer-based testing in 1993 with TOEFL and GRE to computer, but it took decades to totally eliminate the paper-based world, so I can see using that modality. I can see the test center is still being used in some locations where they have to be, people choose to be. And remote proctoring, that will definitely be offered as well.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Jarrod Morgan<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Faisel, what\u2019s your take on the future?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Speaker: Faisel Alam<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">I feel like I have to echo Ray and I can\u2019t bring any new information into this, but I think that\u2019s exactly right. You go where your customers are essentially and to make sure that we are serving our populations. Like I said, aspiring people that are aspiring for legal education and specifically for our tests, but the industry in general, you know they\u2019re going to make sure that they serve this industry and this community. Those that are seeking licensure credentialing, they\u2019re going to be able to serve them, and we\u2019re always going to have a contingent, you know, we still have people that send faxes today, right? Not really necessary but they do it. We have a condition with folks that want to take our tests that want to only take it in person, you know, so what do we do for those people? We can\u2019t just leave them behind. We have to make sure that we\u2019re serving anyone that wants to pursue legal education. And I think that\u2019s going to be true for everyone. So I think it\u2019s not earth-shattering, that it\u2019s going to be a dual, that mixed modality solution. I think that\u2019s pretty fair to say in the next, you know, five to ten years. The biggest asterisk I would say is making sure that those two are equivalent. And that\u2019s something that our organization is working very hard on. Our test is the gold standard of what we do, and we had a paper-based model for a long time. We started studying computer for much longer before that and never made the change because we had a reliable assessment tool in place for our law schools to use. So not going down the path of Coca-Cola and adjusting new Coke, we stuck with what worked, and so will always stick with what works. So making sure that we\u2019re going mixed modality, that those two things are equivalent, and the score that it produces is relevant to those that need to use it.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Larry Lynch<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Yeah, I\u2019ll be a little more predictive in mine. If you think about the speed of change, Ray was talking about how long it took to get ETS to where it is today. I think exponentially things are changing faster. And if we\u2019re going to want to be where our customers are, I think we\u2019re going to see \u2013 and security still being parallel and everything \u2013 that we do focus on the security of our exams and the opportunity for our candidates. I think we\u2019re going to start to see things shift more mobile. You know I heard Faisel talk a lot about tablets and we think about where we could be five years from now, I think that convenience and security are both going to be drivers for us going forward.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Jarrod Morgan<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">And finally, we\u2019re in overtime but we need to hear from our friend Jeff. Jeff, what do you think?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Jeff Frisk<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">I just have one thing and this is probably counterintuitive. I can get behind what all y\u2019all said. I think for us, one of the big differentiators working with ProctorU, instead of relying on AI and robots proctoring, although that might be futuristic, I think having humans that are proctors is a huge benefit for us. So if I look into my future, I don\u2019t see it changing to AI is ruling the world for proctoring. And I think humans are going to be involved because I get a lot better feel for the test security when there\u2019s a human there. So, anyway, thanks I really appreciate it and great job, Jarrod, for facilitating this great discussion.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Speaker:<\/strong>&nbsp;Jarrod Morgan<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Thank you guys very much. We at Meazure Learning also agree with that position on AI, got some information out there on that. I want to say thank you to everybody for attending. Larry, Ray, Faisel, Jeff, thank you for lending your expertise here today. It\u2019s been great to hear from you. We\u2019ll follow up with some information on your Q&amp;A that you guys sent in if we didn\u2019t get to your question and thank you guys very much. Thanks, everybody.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Now that more than a year has passed since the onset of the pandemic, testing programs are evaluating the impact of pandemic-era changes on their security, performance, accessibility, and reach. Join four industry leaders from high-stakes testing programs in a panel discussion as they share how they\u2019ve turned innovative pandemic changes into long-term solutions. Panelists [&hellip;]<\/p>\n","protected":false},"author":28,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_editorskit_title_hidden":false,"_editorskit_reading_time":0,"_editorskit_is_block_options_detached":false,"_editorskit_block_options_position":"{}","_lmt_disableupdate":"","_lmt_disable":"","footnotes":"","_members_access_role":[],"_members_access_error":""},"categories":[45],"tags":[],"higher_ed":[],"pro_testing":[],"topics":[],"industry":[],"class_list":["post-692","post","type-post","status-publish","format-standard","hentry","category-webinars"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v28.7 (Yoast SEO v28.7) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>[Webinar] The Future is Now: Change and Innovation in Exam Delivery | Meazure Learning<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.meazurelearning.com\/fr\/resources\/the-future-is-now-change-and-innovation-in-exam-delivery\/\" \/>\n<meta property=\"og:locale\" content=\"fr_CA\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"[Webinar] The Future is Now: Change and Innovation in Exam Delivery\" \/>\n<meta property=\"og:description\" content=\"Now that more than a year has passed since the onset of the pandemic, testing programs are evaluating the impact of pandemic-era changes on their security, performance, accessibility, and reach. Join four industry leaders from high-stakes testing programs in a panel discussion as they share how they\u2019ve turned innovative pandemic changes into long-term solutions. Panelists [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.meazurelearning.com\/fr\/resources\/the-future-is-now-change-and-innovation-in-exam-delivery\/\" \/>\n<meta property=\"og:site_name\" content=\"Meazure Learning\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/MeazureLearning\" \/>\n<meta property=\"article:published_time\" content=\"2021-09-07T19:59:07+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-11-02T12:55:21+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/fast.wistia.com\/embed\/medias\/icna6baedm\/swatch\" \/>\n<meta name=\"author\" content=\"cporter2022\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@MeazureLearning\" \/>\n<meta name=\"twitter:site\" content=\"@MeazureLearning\" \/>\n<meta name=\"twitter:label1\" content=\"\u00c9crit par\" \/>\n\t<meta name=\"twitter:data1\" content=\"cporter2022\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimation du temps de lecture\" \/>\n\t<meta name=\"twitter:data2\" content=\"50 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.meazurelearning.com\\\/resources\\\/the-future-is-now-change-and-innovation-in-exam-delivery#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.meazurelearning.com\\\/resources\\\/the-future-is-now-change-and-innovation-in-exam-delivery\"},\"author\":{\"name\":\"cporter2022\",\"@id\":\"https:\\\/\\\/www.meazurelearning.com\\\/fr\\\/#\\\/schema\\\/person\\\/cb577930c4ecbab1ad0c4ce85728b6b7\"},\"headline\":\"[Webinar] The Future is Now: Change and Innovation in Exam Delivery\",\"datePublished\":\"2021-09-07T19:59:07+00:00\",\"dateModified\":\"2023-11-02T12:55:21+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.meazurelearning.com\\\/resources\\\/the-future-is-now-change-and-innovation-in-exam-delivery\"},\"wordCount\":11512,\"publisher\":{\"@id\":\"https:\\\/\\\/www.meazurelearning.com\\\/fr\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/www.meazurelearning.com\\\/resources\\\/the-future-is-now-change-and-innovation-in-exam-delivery#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/fast.wistia.com\\\/embed\\\/medias\\\/icna6baedm\\\/swatch\",\"articleSection\":[\"Webinars\"],\"inLanguage\":\"fr-CA\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.meazurelearning.com\\\/resources\\\/the-future-is-now-change-and-innovation-in-exam-delivery\",\"url\":\"https:\\\/\\\/www.meazurelearning.com\\\/resources\\\/the-future-is-now-change-and-innovation-in-exam-delivery\",\"name\":\"[Webinar] The Future is Now: Change and Innovation in Exam Delivery | Meazure Learning\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.meazurelearning.com\\\/fr\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.meazurelearning.com\\\/resources\\\/the-future-is-now-change-and-innovation-in-exam-delivery#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.meazurelearning.com\\\/resources\\\/the-future-is-now-change-and-innovation-in-exam-delivery#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/fast.wistia.com\\\/embed\\\/medias\\\/icna6baedm\\\/swatch\",\"datePublished\":\"2021-09-07T19:59:07+00:00\",\"dateModified\":\"2023-11-02T12:55:21+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.meazurelearning.com\\\/resources\\\/the-future-is-now-change-and-innovation-in-exam-delivery#breadcrumb\"},\"inLanguage\":\"fr-CA\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.meazurelearning.com\\\/resources\\\/the-future-is-now-change-and-innovation-in-exam-delivery\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-CA\",\"@id\":\"https:\\\/\\\/www.meazurelearning.com\\\/resources\\\/the-future-is-now-change-and-innovation-in-exam-delivery#primaryimage\",\"url\":\"https:\\\/\\\/fast.wistia.com\\\/embed\\\/medias\\\/icna6baedm\\\/swatch\",\"contentUrl\":\"https:\\\/\\\/fast.wistia.com\\\/embed\\\/medias\\\/icna6baedm\\\/swatch\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.meazurelearning.com\\\/resources\\\/the-future-is-now-change-and-innovation-in-exam-delivery#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.meazurelearning.com\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"[Webinar] The Future is Now: Change and Innovation in Exam Delivery\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.meazurelearning.com\\\/fr\\\/#website\",\"url\":\"https:\\\/\\\/www.meazurelearning.com\\\/fr\\\/\",\"name\":\"Meazure Learning\",\"description\":\"A Full-Service Test Development, Delivery, and Proctoring Provider\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.meazurelearning.com\\\/fr\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.meazurelearning.com\\\/fr\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"fr-CA\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.meazurelearning.com\\\/fr\\\/#organization\",\"name\":\"Meazure Learning\",\"url\":\"https:\\\/\\\/www.meazurelearning.com\\\/fr\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-CA\",\"@id\":\"https:\\\/\\\/www.meazurelearning.com\\\/fr\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/www.meazurelearning.com\\\/wp-content\\\/uploads\\\/2021\\\/09\\\/MZ-primary-logo-color.png\",\"contentUrl\":\"https:\\\/\\\/www.meazurelearning.com\\\/wp-content\\\/uploads\\\/2021\\\/09\\\/MZ-primary-logo-color.png\",\"width\":2727,\"height\":734,\"caption\":\"Meazure Learning\"},\"image\":{\"@id\":\"https:\\\/\\\/www.meazurelearning.com\\\/fr\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/MeazureLearning\",\"https:\\\/\\\/x.com\\\/MeazureLearning\",\"https:\\\/\\\/www.linkedin.com\\\/company\\\/meazure-learning\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.meazurelearning.com\\\/fr\\\/#\\\/schema\\\/person\\\/cb577930c4ecbab1ad0c4ce85728b6b7\",\"name\":\"cporter2022\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-CA\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/5ff15d8844ff15a61e46fbb5a6575176d67fe9452bc932542491ff5fa53c58d9?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/5ff15d8844ff15a61e46fbb5a6575176d67fe9452bc932542491ff5fa53c58d9?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/5ff15d8844ff15a61e46fbb5a6575176d67fe9452bc932542491ff5fa53c58d9?s=96&d=mm&r=g\",\"caption\":\"cporter2022\"}}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"[Webinar] The Future is Now: Change and Innovation in Exam Delivery | Meazure Learning","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.meazurelearning.com\/fr\/resources\/the-future-is-now-change-and-innovation-in-exam-delivery\/","og_locale":"fr_CA","og_type":"article","og_title":"[Webinar] The Future is Now: Change and Innovation in Exam Delivery","og_description":"Now that more than a year has passed since the onset of the pandemic, testing programs are evaluating the impact of pandemic-era changes on their security, performance, accessibility, and reach. Join four industry leaders from high-stakes testing programs in a panel discussion as they share how they\u2019ve turned innovative pandemic changes into long-term solutions. Panelists [&hellip;]","og_url":"https:\/\/www.meazurelearning.com\/fr\/resources\/the-future-is-now-change-and-innovation-in-exam-delivery\/","og_site_name":"Meazure Learning","article_publisher":"https:\/\/www.facebook.com\/MeazureLearning","article_published_time":"2021-09-07T19:59:07+00:00","article_modified_time":"2023-11-02T12:55:21+00:00","og_image":[{"url":"https:\/\/fast.wistia.com\/embed\/medias\/icna6baedm\/swatch","type":"","width":"","height":""}],"author":"cporter2022","twitter_card":"summary_large_image","twitter_creator":"@MeazureLearning","twitter_site":"@MeazureLearning","twitter_misc":{"\u00c9crit par":"cporter2022","Estimation du temps de lecture":"50 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.meazurelearning.com\/resources\/the-future-is-now-change-and-innovation-in-exam-delivery#article","isPartOf":{"@id":"https:\/\/www.meazurelearning.com\/resources\/the-future-is-now-change-and-innovation-in-exam-delivery"},"author":{"name":"cporter2022","@id":"https:\/\/www.meazurelearning.com\/fr\/#\/schema\/person\/cb577930c4ecbab1ad0c4ce85728b6b7"},"headline":"[Webinar] The Future is Now: Change and Innovation in Exam Delivery","datePublished":"2021-09-07T19:59:07+00:00","dateModified":"2023-11-02T12:55:21+00:00","mainEntityOfPage":{"@id":"https:\/\/www.meazurelearning.com\/resources\/the-future-is-now-change-and-innovation-in-exam-delivery"},"wordCount":11512,"publisher":{"@id":"https:\/\/www.meazurelearning.com\/fr\/#organization"},"image":{"@id":"https:\/\/www.meazurelearning.com\/resources\/the-future-is-now-change-and-innovation-in-exam-delivery#primaryimage"},"thumbnailUrl":"https:\/\/fast.wistia.com\/embed\/medias\/icna6baedm\/swatch","articleSection":["Webinars"],"inLanguage":"fr-CA"},{"@type":"WebPage","@id":"https:\/\/www.meazurelearning.com\/resources\/the-future-is-now-change-and-innovation-in-exam-delivery","url":"https:\/\/www.meazurelearning.com\/resources\/the-future-is-now-change-and-innovation-in-exam-delivery","name":"[Webinar] The Future is Now: Change and Innovation in Exam Delivery | Meazure Learning","isPartOf":{"@id":"https:\/\/www.meazurelearning.com\/fr\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.meazurelearning.com\/resources\/the-future-is-now-change-and-innovation-in-exam-delivery#primaryimage"},"image":{"@id":"https:\/\/www.meazurelearning.com\/resources\/the-future-is-now-change-and-innovation-in-exam-delivery#primaryimage"},"thumbnailUrl":"https:\/\/fast.wistia.com\/embed\/medias\/icna6baedm\/swatch","datePublished":"2021-09-07T19:59:07+00:00","dateModified":"2023-11-02T12:55:21+00:00","breadcrumb":{"@id":"https:\/\/www.meazurelearning.com\/resources\/the-future-is-now-change-and-innovation-in-exam-delivery#breadcrumb"},"inLanguage":"fr-CA","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.meazurelearning.com\/resources\/the-future-is-now-change-and-innovation-in-exam-delivery"]}]},{"@type":"ImageObject","inLanguage":"fr-CA","@id":"https:\/\/www.meazurelearning.com\/resources\/the-future-is-now-change-and-innovation-in-exam-delivery#primaryimage","url":"https:\/\/fast.wistia.com\/embed\/medias\/icna6baedm\/swatch","contentUrl":"https:\/\/fast.wistia.com\/embed\/medias\/icna6baedm\/swatch"},{"@type":"BreadcrumbList","@id":"https:\/\/www.meazurelearning.com\/resources\/the-future-is-now-change-and-innovation-in-exam-delivery#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.meazurelearning.com\/"},{"@type":"ListItem","position":2,"name":"[Webinar] The Future is Now: Change and Innovation in Exam Delivery"}]},{"@type":"WebSite","@id":"https:\/\/www.meazurelearning.com\/fr\/#website","url":"https:\/\/www.meazurelearning.com\/fr\/","name":"Meazure Learning","description":"A Full-Service Test Development, Delivery, and Proctoring Provider","publisher":{"@id":"https:\/\/www.meazurelearning.com\/fr\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.meazurelearning.com\/fr\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"fr-CA"},{"@type":"Organization","@id":"https:\/\/www.meazurelearning.com\/fr\/#organization","name":"Meazure Learning","url":"https:\/\/www.meazurelearning.com\/fr\/","logo":{"@type":"ImageObject","inLanguage":"fr-CA","@id":"https:\/\/www.meazurelearning.com\/fr\/#\/schema\/logo\/image\/","url":"https:\/\/www.meazurelearning.com\/wp-content\/uploads\/2021\/09\/MZ-primary-logo-color.png","contentUrl":"https:\/\/www.meazurelearning.com\/wp-content\/uploads\/2021\/09\/MZ-primary-logo-color.png","width":2727,"height":734,"caption":"Meazure Learning"},"image":{"@id":"https:\/\/www.meazurelearning.com\/fr\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/MeazureLearning","https:\/\/x.com\/MeazureLearning","https:\/\/www.linkedin.com\/company\/meazure-learning"]},{"@type":"Person","@id":"https:\/\/www.meazurelearning.com\/fr\/#\/schema\/person\/cb577930c4ecbab1ad0c4ce85728b6b7","name":"cporter2022","image":{"@type":"ImageObject","inLanguage":"fr-CA","@id":"https:\/\/secure.gravatar.com\/avatar\/5ff15d8844ff15a61e46fbb5a6575176d67fe9452bc932542491ff5fa53c58d9?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/5ff15d8844ff15a61e46fbb5a6575176d67fe9452bc932542491ff5fa53c58d9?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/5ff15d8844ff15a61e46fbb5a6575176d67fe9452bc932542491ff5fa53c58d9?s=96&d=mm&r=g","caption":"cporter2022"}}]}},"modified_by":null,"_links":{"self":[{"href":"https:\/\/www.meazurelearning.com\/fr\/wp-json\/wp\/v2\/posts\/692","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.meazurelearning.com\/fr\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.meazurelearning.com\/fr\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.meazurelearning.com\/fr\/wp-json\/wp\/v2\/users\/28"}],"replies":[{"embeddable":true,"href":"https:\/\/www.meazurelearning.com\/fr\/wp-json\/wp\/v2\/comments?post=692"}],"version-history":[{"count":0,"href":"https:\/\/www.meazurelearning.com\/fr\/wp-json\/wp\/v2\/posts\/692\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.meazurelearning.com\/fr\/wp-json\/wp\/v2\/media?parent=692"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.meazurelearning.com\/fr\/wp-json\/wp\/v2\/categories?post=692"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.meazurelearning.com\/fr\/wp-json\/wp\/v2\/tags?post=692"},{"taxonomy":"higher_ed","embeddable":true,"href":"https:\/\/www.meazurelearning.com\/fr\/wp-json\/wp\/v2\/higher_ed?post=692"},{"taxonomy":"pro_testing","embeddable":true,"href":"https:\/\/www.meazurelearning.com\/fr\/wp-json\/wp\/v2\/pro_testing?post=692"},{"taxonomy":"topics","embeddable":true,"href":"https:\/\/www.meazurelearning.com\/fr\/wp-json\/wp\/v2\/topics?post=692"},{"taxonomy":"industry","embeddable":true,"href":"https:\/\/www.meazurelearning.com\/fr\/wp-json\/wp\/v2\/industry?post=692"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}