{"id":12101,"date":"2019-04-10T11:04:13","date_gmt":"2019-04-10T16:04:13","guid":{"rendered":"https:\/\/www.getyardstick.com\/?p=12101"},"modified":"2023-11-29T09:32:25","modified_gmt":"2023-11-29T15:32:25","slug":"how-online-proctoring-beats-in-person-exam-administration-to-securely-certify-social-compliance-auditors","status":"publish","type":"post","link":"https:\/\/www.meazurelearning.com\/fr\/resources\/how-online-proctoring-beats-in-person-exam-administration-to-securely-certify-social-compliance-auditors","title":{"rendered":"How Online Proctoring Beats In-Person Exam Administration to Securely Certify Social Compliance Auditors"},"content":{"rendered":"\n

Quick Overview<\/h2>\n\n\n\n
\n
\n

Situation<\/mark><\/h3>\n\n\n\n

APSCA is an industry association charged with developing a standardized global certification program. A credible, cost-effective solution was needed to reach over 3,200 people in 47 different languages across 93 countries. <\/p>\n\n\n\n

\"\"<\/figure>\n<\/div>\n\n\n\n
\n

Solution<\/mark><\/h3>\n\n\n\n

After careful evaluation of other proctoring methods, APSCA chose online proctoring to monitor their three different exam types and selected the ProctorU Proctoring Platform<\/a>‘s Live+ service line<\/a>.<\/p>\n\n\n\n

<\/div>\n\n\n
\n
\"\"<\/figure>\n<\/div><\/div>\n\n\n\n
\n

Results<\/mark><\/h3>\n\n\n\n

Meazure Learning provided a solution that allowed APSCA to quickly scale a new global certification program while also helping them to avoid $4.8 million in costs as well as identify and prevent integrity issues.<\/p>\n\n\n\n

\"\"<\/figure>\n<\/div>\n<\/div>\n\n\n\n

Background<\/h2>\n\n\n\n

The Association of Professional Social Compliance Auditors (APSCA) was established in 2015 to enhance the professionalism, consistency, and credibility of individuals and organizations performing social compliance audits. While APSCA is still a young association, the social compliance industry has been in existence for more than 20 years. APSCA is the sixth attempt to professionalize the industry and the first to find success. Today, APSCA consists of over 3,200 auditors and 40+ member firms across 93 countries, and it is still growing.<\/p>\n\n\n\n

\n
\n

A major goal of APSCA was to create a standardized global certification program. This led to the development of the Certified Social Compliance Auditor (CSCA) program. To be designated a CSCA, an individual must pass a three-part examination and meet minimum experience requirements stipulated by APSCA.<\/p>\n<\/div>\n\n\n\n

\n
\n

“You wouldn’t go hire an accountant that wasn’t a CPA or a lawyer that hadn’t passed the Bar exam. You wouldn’t even think about doing that. We want people to get to that place with our industry as well.”<\/p>\nRona Starr, President and CEO, APSCA<\/cite><\/blockquote>\n<\/div>\n<\/div>\n\n\n\n

The purpose of the certification is to establish a level of credibility and validation for APSCA member firms and auditors. The association mirrored its program after legal, accounting, and other similar industry certifications with the intention of establishing a credential that would be sought after and, eventually, required when a company needed social compliance auditing services.<\/p>\n\n\n\n

As explained by Rona Starr, President and CEO of APSCA, \u201cYou wouldn\u2019t go hire an accountant that wasn\u2019t a CPA or a lawyer that hadn\u2019t passed the Bar. You wouldn\u2019t even think about doing that. We want people to get to that place with our industry as well.\u201d<\/p>\n\n\n\n

With five failed attempts to professionalize the industry, it was critical that APSCA succeed and find a credible solution to meet all of their requirements.<\/p>\n\n\n\n

    \n
  1. Quick to implement.<\/mark><\/li>\n\n\n\n
  2. Scalable to reach over 3,200 auditors across 93 countries.<\/mark><\/li>\n\n\n\n
  3. Cost effective<\/mark><\/li>\n<\/ol>\n\n\n\n

    In-Person Exam Administration Pilots<\/h2>\n\n\n\n

    In the first pilot phase, APSCA chose to administer and proctor their exams in a face-to-face setting. Pilots were administered in Turkey with 40 auditors and in China with 80 auditors. In going through those pilots, they saw that using physical testing centers would not meet their requirements.<\/p>\n\n\n\n

    \u201cIt wasn\u2019t scalable, it wasn\u2019t cost-effective, and we realized that we had a much higher risk of integrity issues than what we originally thought we would have,\u201d said Starr. \u201cWe thought we couldn\u2019t beat face-to-face in being able to address integrity issues, and we quickly recognized that wasn\u2019t the case.\u201d<\/p>\n\n\n\n

    The Search for a Better Solution<\/h2>\n\n\n\n
    <\/div>\n\n\n\n
    \n
    \n
    \n

    “We thought we couldn’t beat face-to-face in being able to address integrity issues. And we quickly recognized that wasn’t the case.”<\/p>\n<\/blockquote>\n<\/div>\n\n\n\n

    \n

    Starr admits that she was very anti-online proctoring at the beginning of the process. However, as a direct result of what she saw during face-to-face pilots, she began looking for other options, and online proctoring soon rose to the top of her list of alternatives. After investigating the players in online proctoring, APSCA decided to put Meazure Learning (formerly ProctorU) to the test \u2026 literally. Starr signed up a few of her team members through our system and instructed them that their sole purpose was to cheat in the most subtle ways possible and see what happened. The outcome was positive.<\/p>\n<\/div>\n<\/div>\n\n\n\n

    Exceeding Expectations and Overcoming Barriers<\/h2>\n\n\n\n

    In addition to meeting the initial requirements of quick, scalable, and cost-effective, Starr identified several other areas where the Live+ proctoring service exceeded her expectations.<\/p>\n\n\n\n

    Identifying and Preventing Integrity Issues<\/mark><\/h3>\n\n\n\n
    \n
    \n

    During the face-to-face proctored exam pilots, APSCA recognized how difficult it was to effectively monitor a room full of test-takers all at once.<\/p>\n\n\n\n

    “It is physically impossible for one or two proctors (also called invigilators) to watch each individual at all times. The proctor is right onto them and saying, \u2018What are you looking at? What\u2019s over there?\u2019 We could never pick that up in a live, in-room situation. Some of the other benefits that we\u2019ve seen are that as soon as the proctor says your time is up, the proctor can stop that exam and stop the test-taker from continuing on.\u201d<\/p>\n\n\n\n

    The ability to identify and proactively eliminate integrity issues translates to value and added credibility for the CSCA credential.<\/p>\n\n\n\n

    \u201cThe more credibility that we can build and demonstrate to the people that are asking for APSCA certified auditors, the better for us as an industry association,\u201d explains Starr.<\/p>\n<\/div>\n\n\n\n

    \n
    \n

    \u201cI was actually blown away at the process,\u201d said Starr. \u201cI was amazed at the very simple things they caught. Eye movement from the auditor, body language that the proctor was able to identify and then stop the exam to investigate further. It really impressed me and we made an almost overnight change in the organization to move away from face-to-face and only move forward with online proctoring.\u201d<\/p>\n<\/blockquote>\n<\/div>\n<\/div>\n\n\n\n

    Cost Avoidance<\/mark><\/h3>\n\n\n\n

    A benefit Starr is most excited about with the transition to online test administration and proctoring is the cost avoidance recognized by APSCA and their member firms. She estimates that the association is saving at least $500 per auditor, per exam. With three exams to administer across 3,200+ auditors, that comes out to a minimum savings of $4.8 million for APSCA. That number doesn\u2019t take into account the money saved by the member firms not having to pay travel expenses (flights, cars, hotels, food, etc.) for each auditor to go to a physical testing center. Furthermore, the estimate doesn\u2019t include the time each auditor would have to spend away from work when traveling to a physical test center. Considering these variables, the quantifiable cost is much higher than APSCA\u2019s estimated savings of $500\/auditor\/exam.<\/p>\n\n\n

    \n
    \"math<\/figure>\n<\/div>\n\n\n

    Validating Integrity Issues<\/mark><\/h3>\n\n\n\n

    One of the benefits Starr didn\u2019t expect was how easy the ProctorU system makes it to validate and close out an integrity issue.<\/p>\n\n\n\n

    \u201cEverything is recorded,\u201d she explains. \u201cI can see what the auditor was doing, I can see where they were in the exam, I can see the time, I can see what the chat log is between the individual proctor and the individual auditor. It really makes for a simple closing out of an integrity issue when you\u2019ve got those snapshots and you\u2019ve got that video recording. It\u2019s pretty black-and-white.\u201d<\/p>\n\n\n\n

    When an integrity issue comes into question at a physical testing facility, it can be difficult to definitively prove the series of events due to hearsay. Starr recalls one integrity issue from the face-to-face pilots that took a very long time to close out because it turned into a he-said, she-said situation.<\/p>\n\n\n\n

    \u201cThe proctor says, \u2018This is what I saw.\u2019 The test-taker says, \u2018No, this is what actually happened.\u2019 It\u2019s very difficult to close that out.\u201d<\/p>\n\n\n\n

    Full recordings of a test-taker\u2019s face and screencast plus the chat logs make it very clear and nearly irrefutable when an integrity breach is suspected.<\/p>\n\n\n\n

    Flexibility Across Different Exam Types<\/mark><\/h3>\n\n\n\n

    The CSCA examination process is made up of three separate exams that must be passed in sequential order:<\/p>\n\n\n\n

      \n
    1. A 100-question multiple choice exam to establish an auditor\u2019s base of knowledge<\/li>\n\n\n\n
    2. A case study followed by 40 multiple choice and short answer questions to simulate an actual social compliance audit<\/li>\n\n\n\n
    3. A one-on-one remote interview, fully recorded<\/li>\n<\/ol>\n\n\n\n

      Collaboration in Implementing Solutions<\/mark><\/h3>\n\n\n\n

      Starr notes her appreciation of working with Meazure Learning as a true partner in defining the exam process and implementing solutions that address their unique situation.<\/p>\n\n\n\n

      \u201cSome of the most successful parts of the pilot have been the collaboration and teamwork with [Meazure Learning],\u201d she says. \u201c[Meazure Learning has] been really keen to work and learn with us. We\u2019ve made some mistakes along the way, but we\u2019ve also been able to correct along the way.\u201d<\/p>\n\n\n\n

      Overcoming Language Barriers<\/mark><\/h3>\n\n\n\n

      A unique challenge faced when creating a global exam process is language. APSCA auditors speak 47 different languages, with 10 of those being spoken by only one person. This is another specific area where Starr values the collaboration with her Meazure Learning team. \u201c[Meazure Learning] has been great in thinking about how we\u2019re going to do that, but I also think it\u2019s going to be one of our biggest issues,\u201d she says.<\/p>\n\n\n\n

      Conclusion<\/h2>\n\n\n\n

      APSCA\u2019s goal is to have the first round of fully-certified auditors by the end of 2019 and to bring a new level of credibility and value to the social auditing profession. Starr is confident this goal will be achieved.<\/p>\n\n\n\n

      \u201cWe continue to gain momentum with both our stakeholders as well as other interested parties,\u201d she says. \u201cThere are a number of brands, retailers, and collaborative initiatives who are already saying only APSCA-enrolled auditors who put their APSCA number on a report are eligible to conduct audits on their behalf.\u201d<\/p>\n\n\n\n

      With all the challenges faced by previous associations trying to professionalize the social compliance industry, Starr and APSCA felt tremendous pressure to make the global standardized certification a reality quickly, but in the most credible and cost-effective way possible. They\u2019re now certain online proctoring through ProctorU Pro was the only way to meet all of their objectives.<\/p>\n\n\n\n

      \n\n\n\n

      Want to take this case study with you? Download a PDF!<\/h3>\n\n\n\n\n