RESOURCES

Read our latest news and access media resources

The Time Crunch: How Much Time Should Candidates Be Given to Take an Exam?

Posted:
Categories: Reports & Guides

When developing an assessment, two major decisions a credentialing organization needs to make are: How many items will be on the exam? and How much time will test-takers be given to complete the exam? These choices can have a significant impact on fairness and validity. Often, once an exam has been administered, many ctest-takers will anecdotally report that they ran out of time and the assessment was unfair. Therefore, an important question to ask is, What can credentialing organizations do in order to investigate and address these concerns? We explore this topic in the white paper.

Scoring Models for Innovative Items

Posted:
Categories: Reports & Guides

As a way to capture the richness of job performance, many credentialing organizations are supplementing traditional multiple-choice questions (MCQs) with innovative item types. Although this view is not unanimous, one theory suggests that MCQs represent a somewhat artificial representation of job tasks and that innovative item types represent a more refined way to assess candidate competence. This white paper explores this topic in depth.

Competency Validation Surveys

Posted:
Categories: Reports & Guides

A competency survey is a popular instrument for validating the skills, knowledge, and behaviors included on your competency profile. It allows an organization to reach numerous practitioners working in different practice settings and gather quantitative and qualitative data that lends itself to multiple methods of analysis and interpretation. This white paper explores the options for completing such a survey as well as some important considerations. 

Evaluating Your Distractors

Posted:
Categories: Reports & Guides

In addition to looking at an item’s p-value and discrimination index to determine how well an item is functioning, it is also important to analyze the distractor choice. The study of distractors is important for subject matter experts to better understand the performance of an item. Accordingly, distractor analyses can be used in an item’s revision process. Distractor evaluation is also helpful during key validation as it can help determine whether an item has a key error or more than one correct answer. This white paper discusses two methods for distractor evaluation: tabular and graphical.

Reading Your Item Analysis Report: Item Is Making a Limited Contribution to the Measurement Capacity of the Test

Posted:
Categories: Reports & Guides

Following an exam administration, Meazure Learning (formerly Yardstick) often produces an item analysis report from their proprietary software, COGs. The item analysis report provides information about each item in terms of its difficulty, discrimination, and the distribution of responses across alternatives. This white paper focuses on understanding what it means when a COGs item analysis report reads: “Item is making a limited contribution to the measurement capability of the test.”

Item Response Theory 101: Assessing Candidate Ability

Posted:
Categories: Reports & Guides

In the testing world, mention of Item Response Theory (IRT) conjures up images of cutting-edge, state-of-the-art practices needed for a program to be seen as modern and valid. The purpose of this white paper is to provide an introduction to IRT using nontechnical language. Since IRT is such a big topic, this white paper will focus on how IRT can be used to assess test-taker ability.

2018: Online Proctoring and the Evolution of Cheating Infographic

Posted:
Categories: Reports & Guides

We’ve seen a lot in the ten years since ProctorU (now Meazure Learning) was established as the first live online proctoring service. We’ve learned so much that we wanted to share a few stats about the ever-changing online learning industry and how cheaters have evolved alongside technological advances. Learn how much online education has grown in the last decade, what some of the most innovative cheating attempts are and when cheaters cheat most often.

Cheating in the Digital Age: How Higher Education Can Protect Itself from New Forms of Academic Dishonesty

Posted:
Categories: Reports & Guides

This white paper dives into how technology has changed the landscape of higher education and how cheating has evolved to take advantage of the new realities. Included are staggering statistics about academic dishonesty, two case studies about how Meazure Learning (formerly ProctorU) helped institutions combat the rising problems, and four ways campuses can protect themselves.