RESOURCES

Read our latest news and access media resources

Assessment Life Cycle Stage 2: Item Development

Posted:
Categories: Reports & Guides

Stage 2 of the Assessment Life Cycle is where test questions are created and used to populate an item bank. That may sound simple enough, but in truth, item development is careful work. It requires the coordinated effort of several groups of experts to ensure that the final examination includes the right number and quality of items and is organized into the right categories. This white paper explores many of the considerations when undertaking this process.

Assessment Life Cycle Stage 1: Defining Your Target & Creating Test Specifications

Posted:
Categories: Reports & Guides

Every assessment program starts with defining targets and creating test specifications. During this stage, the test developers decide what the goal of their assessment is going to be. These goals are formalized and used to create an “examination blueprint,” which specifies the number and type of questions that the assessment requires to soundly measure each knowledge area. This white paper explores many of the considerations when undertaking this process.

For Credentialing Programs: 11 Questions to Ask when Considering Online Proctoring

Posted:
Categories: Reports & Guides

Finding the right online proctoring partner can be difficult and time consuming. If you knew the right questions to ask, wouldn’t it be easier to make an informed decision? We think so too! That’s why we’ve outlined some questions that can help guide you in your search. In this white paper, you’ll find: 11 important questions you should be asking every company you’re considering, why the questions matter, and our responses to the questions.

Remote Education 2.0

Posted:
Categories: Reports & Guides

In the wake of the COVID-19 pandemic, colleges and universities across the world were forced to pivot to remote education. This hasty transition resulted in many ad hoc and make-do teaching and assessment plans that were never designed for long-term use. As the pandemic continues to disrupt traditional higher education, administrators and faculty need sustainable methods to remotely teach and assess students. Jeffrey Selingo and Karin Fischer, two well-respected writers in the field of higher education, collaborated on this white paper addressing three key questions regarding online proctoring.

For Academic Institutions: 9 Questions to Ask Every Online Proctoring Vendor Before Committing

Posted:
Categories: Reports & Guides

Finding the right online proctoring partner can be difficult and time consuming. If you knew the right questions to ask, wouldn’t it be easier to make an informed decision? We think so too! That’s why we’ve outlined some questions that can help guide you in your search. In this white paper, you’ll find: 9 important questions you should be asking every company you’re considering, why the questions matter, and Meazure Learning’s responses to the questions

Setting a Cut Score for a Performance-Based Assessment: The Ebel Method

Posted:
Categories: Reports & Guides

Setting a defensible cut score through a process called standard setting is an essential component that supports exam validity. For traditional multiple-choice and other selected-response assessments, there is a wide body of literature that supports the use of established standard-setting methods such as the Angoff method or the Nedelsky method. This white paper explores some of the key considerations when setting a cut score.

The Time Crunch: How Much Time Should Candidates Be Given to Take an Exam?

Posted:
Categories: Reports & Guides

When developing an assessment, two major decisions a credentialing organization needs to make are: How many items will be on the exam? and How much time will test-takers be given to complete the exam? These choices can have a significant impact on fairness and validity. Often, once an exam has been administered, many ctest-takers will anecdotally report that they ran out of time and the assessment was unfair. Therefore, an important question to ask is, What can credentialing organizations do in order to investigate and address these concerns? We explore this topic in the white paper.

Scoring Models for Innovative Items

Posted:
Categories: Reports & Guides

As a way to capture the richness of job performance, many credentialing organizations are supplementing traditional multiple-choice questions (MCQs) with innovative item types. Although this view is not unanimous, one theory suggests that MCQs represent a somewhat artificial representation of job tasks and that innovative item types represent a more refined way to assess candidate competence. This white paper explores this topic in depth.

Competency Validation Surveys

Posted:
Categories: Reports & Guides

A competency survey is a popular instrument for validating the skills, knowledge, and behaviors included on your competency profile. It allows an organization to reach numerous practitioners working in different practice settings and gather quantitative and qualitative data that lends itself to multiple methods of analysis and interpretation. This white paper explores the options for completing such a survey as well as some important considerations. 

Evaluating Your Distractors

Posted:
Categories: Reports & Guides

In addition to looking at an item’s p-value and discrimination index to determine how well an item is functioning, it is also important to analyze the distractor choice. The study of distractors is important for subject matter experts to better understand the performance of an item. Accordingly, distractor analyses can be used in an item’s revision process. Distractor evaluation is also helpful during key validation as it can help determine whether an item has a key error or more than one correct answer. This white paper discusses two methods for distractor evaluation: tabular and graphical.