Evidence-based evaluations and 
      credentials supporting schools and workforce.
 



 



 
  For the field.  By the field.  In the field.

Integrity + Innovation 

Log in

Practical Analytics & Psychometrics

  • 27 Oct 2014
  • 8:30 AM
  • 28 Oct 2014
  • 5:00 PM
  • Live & Virtual Oct 27, 28 from 8:30 - 5:00pm Central

Registration


Registration is closed

Practical Analytics & Psychometrics

Live & Virtual Oct 27 & 28 from 8:30 - 5:00pm Central 
Limited Enrollment = 20

The workshop is offered as a live 2-day program. Attendees may also join virtually.  It is for the lay person involved in credentialing. This workshop provides skills in using analytics and psychometrics for credentialing and assessments along with guidance on working more effectively with psychometricians and evaluation professionals. 

Intended audience
  1. Managers and professionals who make decisions related to the application of psychometrics and who engage psychometricians
  2. Professionals who want a better understanding of psychometrics so they can be  better consumers of the services

Objectives

Given a mandate to oversee or develop a credential and require psychometric and analytic services, you will learn to:

  • Define and select services that meet your requirements
  • Make sampling decisions that support your credentialing mandate
  • Select a defensible method for setting a pass score that best meets your needs
  • Identify the need for policies and procedures to reduce administrative error
  • Judge the validity of an assessment based on assessment data
  • Interpret item analyses and test results
  • Judge the efficacy of an assessment instrument
  • Design and conduct validation studies
  • Partner with measurement professionals in ways that protect your interests
  • Respond to challenges to the validity and defensibility of your credential
Books and Materials

The fee includes an electronic copy of the Practical Analytics & Psychometrics Workbook for Credentialing Professionals.   The workbook contains instructions and guidelines.

 

Topic Outline for the Practical Analytics & Psychometrics Workshop

First Session:  What is Psychometrics?

•   Definitions

•   Overview of where psychometrics plays a role in the process of creating or evaluating a credential

•   What decisions benefit from psychometric input

•   The importance of knowing your psychometric requirements

•   What is required for evidence-centered assessment v other based assessments

•   Nomenclature that will help you find consultants that will help you move your process forward

•   Critical question to ask

Third Session: Guidelines for Knowledge and Skill-based assessment compared to Evidence-centered assessments

  • Strengths and limitation of methods used to set pass scores
  • What validity and reliability look like
  • How to interpret and use an item analysis
  • How to interpret and use test results
  • How to create & validate a rubric
  • Critical questions to ask

Second Session: General Integrity Guidelines

  • What is reliability and why it is important
  • What is validity and why it is important
  • How to minimize sampling error
  • How to minimize administrative error
  • How to minimize construct errors
  • How to establish internal integrity
  • Critical questions to ask

Fourth Session: Continuous Improvement

  • Inter-rater reliability
  • Instrument and Item analyses
  • Evaluating the performance of the instrument and process
  • Measuring quality, impact, and results
  • Critical questions to ask





(c) Hale Associates Center, 2018, www.halecenter.org

Powered by Wild Apricot Membership Software