Comira features RIAS™, a proprietary methodology that ensures precision and reliability in all phases of Test Development.

Our psychometricians work closely with boards, board members and executive officers to develop job-related examination programs that adhere to the highest technical standards.

RIAS™ – Remote Item Authoring. Development of test questions by trained subject matter experts on the website via a secure network.

Psychometric Audits. Evaluation of psychometric properties of an examination program that assesses the degree of congruence with the Standards for Educational and Psychological Testing (AERA, APA, NCME, 1999).

Practice Analysis. Identification of professional responsibilities, work behaviors, and underlying competencies required for safe practice.

Content Specifications. Identification of major subject matter areas and relative weights of subject matter areas, e.g., number of items.

Examination Development. Development of questions that assess professional knowledge required for safe practice. Requires formal training of subject matter experts in item writing and item review procedures.

Cut Score Studies. Establishment of minimum acceptable competence to pass the examination. The cut score determines the number of items that candidates must answer correctly in order to qualify for the credential.

Examination Publication. Selection of items that measure the full range of competencies of the profession, e.g., number of items in each major subject matter area.

Statistical Analysis. Application of statistical methods to determine the overall quality of test items, distractors and test reliability.

Item Banking and Maintenance. Storage and maintenance of test items and information about test items in a database, e.g., item statistics, creation and revision dates, reference sources from which the item was derived, etc.

Learn more about our test administration services.


Our psychometric team has provided short papers to drive conversation and enhance understanding regarding various topics. Often they share their expertise via professional conferences, webinars, and workshops.

White Paper Series: Test Development Life Cycle

by Pamela Ing Stemmer, Ph.D.

  1. A Test Development Life Cycle Framework for Testing Program Planning (February 29th, 2016)
  2. Job Analysis 101 (April 11th, 2016)

White Paper Series: Current Issues in Test Development

by Anne Thissen-Roe, Ph.D.

  1. Some Issues In Retesting Policy (September 15th, 2016)
  2. Nuisance Multidimensionality: Practical Approaches, Solutions and Opportunities (June 22nd, 2016)
  3. High Fidelity in Items and Response Data (May 17th, 2016)
  4. Stretching Your Item Bank: Cloning, Sampling, and Item Assembly (April 11th, 2016)
  5. Web Monitoring: Are you putting your secure item content into Google Autocomplete? (February 29th, 2016)

White Paper Series: Technical Notes on Test Security

by Anne Thissen-Roe, Ph.D.

  1. The Number Seven: Visualizing Item Compromise (October 28th, 2016)

Conference Papers

Automatic Response Option Sampling for Situational Judgment Items
by Anne Thissen-Roe, Ph.D., Comira, and Stephen Gunter, Ph.D., Camber Corporation
Paper presented at the annual meeting of the Society for Industrial and Organizational Psychology (SIOP), Anaheim, CA, April 15th, 2016

Speed, Speededness, and the Price of High Information
by Anne Thissen-Roe, Ph.D. and Michael Finger, Ph.D., Comira
Paper presented at the annual meeting of the Society for Industrial and Organizational Psychology (SIOP), Honolulu, HI, May 17th, 2014