Examination construction begins with the preparation of a draft examination that is based on a form of the examination about to be retired from use;
-
The psychometricians ensure the pool of questions meets item-level statisitical criteria as well as pass-rate criteria for both validated and pre-test items. The pool of questions is assessed to remove items that are too easy (i.e. approx. P>.90), too difficult (i.e. approx. P<.40) and/or poor discriminators (i.e. approx. Rpb>.10
-
Every five years following the release of the new task analysis, a Standard Setting Study is conducted using methods that objectively facilitate the criterion-referenced nature of credentialing decisions, based on a method described by Angoff (1971). The study results are used to guide selection of a passing standard. The form used for standard setting is used as the base form for the creation of subsequent forms of the examination, to be made parallel and equivalent using statistical pre-administration equating and adherence to the content allocation requirements of the exam content outline.
-
The examination committee members (committee) perform an item-by-item review of the pool of questions prepared by the pyschometricians and take any of the following actions for each individual item: 1) retain item; 2) delete item from the pool; and 3) select items to replace those removed; and 4) revise items (i.e., pre-test items only).
-
The psychometricians executed the changes made and produce the final pool of questions. The final pool of questions is approved by the chairperson and selected members of the committee. Once finalized and approved, the pool of questions is deemed suitable for submission to the computer based testing vendor.
AMCB Committee Description for Examination Process
Examination Committee
The Examination Committee is responsible for the development, final review and approval of the examinations in conjunction with the psychometricians. The committee is comprised of a diverse group of subject matter experts (CMs & CNMs) who represent midwives of different races/ethnicities, genders, practice settings, locations, etc. as much as possible. The committee typically meets 2 to 3 times per year to develop a new version of the examination. They review new questions developed by the Item Writing Committee and select new questions or revised questions for pre-testing. They review the content of each test question and associated statistical properties (i.e., item analysis data). At each meeting, the committee reviews the performance of the examination (i.e., quarterly exam performance reports), and all candidates’ comments about test questions. The committee receives orientation and training by a psychometrician on how to review and validate examinations.
Item Writing Committee
The Item Writing Committee is a diverse group of subject matter experts (CMs & CNMs) who represent midwives of different races/ethnicities, genders, practice settings, locations, etc. as much as possible. The committee is responsible for developing new test questions based on requirements set forth by the Examination Committee based on the Task Analysis. New questions are developed annually. The new items are drafted in an item development software that is password protected. The committee receives orientation and training by a psychometrician on how to develop test questions and how to enter the questions into the item development software. New questions are then passed on to the Examination Committee for review and editing. The approved questions undergo a psychometric review and are entered into the question bank for future use in pre-testing.
Passing Score Committee
The Passing Score Committee is a diverse group of subject matter experts (CMs & CNMs) who represent midwives of different races/ethnicities, genders, practice settings, locations, etc. as much as possible. The committee is responsible for participating on a passing score study on a new base form of the examination. The passing score meeting is facilitated by a psychometrician who provides orientation and training on the passing score methodology. A modified Angoff method is used to establish the proposed passing score for the examination. The modified Angoff method focuses on defining the “examinee with basic competence” and obtaining judgments from subject matter experts regarding the expected performance of such examinees on the test questions comprising an examination (Angoff, 1971). The Passing Score Committee meets once every five (5) years following the development of a new base form examination that conforms to test specifications resulting from the most recent task analysis study.
Task Analysis Committee (aka Research Committee)
The Task Analysis Committee is a diverse group of subject matter experts (CMs & CNMs) who represent midwives of different races/ethnicities, genders, practice settings, locations, etc. as much as possible. The committee is responsible for conducting a task analysis study once every five (5) years. A psychometrician provides consultation and conducts analysis of the data collected for the study. The data resulting from the study are used to develop the test content outline (i.e., major domains of practice and associated tasks) and test specifications for the examination (i.e., the number of test questions by major domain of practice). The test content outline and test specifications are used to develop new forms of the examination.
If you have any questions about AMCB Certification, please contact:
Morgan Saul
Certification Coordinator
Phone: 410-694-9424 ext. 7017