Career and Technical Education Assessment Information
Student Occupational Competency Testing is required by the Pennsylvnaia Department of Education (PDE), Bureau of Career and Technical Education (BCTE) for all concentrators in approved career and technical education programs in the Commonwealth.
To assist schools in meeting this requirement, the BCTE has developed a number of resources, including A Guide to Student Occupational Competency Testing in Pennsylvania. The guide and other resources are provided to assist school administrators in preparing for the required testing. Developed by the Pennsylvania Department of Education, it is to be used as the resouce that addresses procedures for participating in federal and state mandated occupational competency testing.
|A Guide to Student Occupational Competency Testing|
Pennsylvania utilizes two methods of measuring the occupational competency of career and technical education students. The two methods are assessments from the National Occupational Competency Testing Institute (NOCTI) and the National Institute of Metalworking Skills (NIMS). NOCTI's Job Ready tests are designed to measure an individual's knowledge of basic processes including the identification and use of terminology and tools. Job Ready tests can be used for both secondary and postsecondary education as well as business and industry applications.
Click on the following link for comprehensive information on assessments used in career and technical education in Pennsylvania and the Pennsylvania Skills Certificate: A Guide to Student Occupational Competency Testing (PDF).
Students who successfully meet the state's requirements are awarded a Pennsylvania Skills Certificate. This certificate is an important addition to their portfolios when exiting the secondary career and technical education program.
For more information about career and technical education testing, visit Student Occupational Competency Testing in Pennsylvania.
The Pennsylvania Bureau of Career and Technical Education (BCTE) develops Pennsylvania-specific performance levels and cut scores in conjuntion with the Student Occupational Competency Testing program. The performance levels for career and technical education and of program testing are Basic, Competent, and Advanced. Those students who achieve the Advanced level will achieve a Pennsylvania Skills Certificate.
NOCTI (National Occupational Competency Testing Institute) Job Ready Student Assessments are revised approximately every two years. A new cut score must be developed each time an assessment is revised/updated. This is done using a statistical method called the Nedelsky Method (1954) which is specifically designed for assessments which use multiple choice items. A qualified panel of 12 or more subject matter experts (SME) is assembled using business and industry representatives as well as teachers from across the Commonwealth. Committees are trained on the Nedelsky method in live training sessions and the actual assessment review is done online using the NOCTI Online Criterion Based Cut Scores System. Individual subject matter expert scores are calculated automatically by the NOCTI Online Cut Score System and are sent to Penn State Greater Allegheny and, in turn, to the Pennsylvania Department of Education, Bureau of Career and Technical Education. Cut scores are finalized by the Bureau and released to schools and NOCTI. NOCTI uses these cut scores to generate score reports for each school.
Nedelsky Benchmarking Process Description:
A panel of at least 12 qualified SMEs with clear instructions is used for this process. Each SME is instructed to evaluate each question by crossing out the responses that a minimally competent examinee should be able to eliminate as obviously incorrect. Each question is then given the reciprocal of the number of items/choices not crossed out. The sum of the reciprocals over all items in the assessment is denoted as the probable score of a minimally qualified examinee for a single SME. These values are averaged over all SMEs to arrive at the Competent level. This is the number of items that must be answered correctly on the assessment for the student to be deemed Competent. The Bureau has determined the Advanced level to be two standard errors of measurement above the Competent level. The Basic level is two standard errors of measurement below the Competent level. The cut scores determined through this methodology are used for each assessment until that assessment is revised. Then a new cut score is determined.
Pennsylvania Skills Certificate Scores