Public Sector Practice Exchange
by Ilene Gast, Associate Editor
This column highlights innovative public sector programs at the Federal, state, and local level. If you are conducting a project that would interest the ACN readers, or if you know someone who is, please let me hear from you. I can be reached by phone at (202) 305-0590, by fax at (202) 514-4200, or electronic mail at IFGAST@AOL.COM.
In the last edition of the ACN, Nicholas Vasilopoulos, a Personnel Research Psychologist with the Immigration and Naturalization Service (INS), described the Fast Stream Assessment developed by the British Civil Service's Recruitment and Assessment Services (RAS). The Fast Stream Assessment Process identifies individuals who can work effectively in an intellectually demanding environment. In this edition, Nick describes how the British Government is adapting the program to make it more cost-effective.
THE FAST STREAM JOB PREVIEW: INCREASING THE COST-EFFECTIVENESS OF THE FAST STREAM ASSESSMENT PROCESS
by Nicholas Vasilopoulos
Although the Fast Stream Assessment Process has proven to be beneficial, its administration requires considerable resources. Recruitment and Assessment Services (RAS) administers the assessments to approximately 8,000 candidates who apply for 250 Fast Stream positions. In an attempt to reduce the number of applicants to the Fast Stream, RAS is developing a realistic job preview. The new Fast Stream Job Preview will enable potential candidates to determine, in advance, whether their needs and abilities mesh with the requirements of the Fast Stream position.
To obtain the information needed to develop the Fast Stream Job Preview, RAS staff are interviewing university students interested in the Fast Stream and incumbent Fast Streamers. From the interviews with university students, RAS staff hopes to learn more about (a) the abilities students think they need to succeed in a Fast Stream position; and (b) the types of information students use when deciding whether to apply for the Fast Stream. The interviews with Fast Streamers will identify the actual requirements of the Fast Stream position. Based on the information collected in both types of interviews, RAS staff will develop a realistic job preview that will present accurate information about specific duties and requirements of the Fast Stream position. The Fast Stream Job Preview will also address common concerns considered by potential candidates when deciding whether to apply.
In addition to the Fast Stream Job Preview, potential applicants will receive a self-administered questionnaire. The questionnaire will provide a list of activities that Fast Streamers must perform in order to be successful. Potential applicants will be asked to rate their degree of comfort with each of these activities. After completing the questionnaire, candidates may score their own responses using an enclosed scoring key (currently under construction). The RAS also plans to include a guide that potential candidates may use to interpret their scores. In this way, potential candidates can receive feedback about the extent to which they are suited for a Fast Stream appointment before they complete the application process.
For more information call Nicholas Vasilopoulos at (202) 305-0596.
INS PREPARES THINKING SKILLS "BLUEPRINT"
For the past 10 years, tests of logic-based reasoning have been used in place of reading comprehension tests to select Federal employees. Preparation of logic-based examinations combines elements of logic and essentials of item writing. In 1989, the U.S. Office of Personnel Management prepared a taxonomy, based on principles of deductive reasoning, to guide item writers in the preparation of logic-based test items. The staff of the Research and Development Branch, HRD, at the Immigration and Naturalization Service (INS) has recently revised and expanded the taxonomy to include inductive reasoning.
The newly developed taxonomy of job-related thinking skills, the Blueprint of Job-Related Foundational Thinking Skills, contains 129 valid forms for deductive reasoning and 97 valid forms for inductive reasoning. The inclusion of the inductive forms represents a "first" in measurement for selection. Inductive reasoning involves reasoning with incomplete information and drawing probabilistic conclusions. It is essential for good decision making. Inductive reasoning is particularly relevant for the mission-critical jobs at INS, where, for example, Border Patrol agents must make on-the-spot decisions, frequently in the absence of complete information and under life-threatening circumstances.
The new taxonomy also contains 93 forms for deductive illogical biases and 45 forms for inductive illogical biases. Illogical biases are fallacies of reasoning that people are especially prone to commit. These biases can be used as incorrect response choices to provide a stringent test of reasoning and very fine discrimination on reasoning/decision-making abilities among job candidates
In view of the primary importance of thinking skills for every job in the economy, including higher-level decision-making managerial/executive jobs, use of the new taxonomy for the design and construction of test questions should result in large increases in productivity dollars and overall economic utility.
The Research and Development Branch of INS is making plans for publishing its Blueprint of Job-Related Foundational Thinking Skills. Once published, the Blueprint will be available for general distribution. For more information about logic-based testing and the Blueprint, call Mary Anne Nester at (202) 305-0606 or Susan Reilly at (202) 305-4761.
© Copyright 1996 by the IPMA Assessment Council. All rights reserved.