Revised October 2003
TESCAN (Using Scantron to Score and Obtain Printed/Email Results)
TESCAN (Using Scantron to Obtain Printed/Email Results only)
Using Scantron to Read Raw Data
Appendix 1: TESCAN Scoring Options
Appendix 2: TESCAN Scoring Terminology
University Computing Support Services coordinates the use of several Scantron machines. These machines, located in several buildings on campus, allow faculty to
· score only multiple choice tests (50 question form or 100 question form)
· obtain printed results or email results of scoring and test analysis done by computer (TESCAN)
· read raw data (i.e. surveys) into a data file which can in turn be analyzed by a statistical program such as SAS.
This document includes a FAQ (frequently asked questions), describes the ways to use the machine, and includes appendices which describe the TESCAN scoring options and TESCAN scoring terminology.
Any faculty or staff member can use the machines.
The machines are located in Stephens (SMH) 122, Madison 220, and Wharton 407. The machines are available Monday through Friday 7:00 A.M. to 5:30 P.M. When exams are administered on Saturday, the Stephens Operations staff (SMH 309, 482-6762) is usually available to unlock SMH 122. Faculty can call in advance to make arrangements.
When using the equipment please do not place food or drink by the equipment; spilled drinks and food can ruin equipment.
The advantage to using the machine in Stephens, is that staff in the building can help faculty with the operation of the equipment. During normal office hours, ask Nola Navarre in SMH 146 for assistance. If she is not available, go to the Help Desk, SMH 201.
Students can purchase the forms (50 questions on one side--4.25 inches by 11 inches or 100 questions on one side--8.5 inches by 11 inches) at UL Lafayette Bookstore or Folletts. All students must purchase the same form. The Scantron machine cannot score the 50 question sheets and the 100 question sheets at the same time.
The test must be scored as two separate tests (questions 1-50 and questions 51-100) and the scores manually totalled. If these forms are used to obtain printed or email results, the students must put their student Cajun Card number on both sides of the form.
Insert a form in the right side of the machine, with the marked side toward you and the timing marks (black lines) at the bottom.
The advantage to using score-only is that faculty obtains immediate results.
There are several advantages to using printed/email results:
The disadvantage to using printed/email results is that each sheet must have a student Cajun Card number and a single response for all questions. The machine will not score a test until those criterion are met. If a student does not include the student Cajun Card number the person scoring the test must code the student Cajun Card number onto the form. Faculty will often bring a class roster and good eraser when scoring a test. If a student puts a multiple answer for a question (or an answer and incomplete erasure), the person scoring the test must erase the incomplete erasures. The software does indicate the problem id number field or question number it cannot read. If a student has a number of incomplete erasures, it might take some time to erase all incomplete erasures.
TESCAN (TEet SCanning and ANalysis) is the name of the software program that analyzes data read by the Scantron machine.
No, there are no email programs or web browsers on the computer. The only program on the computer is the program running TESCAN.
When scoring a test, Scantron prints arrows by incorrect responses. If the student answered three questions incorrectly, there should be three arrows on the sheet showing which three questions were answered incorrectly.
Use a number 2 pencil and make no stray marks. Between the ID field and question one there is a field that says that this is the test key. Mark this field. If there is no place marked KEY on the form, go to SMH 146 or SMH 201 for assistance in marking the key.
Welcome to TESCAN, a UL-Lafayette program used for test scoring
and analysis of Scantron(TM) data. TESCAN is supported by
University Computing Support Services; for assistance contact our HelpDesk
at 482-5516 or see http://www.louisiana.edu/InfoTech/UCSS/Docs/tescan.html
Choose one of these options:
(a) score only
(b) score and report
(c) report only
(?) to explain the differences between options a-c
(h) to HALT, then POWER OFF, this computer
(q) to quit, then restart, this program
:
1. Reset the Scantron machine: turn it OFF (if necessary),
then turn it ON while holding down the blue button, until
the yellow LED begins to blink.
2. Release the blue button.
3. Press Enter on the keyboard (or type q to quit program)
Configuring Scantron Machine......Please wait....This will take about 20 seconds
Begin scanning the key sheet, followed by student sheets to be graded.
Press the keyboard Enter key when you have finished scanning sheets:
You will see the menu :
Welcome to TESCAN, a UL-Lafayette program used for test scoring
and analysis of Scantron(TM) data. TESCAN is supported by
University Computing Support Services; for assistance contact our HelpDesk
at 482-5516 or see http://www.louisiana.edu/InfoTech/UCSS/Docs/tescan.html
Choose one of these options:
(a) score only
(b) score and report
(c) report only
(?) to explain the differences between options a-c
(h) to HALT, then POWER OFF, this computer
(q) to quit, then restart, this program
:
Note: During periods of high usage (midterms, finals), you can leave the computer powered on.
Examine the form. Look for stray marks or bent edges. If you do not see any apparent problems with the form, try to submit the form again. If you continue to experience problems, you might have to copy the contents of the form to an new form or score the form by hand.
If the computer is turned on and the monitor is blank, press the <Enter> key to refresh the screen. If the computer is turned off, press the green power on button on the computer case. The monitor should be on. Wait for the Welcome to TESCAN message to appear on the screen.
You will see the menu:
Welcome to TESCAN, a UL-Lafayette program used for test scoring
and analysis of Scantron(TM) data. TESCAN is supported by
University Computing Support Services; for assistance contact our HelpDesk
at 482-5516 or see http://www.louisiana.edu/InfoTech/UCSS/Docs/tescan.html
Choose one of these options:
(a) score only
(b) score and report
(c) report only
(?) to explain the differences between options a-c
(h) to HALT, then POWER OFF, this computer
(q) to quit, then restart, this program
:
Type b and press <Enter>. Always press <Enter> after you issue a command.
You then see the following message:
1. Reset the Scantron machine: turn it OFF (if necessary),
then turn it ON while holding down the blue button, until
the yellow LED begins to blink.
2. Release the blue button.
3. Press Enter on the keyboard (or type q to quit program)
The Scantron machine power on button is in the lower back right corner. Follow the instructions for resetting the Scantron machine. After you press <Enter> you will see the following:
Configuring Scantron Machine......Please wait....This will take about 20 seconds
After the Scantron machine is programmed, then you answer several questions about the test.
(Assume that Mary Smith who teaches English 300 section 7, gave a test on today's date)
Enter instructor name: Mary Smith
Enter department name or number: English
Enter course number: 300
Enter section number: 7
If test date is not today's date enter date as MM/DD/YY:
otherwise simply press the <Enter> key: Your choice
You will receive an instructor's grade report.
Would you ALSO like reports returnable to each student (yes/no):
Pressing the <Enter> key defaults to NO student reports.
Answer yes if you want student reports. Individually prepared student reports list student number, name, and total score. In addition, for each question, the report lists the student's answer and the correct answer. If you do not want student reports, answer no or press <Enter>.
Enter letter of test options desired. Available options are:
a: Option 1, Test statistics
b: Option 2, Test statistics and Item analysis
c: Option 3, Test statistics, Item analysis & correction for guessing
d: Options 1 & 4, Option 4 produces special question analysis data
e: Options 2 & 4
f: Options 3 & 4
g: Options 1 & 5, Option 5 gives question weighing
h: Options 2 & 5
i: Options 3 & 5
j: Options 1 & 4 & 5
k: Options 2 & 4 & 5
l: Options 3 & 4 & 5
Pressing the <Enter> key defaults to Option 2 (which is selection 'b' above)
Scoring options are explained in Appendix 1 Most users press <Enter> to select Option b.
Enter letter of options a-l: Your choice
Enter letter of how the class results are to be sorted:
Available sorts are:
a: class sorted by test score
b: class sorted by student number
c: class sorted by name
Pressing the <Enter> key defaults to sort by name
Enter letter of sort a-c: Your choice
Enter letter describing your report choice:
a) to receive the standard TESCAN printed report
b) to receive the standard TESCAN printed report *AND* have a copy of the student-grade-portion of the TESCAN report electronically mailed to you.
c) to electronically mail the student grades to you; NO report is printed.
Pressing <Enter> defaults to choice (a).
Enter letter of your report choice (a, b, or c): Your choice
If you specify c, then you are prompted for an email address:
Please enter your email address,
for example, nobody@louisiana.edu: Your choice
Enter letter which best describes the type of SCANTRON sheets:
Available sheets are:
a: 50 answers on one side; 4.25 by 11.0 inches
b: 100 answers on one side: 8.5 by 11.0 inches
Pressing <Enter> key defaults to the smaller sheets
Enter letter of sheet type (a or b): Your choice
Please enter exam number: Your choice
If this is the first test of the semester enter 1. If this is the second test enter 2, etc.
You will hear a beep and see the following message:
Please insert key sheet; make sure the place on the form marked KEY is darkened
Make sure the place on the form marked Key is darkened. Fill in the id field of the answer key with any combination of nine numbers; 000000000 is an acceptable id for the answer key.
Insert key sheet. If TESCAN reads the key without error, you will see the following message:
Please begin inserting student answer sheets
Press the BLUE button to indicate finish or to resync after a misfeed
If, instead you see the message Press <Enter> when you are ready to re-read the KEY, TESCAN encountered an error when reading the key. Refer to TESCAN - Common Problems for a list of possible problems and solutions.
When scoring the key and each exam, TESCAN prints the number of correct responses on the form. Check that TESCAN correctly printed the number of items on the answer key.
When TESCAN successfully reads a test, it responds Good Sheet!
If the form does not scan properly, the Scantron machine beeps three times, TESCAN displays what it read and tells where there is a problem with a comment such as ID position 9 or Question #1. Look at the field on the student sheet. Often times there is an incomplete erasure or the ID was coded incorrectly or the ID was omitted altogether.
After you have scored the last test, press the blue button on the Scantron machine to indicate end-of-batch.
xx student sheet(s) have been read so far -- continue reading?
Type y<Enter> if you wish to continue.
Type n<Enter> if you wish to stop and grade the test:
Type n
Notifying pineau.ucs.louisiana.edu [130.70.116.254]
Are there any more tests?:
If you have more exams to grade, answer yes to the question. TESCAN will start over at the point
Enter Instructor Name:
If you answer no to the question, meaning you are finished using the test scoring equipment, TESCAN responds with
Welcome to TESCAN, a UL-Lafayette program used for test scoring
and analysis of Scantron(TM) data. TESCAN is supported by
University Computing Support Services; for assistance contact our HelpDesk
at 482-5516 or see http://www.louisiana.edu/InfoTech/UCSS/Docs/tescan.html
Choose one of these options:
(a) score only
(b) score and report
(c) report only
(?) to explain the differences between options a-c
(h) to HALT, then POWER OFF, this computer
(q) to quit, then restart, this program
:
Type h which automatically shuts down and powers off the computer. Do not turn off the monitor. Turn off the Scantron machine (power button on back lower right corner).
Note: During periods of high usage (midterms, finals), you can leave the computer powered on.
Pick up the reports for the instructor and students and summary statistics in SMH 321. They will be ready in 12 - 24 hours.
l If TESCAN encounters a problem when reading the key, you will see the message Press <Enter> when you are ready to reread the KEY. TESCAN also displays a message immediately preceding this message to help you discern the problem. You will see the message ID position n if the student id field contains errors. You will see the message Question # n if a bad answer key item was found (probably multiple marks for a answer). You will see Bad read of key : Please re-insert key if the key sheet does not contain any answers.
xx student sheet(s) have been read so far -- continue reading?
Type y<Enter> if you wish to continue.
Type n<Enter> if you wish to stop and grade the test:
Type y. Examine the form. Look for stray marks or bent edges. If you do not see any apparent problems with the form, try to submit the form again. If you continue to experience problems, you might have to copy the contents of the form to an new form or score the form by hand.
I want to know how many students answered question xx correctly. Where do I find this information on the TESCAN output?
That information appears in the item analysis (Option 2) as the difficulty level for a question (ratio of the number of correct responses to the number of total responses to a question).
Why does TESCAN want to know my email address?
So it can mail you a copy of grades (which is a subset of the entire TESCAN report). The mail can be saved into a file, then this file can be edited and read into a spreadsheet program such as Excel or Quattro Pro to create/maintain/calculate the grades for the entire class.
I started answering the TESCAN questions and realize that I want to change a response. How can I do that?
If you have already pressed the <Enter> key, TESCAN has recorded that information in its files. You must continue answering questions and then insert the key when told to do so. When the screen says Please begin inserting student answer sheets, press the Blue button (End-of-Batch). The screen will respond:
Student tests have not been entered -- Continue?
Enter y <Enter> if you wish to stop
or enter n <Enter> if you wish to stop
You respond n
There are several lines of messages and then
Are there any more tests?
You answer yes, answer the questions, and grade the exam. You will get output from the test you graded and output from a test with 0 exams graded.
What do the different beeps mean?
One beep means the machine was able to read the form.
Three beeps can mean:
· The student Cajun Card number is not correct. It might be blank or have incomplete erasures.
If the computer is turned on and the monitor is blank, press the <Enter> key to refresh the screen. If the computer is turned off, press the green power on button on the computer case and wait for the Welcome to TESCAN message to appear on the screen.
You will see the menu:
Welcome to TESCAN, a UL-Lafayette program used for test scoring
and analysis of Scantron(TM) data. TESCAN is supported by
University Computing Support Services; for assistance contact our HelpDesk
at 482-5516 or see http://www.louisiana.edu/InfoTech/UCSS/Docs/tescan.html
Choose one of these options:
(a) score only
(b) score and report
(c) report only
(?) to explain the differences between options a-c
(h) to HALT, then POWER OFF, this computer
(q) to quit, then restart, this program
:
Type c and press <Enter>. Always press <Enter> after you issue a command.
Use this option when you want to transmit the data (but have no scores printed on exams) and obtain printed/email results. Use this option with caution, even if you will not return the tests to the students, it can be helpful to see the printed results on the key and the student sheets. For example, if a test has 50 questions and the score on the key is 49 then you know that there is a problem with the key.
The instructions for this section are identical to the instructions TESCAN (Using Scantron to Score and Obtain Printed/Email Results).
You code information on Scantron forms, have Scantron read the information into a file on a formatted floppy disk, and then upload the floppy file to UCS to analyze the data. You can analyze the data using SAS or SPSS.
If the computer is turned on and the monitor is blank, press the <Enter> key to refresh the screen. If the computer is turned off, press the green power on button on the computer case. The monitor should be on. Wait for the Welcome to TESCAN message to appear on the screen.
Welcome to TESCAN, a UL-Lafayette program used for test scoring
and analysis of Scantron(TM) data. TESCAN is supported by
University Computing Support Services; for assistance contact our HelpDesk
at 482-5516 or see http://www.louisiana.edu/InfoTech/UCSS/Docs/tescan.html
Choose one of these options:
(a) score only
(b) score and report
(c) report only
(?) to explain the differences between options a-c
(h) to HALT, then POWER OFF, this computer
(q) to quit, then restart, this program
:
Type e (for Extra Utilities) and press <Enter>. Always press <Enter> after you issue a command.
You then see the following message:
1. Reset the Scantron machine: turn it OFF (if necessary),
then turn it ON while holding down the blue button, until
the yellow LED begins to blink.
2. Release the blue button.
3. Press Enter on the keyboard (or type q to quit program)
The Scantron machine power on button is in the lower back right corner. Follow the instructions for resetting the Scantron machine. After you press <Enter> you will see the following:
Configuring Scantron Machine......Please wait....This will take about 20 seconds
You will then see the following menu:
Extra Utilities: Choose one:
(a) scan
(b) scan_raw
(c) scan_2_cols
(d) scan_and_decompress
(e) decompress_scan_data
(f) demand_decompress
(g) seiscan
(m) to MOUNT a floppy disk
(u) to UNMOUNT a floppy disk
(Q) to quit
:
Insert the formatted floppy disk into the disk drive and press m.
The computer lists any files on the floppy and then you will see the following menu:
Extra Utilities: Choose one:
(a) scan
(b) scan_raw
(c) scan_2_cols
(d) scan_and_decompress
(e) decompress_scan_data
(f) demand_decompress
(g) seiscan
(m) to MOUNT a floppy disk
(u) to UNMOUNT a floppy disk
(Q) to quit
:
Type a.
Please enter a filename in which the data will be stored:
The filename must start with /floppy/filename. Enter a filename such as /floppy/survey.dat
You will hear a beep and see the following message:
insert student answer sheet
You scan the form and the computer responds:
good sheet!
insert student answer sheet
There is no error checking, all sheets scan as good sheet!
When finished scanning sheets, press the blue button on the Scantron machine. You will see the following:
END OF INPUT!
xx records were written to filename
Are there any more forms?:
If you respond y, you will enter the filename and then scan the forms as above. If you respond n, you will see the Extra utilities menu:
Extra Utilities: Choose one:
(a) scan
(b) scan_raw
(c) scan_2_cols
(d) scan_and_decompress
(e) decompress_scan_data
(f) demand_decompress
(g) seiscan
(m) to MOUNT a floppy disk
(u) to UNMOUNT a floppy disk
(Q) to quit
:
Type u to unmount the floppy disk.
You will see:
NOW SAFE TO EJECT FLOPPY DISK:
Eject the floppy disk.
You will also see:
Extra Utilities: Choose one:
(a) scan
(b) scan_raw
(c) scan_2_cols
(d) scan_and_decompress
(e) decompress_scan_data
(f) demand_decompress
(g) seiscan
(m) to MOUNT a floppy disk
(u) to UNMOUNT a floppy disk
(Q) to quit
:
Press Q and then you will see:
Welcome to TESCAN, a UL-Lafayette program used for test scoring
and analysis of Scantron(TM) data. TESCAN is supported by
University Computing Support Services; for assistance contact our HelpDesk
at 482-5516 or see http://www.louisiana.edu/InfoTech/UCSS/Docs/tescan.html
Choose one of these options:
(a) score only
(b) score and report
(c) report only
(?) to explain the differences between options a-c
(h) to HALT, then POWER OFF, this computer
(q) to quit, then restart, this program
:
Press h and also turn off the Scantron machine.
Note: During periods of high usage (midterms, finals), you can leave the computer powered on.
There is no error checking when data is read. Therefore the forms should be as 'clean' as possible:
No stray marks
Number 2 pencil only (no markers or ink pens)
Any erasures must be complete
The first step in analyzing the data should be checking for valid responses (i.e. if survey responses are 1 to 4 then accept as valid only 1, 2, 3, or 4). Blanks will be coded as 'b'; therefore you should have a way of indicating that a b is a missing value.
There are five grading and analysis options available from TESCAN. The first option outlines the usual grading procedure and describes the basic analysis data computed by TESCAN. The other four options allow for variation in the grading procedure and/or give more technical analysis of data along with the basic data provided by Option One.
Grading procedure: Individual student scores, expressed as percentages; Stanine score given along with the number of correct answers, the number of incorrect answers, and the number of questions the student did not answer.
Analysis of Data:
Grading Procedure: Grading procedure is the same as that of Option One.
Analysis of Data:
a. mean
b. median
c. mode
d. standard deviation
e. standard error of the mean
f. standard error of measurement
g. variance
a. option response frequency distribution
b. difficulty level
c. discriminating power
Grading Procedure: Option Three uses a "corrected for guessing" grading procedure for all or part of the test. When using "corrected for guessing" for only part of the test, score the rest of the test by adding one point for each correct answer and zero points for each wrong answer. On a SCANTRON form, the teacher specifies how many possible responses exist for each question. The teacher should only mark the questions that need correction. TESCAN uses the following formula to compute the final score.
S = R - W/(N -1)
where S is corrected score, R is number right. W is number wrong, and N is number of responses.
Analysis of Data: All analysis data available under Options One and Two.
Grading Procedure: This option deals only with analysis data. It may be chosen along with Option One, Two, or Three.
Analysis of Data: Option Four produces analysis of data on special sets of questions. TESCAN analyzes these sets for the number of missed questions. On a SCANTRON form, the instructor specifies which questions to analyze by marking one of the response fields for that question. If you do not want analysis for a question, leave the response fields blank.
Grading Procedure: Teachers assign the question values used for scoring by completing a SCANTRON form with a value for each question (one to five points).
Analysis of Data: This option must be chosen along with Option One, Option Two, or Option Three.
Difficulty Level
The ratio of the number of correct responses to the number of total responses for an item. Values range from zero to one. Difficult items have values close to zero and easy items have values close to one.
Discriminating Power
The ratio of the number of correct responses to an item by the upper 27% of the distribution minus the number of correct responses by the lower 27% of the distribution to one-half of the total number of individuals in the upper 27% and lower 27% of the distribution. You get a positive item discrimination when more students with the highest overall scores answer the item correctly than the students with the lowest overall scores.
Kuder-Richardson Reliability Coefficient
Shows the consistency of measure expected from general administrations of the same test. Values approaching one show increasing reliability. For teacher made tests, values which exceed 0.35 show some level of reliability.
Mean
The arithmetic average.
Median
The score or number which divides the scores into two equal parts.
Mode
The score occurring most frequently.
Range
The point spread between the highest and the lowest score.
Standard Deviation
Shows the extent of heterogeneity of the group tested. The greater the standard deviation, the wider the distribution of scores will be. The standard deviation is the squared distance from each score to the mean.
Standard Error of Measurement
Used in determining the significance between different scores. There is a 2/3 probability that a student's TRUE score is within the obtained score plus or minus the standard error of measurement.
Stanine Score
A normalized score on a nine-point one digit scale in which the successive score values represent intervals of one-half of a standardized deviation with the middle interval set at five, and in which the proportion of examinees at each score is the proportion of the normal curve corresponding to the interval.
Variance
The difference between scores in a distribution.