Purdue University
School of Civil Engineering
How I "Design" Tests
by Jon D. Fricker
Updated 5 October 2004
Dear Student:
In most cases, the Test will be OPEN BOOK and OPEN NOTES.
I begin by reviewing all the material that has been made available to you
(see "Source Materials" below)
for the specified portion of the course.
During this review, I generate approximately 20 questions.
From this group of questions,
I select the six (or so) questions that have
the best overall quality,
as I perceive it.
The questions should be consistent with the objectives for each lesson.
Another important criterion to me is the variety of questions,
with respect to "Source Materials", "Format", and "Degree of Difficulty".
In the list below, I give some details as to my
"building blocks of a test".
-
Source Materials for Test Questions
-
Assigned reading.
Your reading assignments in the textbook and the Course Notes have been kept to a minimum,
and I expect you to have have done them.
Just because I don't mention something in the reading explicitly during class,
that doesn't mean it is unimportant.
If I thought something in the reading needed amplification or clarification,
I would have included it in a lecture.
If you thought something in the reading needed clarification,
you should have asked me, preferably in class.
Given these reasonable assumptions,
anything in the reading can be used as a basis for a test question.
-
Classes.
As mentioned above, class time may be devoted to amplifying or clarifying material
in the assigned reading.
However, class time may be spent on a "parallel approach" to the same topic(s),
rather than reading the reading assignment to you.
Class discussions may be significant enough to form the basis for a test question,
so come to class and pay attention.
(Footnote: In general, I do not take formal attendance,
but I reserve the right to give unannounced quizzes on the reading assignment for that
class, for which students with unexcused absences receive a score of 0.
I also notice when students are not present to receive graded HW when it is being returned.
Unexcused absences do not help the "participation" component of your grade.)
-
Homework and Project Assignments.
I may use the solution to (or an intermediate step in) a written assignment
as the starting point for a test question,
so bring your HW and Project papers to the Test.
If the Project was done as part of a group,
be sure to make a copy of it for your own use during the Test.
No assignments may be shared during the Test.
If you forget to bring a HW assignment that is used on the Test,
you will have to begin the problem "from scratch".
Likewise, if you have failed to pick up graded homework,
I will try to remember to bring the graded HW to the Test,
but it is entirely your responsibility to see that it is in your possession
at Test time.
-
Supplemental Notes and Handouts.
These often contain figures, tables, or charts that assist in the solution of a problem.
These may not be shared among students.
-
Format of individual questions on the Test.
-
Calculations.
In these problems, you are expected to identify the equation(s) used
-- usually by number in the text or location in the SNotes, etc.
You are also expected to give brief explanations for your calculations, as appropriate.
-
Word answers.
Almost always, brief answers are adequate.
I am usually looking for evidence that you have become proficient with the key concepts involved in the problem.
If you find yourself writing a lot in hopes that something "in there" may be right,
you and I will both know that you are uncertain about your answer.
-
Matching, fill-in-the-blank, True/False, etc.
Graders like these problems best.
However, matching problems do not appear on every test,
because the subject matter has to be appropriate and
I have to be able to create matchings that are plausible.
If Fill-in-the-blank and True/False questions require some elaboration
in support of your answer, you will be asked for it.
-
Degree of Difficulty.
Each test question is likely to fall into one of three levels of difficulty.
-
Basic level.
If you have been paying attention and/or taking effective notes,
you should be able to retrieve the answer to "basic level" questions
without much difficulty.
In fact, you may not even need to consult your notes to answer these questions.
-
Intermediate.
Your opportunity to show that you can solve a routine problem using the resources made
available to you in this course.
-
Advanced.
One way to test your understanding of a concept is to present a
variation on a problem that was covered in class or in an assignment,
but which still uses the principles or skills made available to you in the course.
These questions permit the more capable student to demonstrate his/her abilities.
Suggestions on Test Strategy.
-
If the Test is Open Book and Open Notes,
you ought to make sure you bring all the materials you need.
You will not be permitted to borrow anything during the Test.
So make a checklist, create a pile of Test materials where you live,
or do anything that will keep you from forgetting something.
-
Normally, the test questions will be ordered in the sequence in which the topics were
covered in the course.
They are not ordered by degree of difficulty!
The normal sequence may be altered if the questions can be made to fit on fewer pages.
-
All questions will be worth about the same number of points,
regardless of difficulty.
Perhaps you should scan the entire test first, then decide which problems to
attempt first.
-
Typically, a test with six questions is barely enough to give some coverage to
each of the major topics being tested.
You may find it difficult to complete the test in the allotted time,
so decide which questions to attempt first,
then proceed without delay.
If I made the test short enough for everyone to finish in the time allotted,
I would have to choose which major topics to leave out.
I prefer to cover all major topics, then let you decide which problems to do first.
-
If you write out an answer, then change your mind, just cross it out --
don't erase or obliterate it -- before beginning another attempt.
If the grader can see that your abandoned attempt had some correct elements,
you will receive half credit for them,
if that score would be better than the score for your final attempt.
