- Use of Exams Are "exams" a component of your students' course grade? What percentage of the overall grade are from exams? What is the format of your main exams? Would you characterize these exams as mostly multiple choice, short answer, longer answer questions, or some mixture?
- Are these in-class exams or take-home exams?
What time restrictions do you place on the exams?
How many students do you expect to finish in the time allotted?
- Why do you use exams? Do you feel exams are an important reflection of students' abilities?
- Do you take any safeguards to try to minimize student cheating? Please describe the concern and how you respond (e.g., seating arrangements, multiple versions of exams).
Exams are usually 30-40% of the overall course grade. I give in-class exams, the questions are mostly open-ended/short-answer. I let students go about 10 minutes after the class ends but no longer. However, if there is a foreign student who has language problems, I may give them the test in my office and allow more time. I announce this option for all students. I use exams to motivate the students to study and keep up to date. I see them as a way to facilitate student learning. I do get some useful information from them about what difficulties students may be having. Cheating hasn't been a problem. I do walk around the room periodically and keep my eye on students (e.g., don't sit and read while they are being tested.
- External Aids Do you allow students to use any external reference aids on exams? (For example, open book, open notes, student supplied note pages or formulas, instructor supplied note pages.)
- For instructor supplied aids, please describe. For any student supplied aids, what restrictions do you enforce? (For example, number of pages, content such as not allowing worked out examples, authorship such as personally generated vs. photocopied.)
It depends on the class. I NEVER have students memorize formulas or definitions. Sometimes they are allowed to bring one page of notes, sometimes they can use study questions that are used to guide their reading of the textbook. Knowing they can use these study questions on tests motivates students to answer them, which helps draw their attention to the important ideas in the textbook. The only restrictions are either page length (one page both sides, standard paper size) or type (study question sheets I've passed out).
- Use of Technology
Do you allow/encourage students to use any technology on exams? If so, what type (computer, calculator) and what restrictions do you put on their use? Do you include any additional safeguards against cheating based on the technology? Does the technology used on exams correspond to the technology used on homework or in class?
I try to have students complete some questions using computer software. They may use a calculator but usually don't need it.
-
Constructing Exams
In constructing exam questions, do you focus on the content and construct a realistic setting for the questions or do you start with a real problem and try to match the course content? In other words, how much do you strive to use real data as opposed to hypothetical or realistic data in the exam questions?
- In constructing the exam, how do you decide how many points a question should be worth? What percentage of the points on the exam would you say are for primarily conceptual knowledge/interpretation vs. calculation/mechanics?
I usually think of an idea or skill to assess, and then look for good items or data sets to use. I don't always use real data sets, but I try to provide contexts for any phony data sets. I try to have each piece of information worth a point. A question with many parts and answers is worth more points.
- Exam Writing Process
Describe the PROCESS that you use to write an exam from scratch. For example, how do you get started? What steps do you go through? Do you
have another instructor review your questions? How do you decide if the exam is reasonable timewise? Also, after you have given an exam, how do
you decide for yourself if it was a good exam?
In creating a test, I think about the content that the exam is to
cover, and decide what are some key concepts and competencies I want to
assess. I think of things that students may misunderstand that I think
are important, so that I may see if any one is misunderstanding the
material.
I try to have a balance of items that assess basic literacy as well as
challenging items that require students to reason about data or concepts
and explain their reasoning. I never try to include "everything" studied
in a unit but try to sample from each general topic area covered on the
exam. If there's time I ask my TA to review the exam and check it for
clarity and any typos. I usually have a pretty good sense of time, and
try to keep the exams brief, realizing for every minute it takes me to
solve a problem it will take the students about 10! Therefore, I do
"take" the exam myself, writing down the correct answers, before I give
it. I have also discovered many errors this way!
I know it's a good exam if the students do not misunderstand the
questions (as evidenced by questions in class as well as responses on
the questions) and if I get a negatively skewed distribution with most
students doing well, and at least some students getting all answers
correct. (My students are graduate students who study and try to succeed
in this class.) My goal is for all students to master the material and I
design the test to help me determine if this has happened.
- Exam Grading
In grading the exam, do you use an analytic or a holistic scoring scheme (assigning points for individual steps or overall "level" of solution)? Do students start at 0 points and earn points for correct statements or do they start at 100% and lose points for mistakes? Do you give partial credit for answers and if so, how do you assign partial credit? Do you have an expected "average" score on the exam for each class? Do you "curve" exam scores?
- Do you use a straight total or percentage correct to be added to other points in the course to contribute towards a total grade, or do you give a grade to each exam?
- In assigning course grades, do you "curve" student scores? Based on what mechanisms?
I start at 0 and add points earned. I don't curve exams. Students accumulate points in the course for HW, projects, tests, etc., and then the course grade is based on percentage of total points earned in the course. It's a mastery system.
-
Preparing Students
for the Exam How much class time do you spend reviewing for an exam? Do you offer out-of-class review sessions? Do you supply review sheets and/or review problems? Is student participation in such review experiences mandatory or optional?
I like to have students tell me what they have learned in the unit, as a review. For example, I'll ask them: tell me everything you know about bivariate data. Then they tell me what they know and we talk about the different concepts and skills. If there's something missing, I try to give hints so they will think of it. I review during part of the class session before an exam. Sometimes I bring a sample exam to class and students work on that together and we discuss questions they have.
- Post-Exam Feedback
How much class time do you spend going over the exam afterwards? What do you discuss (e.g., the entire exam, the most difficult problems, how the exam was scored)? How specifically do you discuss student responses to exam questions after they have been returned? What information do you convey to students about score distributions? Do you give them access to an exam key? What other types of feedback do you give them about their exam performance? (Do you write comments on the exams, correct their mistakes, or just indicate points? Do you consider students as losing points for mistakes or as gaining points with correct answers?)
I write comments on the exams and take off points where things are wrong or missing. I sometimes go over the whole exam quickly, but if everyone did well I just talk about the main items people missed. I encourage students to come see me to discuss questions they have about answers and grading. Sometimes if students did very poorly I'll give the whole class a chance to correct errors they made, by writing up each missed problem that they did wrong, and how to do it right. This is before telling them the answers!