This article provides a quick explanation on how to update and approve grades for closed questions in online exams or exams scrambled in the Tomasafe system 

For details on checking irregular markings in scrambled printed exams  click here

General Explanation:

Since for closed questions the system "knows" what the score for each question is and what the correct answer is, it performs the grading automatically based on the student's markings.

If the exam consists only of closed questions, all exam booklets will appear with the status "Checked" with the final grade for each examinee.

In fact, if the exam consists only of closed questions, there is no need to enter the exam checking screen at all. As graders, all we need to do is perform quality control on the exam we created by reviewing the various statistics, identify irregularities if any exist, and make changes and adjustments as needed.

If the exam also includes open questions, you must first enter the exam checking screen and complete checking the open questions by giving a manual grade, and then perform the actions described in this document.

Control, Check, and Modification Options:

A. Control and Analysis:

In the "Reports" tab, you can view various statistics about the exam, including drilling down to question-level details (such as the report called "Closed Questions" where clicking on each question column displays the statistics for the selected question):

Hovering over the eye button displays a preview of the question and what the correct answer we defined is:

The reports will provide us with various metrics. For metrics that we thought needed clarification or additional explanation, an "i" icon will appear next to them; hovering over it with the mouse will display the relevant details or clarification:

In the "Detailed Analysis" report, we also get a verbal item analysis where the system will alert and detail irregularities worth paying attention to:

B. Changing Correct Answers, Factors and Updates:

After reviewing the reports, you can make changes in the "Grades and Factor" tab:

In this tab you can:

• View general statistics (in the top row)
• View the answer distribution for each question, and when hovering over a specific answer, the relevant data will appear:
• View a preview of the entire exam by clicking "Preview Master Form" at the bottom of the screen:
• Change the correct answer by clicking on the pencil icon that appears under the "Correct response" heading:
  
  • Add an answer by marking an additional answer:
    - If it's a closed question containing only one correct answer, the screen will look like this:
    - If it's a closed question containing more than one correct answer, the screen will look like this ("All or Nothing" question type):
    - If it's a closed question containing more than one correct answer with limited answers defined, the screen will look like this ("All or Nothing" question type):
    * Please note the warning displayed if you exceed/fall short of the number of correct answers defined when creating the exam.
    
    - If it's a closed question containing more than one correct answer, the screen will look like this ("Custom Points" question type):
    - If it's a closed question containing more than one correct answer with limited answers defined, the screen will look like this ("Custom Points" question type):
    * Please note the warning displayed if you exceed/fall short of the number of correct answers defined when creating the exam, and that the score will total 100%. Also, for "Custom Points" questions, you must first enter the score in the box next to each answer, and then the answer will be marked with a checkmark. Additionally, to remove the mark from this answer, you must enter a score of 0 in the box.
    
    
    

• Change an answer by marking a different answer and removing the original mark (relevant for regular closed questions + closed questions with multiple answers of "All or Nothing" type).
• Add a partially correct answer (update partial score for additional answers) (relevant for regular closed questions)

After making adjustments, to save the changes and see their actual impact, click "Approve" at the bottom of the screen:

After the update, you can see the impact of the changes in the statistics and reports.

• Cancel a question by clicking the trash can icon next to it:
• Document and cancel changes: Every change we make is documented at the top of the table and can be canceled by clicking the trash can icon:
• Apply a factor to the exam. Click "Add" and the "Select Factor Type" button will appear. Clicking the button allows you to choose the desired factor type from a variety of factors:

A detailed explanation of the factors can be found here and here

After making the required changes, you can perform Finish Checking for the exam

For a detailed explanation of the Reports tab click here