Lesson 2: Creating assessments

Quick overview

Let's take a look at some of the features available when customizing your assessments. You can find more information about assessment configuration here.

The beginning of the infoAssessment.json usually looks like this:

{
    "uuid": "F11AD160-A99D-40AA-AC80-797A9E74ED43",
    "type": "Homework",
    "title": "Introduction",
    "set": "Homework",
    "number": "1",
    "allowAccess": [
    ]

Assessment type

There are two available options:

"type": "Homework"

and

"type": "Exam"

Homework:

Every question added in the infoAssessment.json file will appear in the assessment. By default, the questions will appear in the same order they are entered in the json file. To shuffle the question, add the option:

"shuffleQuestions": true

Students can create new instances of the question with different variables (when questions are randomized). The grading scheme rewards repeated correct answers for the same question.

Exam:

Option to randomly select questions that will appear in the Assessment, out of a list of questions in the infoAssessment.json. Order of questions is randomized. The title of the question is not displayed. For each exam instance, there is only one instance of the question and hence the variables are fixed. Students can retry questions for reduced points. To create "practice exams", where students can generate many instances of the same assessment, use:

"multipleInstance": true

Assessment allowAccess

There are many options to help customizing when and who should have access to your assessment. Take a look at the section Access Control to learn more. Here I will briefly describe the option mode

There are two available options:

"mode": "Public"

and

"mode": "Exam"

Exam is used when students are taking an assessment via CBTF (in-person or the online service starting in the Fall 2020). Public is used for all other cases, where students have access to the assessment via the internet using any device.

Examples:

Before you start creating your assessments, make sure you have at least 4 questions inside your course. If you don't have that yet, copy some from the example course XC 101 as we discussed in the previous lesson.

Configuration 1: "Traditional" homework

  • Use "mode": "Public"
  • Use "type":"Homework"
  • Questions appear in randomized order
  • Homework submitted at the deadline receive 100% credit. Homework submitted up to 4 days late receive 70% credit. Homework submitted at least 2 days before the deadline get 5% bonus.
  • Include two zones: one for easy questions, where each question has "maxPoints": 5 and another one for more advanced questions, with "maxPoints": 3

Configuration 2: Synchronous online exam without proctoring

  • Use "mode": "Public" (not using CBTF)
  • Use "type":"Exam"
  • Use alternatives to select questions out of a pre-defined set. For example:
"questions": [{
    "numberChoose": 1,
    "points": [3,2,1],
    "alternatives": [
        {"id": "FirstAltQ"},
        {"id": "SecondAltQ"}
    ]
}]
  • Choose startDate and endDate to allow for a 1-hour window (this could be your lecture time). In allowAccess, set a time limit of 50 minutes. This gives extra 10-minutes for possible delays.
  • Add a password

Configuration 3: Practice exams

  • Start from Configuration 2
  • Make it a practice exam
  • Disable honor code message
  • You may want to adjust the startDate and endDate to give students more opportunity for practice

Configuration 4: Synchronous exam using CBTF

  • Start from Configuration 2
  • Remove startDate and endDate from allowAccess. Instead use:
{
    "mode": "Exam",
    "examUuid": "5719ebfe-ad20-42b1-b0dc-c47f0f714871",
    "credit": 100
}

You will be able to find the examUuid in the CBTF scheduler app.

Homework 2

Continue creating questions using the elements highlighted in lesson 1. Copy the url link to your question in this [spreadsheet] (https://docs.google.com/spreadsheets/d/1XeY-0o0guRGSFEK2E-pCHhW5qiGyBUFm2uo7e6SuzNM/edit#gid=1763628636). Use the tab for Homework 2. I will take a look at your question and provide feedback.

You can also create one assessment as well. What options do you think will be useful for you in the Fall semester? We can provide feedback! Copy the link in the same spreadsheet.