Skip to content
ITIC One LMS

Question Library

Vetted questions,
a paper for each candidate.

Write your questions or import them from a spreadsheet, and a second person vets each one. A Paper Plan then gives every candidate their own paper, with the same skills at the same difficulty.

ContactHow an exam is built

  • Organised and vetted

    Questions sit in subjects, skills and categories, and each is vetted by someone who didn’t write it.

  • A paper for each candidate

    Every attempt gets its own paper, drawn to the same Paper Plan as the others.

  • Graded by skill

    Each result scores every skill, so candidates see where they’re strong and where to work.

Subjects, Skills and Categories

Organise questions the way you examine

Your Question Library has three levels: Subjects, the Skills inside each, and the Categories inside each Skill, which hold the questions. Papers are planned and graded by Skill.

  • A short code for each Subject and Skill, such as FIRE and EXT. Every Paper ID starts with its Subject’s.
  • Share a Subject, Skill or Category with one team member or the whole team, to view, add, edit or delete questions in it.
  • Library Readiness: how many approved questions each Skill has at each difficulty, against what your Paper Plans need.

Writing and Bulk Import

Write questions, or import hundreds at once

Write each question with its answer, difficulty, marks and a rationale. Or fill in the Import template, a spreadsheet, and import up to 500 at a time.

  • Single Choice, Multiple Response, True/False, Numeric Entry, Match the Following and Descriptive questions.
  • Partial credit for Multiple Response and Match the Following, and a Marking rubric for Descriptive questions.
  • Bulk Import checks every row first, then adds them all as Drafts, or none if a row is wrong.

Vetting

A second person vets every question

Submit a question for review, and it waits in the Review queue. A Reviewer or Org Admin who didn’t write it approves it, ticking every item of the Quality checklist, or sends it back with a comment.

  • The Quality checklist covers where it’s filed, a clear stem, a correct answer key, fitting difficulty and marks, a rationale and no duplicates.
  • An edit to an approved question is a Proposed version, vetted in its turn, while papers keep the approved one.
  • Past attempts keep the version they were sat with, and Question history records every change.

Paper Plans

Plan the paper once

A Paper Plan sets how many questions each Skill gives, and the mix of Easy, Medium and Hard. It also sets the time allowed and the Pass mark.

  • A Slot for each Skill at each difficulty, worked out from the plan, so nobody counts by hand.
  • A Type mix, if every paper needs an exact number of one question type.
  • A Pre-flight check before papers are made, naming any Slot without enough questions to draw from.

Papers

A different paper for each candidate

Papers are made from the plan, and each attempt takes one at random. Each has the same Skills at the same difficulty, with its own questions.

  • A Paper ID on every paper, such as FIRE-MIX-P01-00042, kept with the attempt.
  • Paper similarity: how much a paper shares, on average, with the plan’s others, checked against a limit you set.
  • A Generation record of every draw, which replays to the same papers.
  • A Reuse limit and a Rest period, so no question is used too often.

Skill scores

A score for every skill

Every question is scored automatically, apart from Descriptive ones, which your team grades against the rubric without seeing whose they are. Each result has a Skill score for every Skill on the paper.

  • The Scorecard: pass or fail against the Pass mark, the score, and each Skill score.
  • The strongest and weakest Skills named, unless every Skill ties.
  • Candidates never see the questions or the answers on it.

FAQ

Good to know

Something else? Write to us.

Can we bring the questions we already have?

Yes. Fill in the Import template, a spreadsheet with a sheet for each question type, and import up to 500 questions at a time. They arrive as Drafts, ready to be vetted.

Who can vet a question?

A Reviewer or an Org Admin who can see its folder. Nobody vets a question they wrote or edited.

Can we edit a question that’s already approved?

Yes. The edit is a Proposed version, which is vetted like a new question. Papers keep using the approved one until then.

Can two candidates get the same paper?

No. Each paper goes to one attempt only. Papers can share some questions, and Paper similarity shows how much.

How many questions does a Paper Plan need?

Enough to fill each Slot several times over: by default, 5 times its count. The Pre-flight check names any Slot that’s short.

Do candidates see the questions after the exam?

No. Their Scorecard shows their result and a score for each Skill, never the questions or the answers.

Platform

More of the platform

Want to run your exams here?

We set up each organisation ourselves. Write to us about yours.

Contact