Skip to main content
Question Types
Justine Rosenblat avatar
Written by Justine Rosenblat
Updated over a year ago

Developing assessments plays a crucial role in evaluating candidates effectively. This article explores the details of scoring and creating questions in the Canditech platform, offering practical insights to help you design assessments that accurately showcase a candidate's abilities.

In this article, we'll look into the two scoring methods Canditech provides: manual and automatic. Additionally, we'll take a close look at the various question types supported by our platform. Whether you're assessing open-text responses, video submissions, multiple-choice knowledge, or technical skills like coding and SQL, our platform is designed to meet your specific needs.



Manual vs. Automatic Question Scoring:

Canditech provides a wide array of question types to accurately assess candidates' skills for any given role. Every question type can be scored; some are scored automatically, while others require a manual evaluation.

Manually Scored Questions are those that are not auto-scored. In other words, a correct answer will not be assigned to the Question automatically upon submission of the candidates’ assessment, and the Question must be graded by the test-reviewer using “star-ratings”. For these Questions, you can choose to assign a score or leave the score at 0. These question types are open-text and video response questions. For more information on reviewing a candidate's assessment, click here.

Automatically Scored Questions, on the other hand, are questions for which a correct answer is pre-defined and automatically checked. When creating these questions, you are required to provide the correct answer, and the scoring is automated. These question types include multiple-choice, Excel, Google Sheet, Code, and SQL questions.

With this article, you'll be better equipped to create assessments that truly reflect a candidate's abilities and make informed hiring decisions.


Let’s walk through each Question type and how they should be built:

Canditech supports a variety of question types in order to comprehensively evaluate candidates’ skills through a variety of exercises.

Every Question type provides you with the following Question Editor to format your Question. Here, you can format your Question text, add links, upload an image, video, or file, etc.


Multiple Choice Questions

Multiple Choice Questions allow candidates to select an answer from a list of choices. Questions must have a minimum of 2 answers.

Create a Multiple Choice Question:

  • Write the question in the Question Editor and input the Question score.

  • Click on the purple plus button to add more possible answers.

  • Select the applicable correct answer by clicking the circle on the left of the answer choice.

  • Advanced Settings:

    • Multiple Select - more than one correct answer.

    • Shuffle Answers - the possible answers of a Multiple Choice Question are shuffled, meaning every candidate will receive them in a different order. If you would like to disable this option, toggle the Shuffle Answers switch.

Multiple choice Questions are automatically scored. The correct answer(s) should be selected for scoring.

This is how the finalized question will appear on the Assessment:


Open Text Questions

Open Text Questions allow candidates to respond in an open-text format.

Create an Open Test Question:

  • Write the question in the Question Editor and input the Question score.

  • Advanced Settings:

    • Character limit - set a limit to the amount of characters a candidate’s response can contain.

Open text Questions can be scored manually. If you would like to score them manually when reviewing a specific candidates’ session, set the score to be greater than 0. Otherwise, you can leave the default score as 0.

This is how the finalized question will appear on the Assessment:


Video Questions

Video Questions allow candidates to give a recorded response to the camera.

Create a Video Question:

  • Write the question in the Question Editor and input the Question score.

  • Advanced Settings:

    • Time limit - set a time limit to the length of the candidate’s video response.

Video Questions can be scored manually. If you would like to score them manually when reviewing a specific candidates’ session, set the score to be greater than 0. Otherwise, you can leave the default score as 0.

This is how the finalized question will appear on the Assessment:


Excel Questions

Excel Questions allow you to upload an Excel file for candidates to download during the test. The candidates will be able to work on the file on their local machine, and then upload their final version.

Create an Excel Question:

  • Write the question in the Question Editor and input the Question score.

  • Upload an Excel file to the question, by clicking the green Upload Excel File button.

    • This is the Excel file that candidates will download and work on during the Assessment.

  • Input answers by specifying the cell (row and column) and its expected value (numbers only).

    Note: only cells in the first sheet of an Excel file (the leftmost in ltr or the rightmost in rtl) can be automatically checked.

  • Pro-tips:

    • It is recommended to assign a unique Case name to each graded cell. This way, when candidates complete the Assessment, you will be able to view the individual Case names associated with their cells and download the candidate's original Excel file.

    • When creating Excel Questions, it is important to provide candidates with a clear and obvious location to record their answers within the spreadsheet. We suggest creating an “answers” area in the leftmost sheet of the Excel file.

Excel Questions are automatically scored. The correct answer(s) should be inputted for scoring.

This is how the finalized question will appear on the Assessment:


Google Sheet Questions

Google Sheet Questions allow you to create an embedded Sheet for candidates to view and make edits to. The candidates will be able to work on the file directly from the Assessment, and their edits will be automatically saved.

Create a Google Sheet Question:

  • Write the question in the Question Editor and input the Question score.

  • Create an embedded Google Sheet, by clicking the green Create Candidate Sheet button.

  • Input answers by specifying the cell (row and column) and its expected value (numbers only). Note: only cells in the first sheet of a Google Sheet (the leftmost) can be automatically checked.

  • Pro-tips:

    • It is recommended to assign a unique Case name to each graded cell. This way, when candidates complete the Assessment, you will be able to view the individual Case names associated with their cells and view the candidate’s original Google Sheet.

    • When creating Google Sheet Questions, it is important to provide candidates with a clear and obvious location to record their answers within the spreadsheet. We suggest creating an “answers” area in the leftmost sheet of the Google Sheet.

Google Sheet Questions are automatically scored. The correct answer(s) should be inputted for scoring.

This is how the finalized question will appear on the Assessment:


Value Questions

Value Questions allow the candidate to record a specific value response for a question.

Create a Value Question:

  • Write the question in the Question Editor and input the Question score.

  • Select the value type (number, text, or percentage).

  • Input the expected value.

Value Questions are automatically scored. The correct answer should be input for scoring.

This is how the finalized question will appear on the Assessment:


File Upload Questions

File Upload Questions allow candidates to upload a file (image, code, etc.) containing their work. For example, the candidate can upload an image of a graph they created, or a coding project they completed locally on their machine.

Create a File Upload Question:

  • Write the question in the Question Editor and input the Question score.

  • Advanced Settings:

    • Select the type of file the candidate should upload from the dropdown. If selecting Image or Code, you will be able to review the uploaded file content on the platform directly. If another file type is selected, you will be required to download the file and review on your computer.

    • If you want the candidate to upload multiple files, choose "other" as the file type. Then, instruct the candidates to compress their files into a "zip" format before uploading them.

File Upload Questions are manually scored. The scoring can be left at 0, or you can choose to assign a specific score to the Question that will be manually applied while grading a specific candidates’ assessment.

This is how the finalized question will appear on the Assessment:


Code Questions

Coding questions allow candidates to implement a function based on provided requirements and run their code in various programming languages. Coding questions tests candidate’s relevant coding skills and levels.

Input the question description and instructions:

  • Provide the candidate with a detailed description of the coding question and problem they will be solving.

  • Once you are finished writing the question description, click Next.

Choose Code Language:

  • Choose at least one of the coding languages that the candidates can choose to solve the coding question.

  • Once selected, click Next.

Input Function Signature:

  • Function name: the name of the function as will appear in the code (the name of the function and the names of the input parameters are provided to the candidate at the top of the code area).

  • Return type: the type of the return value of the function.

  • Parameters: you can add as many parameters as desired. For each parameter, specify its name and type.

  • Click on Next.

Input Test Cases:

  • Example Test Cases - will be available for the candidates during the Assessment.

  • Scored Test Cases - will be available for the hiring team after the Assessment submission, and will be used to calculate the score of the question.

  • Pro-Tip: it’s recommended to input between 2 to 4 Example Test Cases for the candidate and 4-8 test cases for the Scored Test Cases.

Validation:

  • Write your own solution for the problem to validate all the parameters and test cases.

  • Once you are ready, click Create

This is how the finalized question will appear on the Assessment:


SQL Questions

SQL Questions allow candidates to write a query that returns an output based on the tables and question provided.

When creating the first SQL question, you will be required to upload the database tables for the section.

  • Add Section Tables. The tables added will serve as the database for your SQL questions

  • Click Add Table

  • Input the Table Name and upload the file based on the requirements listed.

    • Note the date/datetime format).

  • Click Next

  • Confirm the Columns Settings, and click Add.

  • Upload as many tables as you require (we recommend no more than 3). Once finished uploading Tables, click Done.

  • Input your SQL question text. Click Next.

  • Provide the Expected Output by inserting and running a correct query.

  • Click Next.

  • Confirm Additional Settings:

    • You can choose to round the numeric values of candidate's output to the specific decimal places.

    • You can choose whether or not you'd like to consider row order in scoring

  • Once ready, click Save.

This is how the finalized question will appear on the Assessment:


To learn more about what our assessment platform can do, you can visit our website.

Did this answer your question?