Creating Candidate Assessments with Exam Engine

The Exam Engine in NTRVSTA allows you to create, manage, and customize assessment templates for your organization's interview process.

Overview

NTRVSTA's exam creation system allows you to build customized assessments that can include multiple question types, time limits, and scoring criteria. Whether you're testing technical skills, behavioral competencies, or domain-specific knowledge, our platform provides the flexibility you need.

Method 1: Upload PDF

Using a job description PDF is the quickest way to generate an AI-powered assessment.

1. Select Upload PDF from the input method options.
2. Drag and drop your PDF file into the designated area or click to browse your files.

Note Files must be PDF format, maximum 3MB, and up to 5 pages.

3. Once your file uploads successfully, you'll see additional assessment options.
4. Select Language: Choose which language the assessment will be conducted in.
5. Choose Avatar: Select a specific AI interviewer avatar for this assessment.
6. Whiteboard Design Mode (Optional): Enable this feature to allow candidates to draw diagrams, sketch algorithms, and visualize solutions during the interview. The AI will interpret these drawings and provide feedback.
7. Click Create Assessment to generate your exam.
8. After generation, you can review and edit the AI-created prompt to better suit your specific requirements.

Method 2: Manual Entry

For greater customization, you can create an exam from scratch:

1. Select Manual Entry from the input method options.
2. Enter an assessment title in the required field.
3. Select Language: Choose which language the assessment will be conducted in.
4. Choose Avatar: Select a specific AI interviewer avatar for this assessment.
5. For best results, expand the Advanced Options section to configure detailed parameters:
   • Job Description: Enter detailed information about the position
   • Topics to Cover: Specify key subject areas the assessment should focus on
   • Specific Questions: Add any particular questions you want included
   • Custom Instructions: Provide additional guidance for the AI to follow when generating the assessment
6. Whiteboard Design Mode: Toggle this feature on if you want candidates to have access to drawing capabilities during technical interviews.
7. Click Create Assessment to generate your customized exam. Once generated, you can review and edit the AI-created prompt to better suit your specific requirements.

Getting Started

Accessing the Exam Builder

1. Navigate to Exams in your dashboard
2. Click "Create New Exam"
3. Choose your exam template or start from scratch

Basic Exam Configuration

Exam Details

const examConfig = {
  title: "Senior Frontend Developer Assessment",
  description: "Comprehensive evaluation of React, JavaScript, and system design skills",
  duration: 90, // minutes
  passingScore: 75, // percentage
  maxAttempts: 2
};

Question Types Available

• Multiple Choice - Single or multiple correct answers
• Coding Challenges - Live coding with test cases
• Video Responses - Behavioral and communication assessment
• Whiteboard Sessions - System design and problem-solving
• File Upload - Portfolio or document submission

Exam Structure

Section Organization

Organize your exam into logical sections for better candidate experience:

Example Structure

1. Technical Knowledge (20 minutes)

   • JavaScript fundamentals
   • React concepts
   • Web performance

2. Coding Challenge (45 minutes)

   • Algorithm implementation
   • Code optimization
   • Testing approach

3. System Design (25 minutes)

   • Architecture planning
   • Scalability considerations
   • Technology choices

Question Configuration

Multiple Choice Example

{
  "type": "multiple-choice",
  "question": "Which React hook is used for side effects?",
  "options": [
    "useState",
    "useEffect",
    "useContext",
    "useReducer"
  ],
  "correctAnswer": "useEffect",
  "points": 5,
  "timeLimit": 60
}

Coding Challenge Example

{
  "type": "coding",
  "question": "Implement a function to debounce API calls",
  "language": "javascript",
  "starterCode": "function debounce(func, delay) {\n  // Your implementation here\n}",
  "testCases": [
    {
      "input": "debounce(() => console.log('test'), 300)",
      "expected": "Function should only execute once after 300ms delay"
    }
  ],
  "points": 25,
  "timeLimit": 1800
}

Advanced Features

Adaptive Questioning

Enable adaptive questioning to adjust difficulty based on candidate performance:

const adaptiveConfig = {
  enabled: true,
  difficultyLevels: ['beginner', 'intermediate', 'advanced'],
  adaptationRules: {
    correctAnswerThreshold: 0.8,
    incorrectAnswerThreshold: 0.4
  }
};

Anti-Cheating Measures

Configure security settings to maintain exam integrity:

• Tab Switching Detection - Monitor when candidates leave the exam
• Copy/Paste Restrictions - Prevent external code copying
• Time Tracking - Detailed timing analytics
• Browser Lockdown - Restrict browser functionality during exam

Custom Scoring

Set up weighted scoring for different question types:

const scoringConfig = {
  multipleChoice: { weight: 1, partialCredit: false },
  coding: { weight: 3, partialCredit: true },
  video: { weight: 2, manualReview: true },
  whiteboard: { weight: 2.5, manualReview: true }
};

Best Practices

Question Design

1. Clear Instructions - Provide unambiguous question prompts
2. Realistic Scenarios - Use real-world problems when possible
3. Appropriate Difficulty - Match question difficulty to role requirements
4. Time Allocation - Allow sufficient time for thoughtful responses

Exam Flow

1. Logical Progression - Start with easier questions to build confidence
2. Section Breaks - Provide natural stopping points
3. Progress Indicators - Show candidates their advancement
4. Clear Navigation - Allow movement between questions when appropriate

Accessibility

• Screen Reader Support - Ensure compatibility with assistive technologies
• Keyboard Navigation - Full functionality without mouse
• Font Scaling - Support for visual accessibility needs
• Color Contrast - Meet WCAG guidelines for visibility

Testing Your Exam

Preview Mode

Always test your exam before publishing:

1. Use Preview Mode to experience the candidate journey
2. Check timing for each section
3. Verify question logic and scoring
4. Test on different devices and browsers

Pilot Testing

Run pilot tests with internal team members:

const pilotTest = await client.exams.createPilot({
  examId: 'exam_123',
  participants: ['team@company.com'],
  collectFeedback: true,
  duration: '1 week'
});

Publishing and Distribution

Exam Activation

Once testing is complete, activate your exam:

1. Review all settings and questions
2. Set availability dates and times
3. Configure candidate invitation settings
4. Publish the exam

Integration Options

• Direct Links - Send unique URLs to candidates
• ATS Integration - Embed in your hiring workflow
• API Integration - Programmatic exam assignment
• Bulk Invitations - Mass candidate outreach

Creating effective exams requires balancing comprehensiveness with candidate experience. Focus on questions that truly assess job-relevant skills while maintaining a professional, accessible testing environment.