Assessment Blueprint Architecture

The Assessment Blueprint is the critical translation layer that sits between the AI-generated Competency Blueprint and the final candidate evaluation. It defines exactly how a competency will be measured, mapping abstract skills into concrete test structures.

How Competencies Transform into Assessments

Once ORIEN generates the Competency Blueprint (which defines what to measure), the Assessment Engine translates it into the Assessment Blueprint (which defines how to measure it).

1. Mapping: Each competency is mapped to one or more appropriate assessment formats (e.g., a "System Design" competency might map to a Case Study, while "React Proficiency" maps to a Coding Challenge or MCQ).
2. Weighting: The blueprint calculates the relative weight of each question or section based on the priority of the underlying competency.
3. Delivery Generation: It constructs the final JSON payload containing the actual assessment questions, which is then rendered by the Candidate Portal UI.

Assessment Content Generation (Who puts the content there?)

The assessment content is primarily generated autonomously, but remains entirely flexible:

1. AI Autonomous Generation: The AI Engine (Claude) dynamically generates the actual questions, test cases, and situational scenarios based on the context of the company and the specific competency requirements.
2. Human Override (Recruiter/Hiring Manager): The generated Assessment Blueprint is presented to the hiring team in the Assessment Studio UI. Here, they can review, edit, replace, or manually add their own custom questions before publishing.
3. Content Banks: Organizations can also link their own internal question banks, which the AI will prioritize pulling from before generating net-new questions.

Available Assessment Formats

The Assessment Blueprint supports a wide range of flexible evaluation formats, including:

• Multiple Choice Questions (MCQ): For rapid knowledge verification.
• Coding Challenges: IDE-based algorithmic or framework-specific tests with automated test cases.
• Situational Judgment Tests (SJT): Scenario-based questions evaluating behavioral and cultural alignment.
• Case Studies & Take-Home Assignments: Long-form text or file upload evaluations.
• Structured Video Interviews: Asynchronous video responses to AI-generated prompts.
• AI Chat Simulations: Interactive role-play scenarios with an AI agent (e.g., simulating a sales call or a code review).

Time Limits: Dynamic vs. Static

Time limits within the Assessment Blueprint are highly flexible:

• Dynamic Time Calculation: By default, the AI calculates an estimated completion time for each generated module (e.g., 2 mins per MCQ, 30 mins for a Coding Challenge) and assigns a dynamic global time limit for the entire assessment.
• Static Overrides: Hiring managers can override this and enforce strict static time limits (e.g., "The entire test must be completed in exactly 60 minutes").
• Section-Level Timing: Time limits can be applied globally to the whole assessment, or specifically to individual sections (e.g., 15 minutes for the behavioral section, regardless of how fast they finish the coding section).

Blueprint Flexibility

The Assessment Blueprint is designed to be highly adaptable:

• Modularity: Sections can be dragged, dropped, reordered, or deleted entirely within the Assessment Studio.
• Adaptive Difficulty: Future iterations of the blueprint will support real-time adaptive difficulty, altering subsequent questions based on the candidate's performance in earlier sections.
• Version Control: Once an assessment is published and taken by a candidate, that blueprint version is locked. If the hiring manager edits the blueprint later, a new version v2 is created to ensure candidate scoring consistency remains intact for older applicants.