A flexible and secure platform designed to streamline the standard-setting process for assessments, ensuring alignment with evidence-based standards and facilitating accurate cut score determination.
Vendor
ExamRoom.AI
Company Website
This software provides a comprehensive, end-to-end solution for scoring, marking, and standard setting in assessments. It enables organizations to ensure their evaluations align with credible, evidence-based standards through a flexible and secure process. The platform supports every step from initial workflow design to final data reporting and cut score recommendations. It offers robust tools for configuring sessions, tracking progress across panels in real-time, and automating documentation to ensure compliance and audit readiness. Designed with accessibility in mind, it ensures inclusive participation for all panelists through WCAG-compliant interfaces, keyboard navigation, screen reader support, and remote access. The system integrates seamlessly with existing item banks and provides powerful, real-time reporting and analytics to support informed decision-making, while maintaining high standards of content security and compliance.
Features & Benefits
- Workflow Management
- Provides an end-to-end workflow supporting every phase of standard setting, from initial setup to final cut score recommendations.
- Configure sessions quickly with pre-built templates
- Track progress in real-time across panels
- Automate documentation for compliance and audit readiness
- Accessibility & Inclusive Participation
- Designed with accessibility in mind to ensure all panelists can participate effectively.
- WCAG-compliant interfaces
- Keyboard navigation and screen reader support
- Remote access for participants with mobility needs
- Seamless Item Bank Integration
- Effortlessly manages and syncs assessment items with existing systems.
- Compatibility with all major item banks
- Secure item syncing with version control
- Advanced tagging by metadata, subject, or difficulty
- Smart integrations including Zapier, Webhooks, LTI, QTI, IB, and LMS platforms
- Powerful, Real-Time Reporting
- Delivers actionable data and analytics to support informed decision-making.
- Instant panelist feedback and scoring analytics
- Exportable summary reports for stakeholders
- Visual dashboards for quick interpretation
- Structured Review Panel Experience
- Supports expert-driven reviews with controlled access and interactive tools.
- Role-based access to review content
- Real-time commenting and annotation
- Voting and scoring features built into the UI
- Standard Setting Panel Support
- Facilitates the seamless conduct of Angoff and Modified Angoff methods.
- Custom panelist workflows
- Score range calibration tools
- Moderator controls for session facilitation
- Flexible SME Collaboration
- Enables diverse and secure modes of collaboration with Subject Matter Experts from any location.
- Unicast: 1:1 expert sessions
- Simulcast: Real-time broadcast to multiple SMEs
- Multicast: Interactive, collaborative multi-sessions
- Accurate Cut Score Determination
- Utilizes robust metrics to define success and passing thresholds for assessments.
- P-Value: Monitor response accuracy across populations
- Difficulty: Calibrate expectations to cognitive load
- Angoff: Leverage expert judgment to define passing thresholds
- Quality Management System (QMS)
- Maintains assessment integrity through documented processes and clear accountability.
- Transparent review and revision logs
- Role-based accountability tracking
- Automated compliance checkpoints
- Robust Content Security & Compliance
- Ensures data safety and adherence to industry-leading security and privacy standards.
- Granular permission controls
- Secure audit trails and session logs
- Items directly move from Item Bank to Standard Setting events without a need for export
- Audited and certified by GDPR, COPPA, FERPA, ISO 9001:2015, ISO 27701:2019, ISO 27001:2022, PCI DSS, SOC2 II