(Image source: Monitaur FlightSim webpage.)
Monitaur (Boston) has made FlightSim, the objective validation capability inside its AI governance platform, available as a standalone solution.
The move gives AI developers and deployers access to FlightSim without requiring a full Monitaur platform license, according to a Monitaur statement.
FlightSim is designed to put high-impact AI systems through objective, repeatable validations and simulated scenarios to assess performance and readiness for use. Monitaur describes the capability as analogous to a penetration test for AI.
Andrew Clark, Co-Founder and CTO, Monitaur.
The tool produces scorecards that identify issues, recommend remediations and provide a measurable view of system performance across risk dimensions.
“Objective validations that provide confidence and assurance in the trust and reliability of AI systems across different data and modeling modalities are very difficult to scale,” comments Andrew Clark, Co-Founder and CTO, Monitaur. “As the proliferation and impacts of AI and agents continue to accelerate, human review capacity and generalized evaluation, testing, and validation techniques fall short.”
Clark says making FlightSim available as a standalone offering will let a broader group of companies use Monitaur’s AI validation expertise without adopting the full governance platform.
Testing High-Impact AI
FlightSim uses black-box testing techniques to evaluate AI systems with minimal user input and without requiring access to a developer’s proprietary code or underlying algorithms, according to Monitaur.
The software applies Monitaur research and AI evaluation practices to assess systems across dimensions including reliability, performance, bias and security.
The company says its large-enterprise and regulated-entity customers have begun requiring successful FlightSim results as a gate for purchasing and deploying high-impact AI systems. Monitaur says standalone availability will let companies use FlightSim in deployment stacks and vendor-management security processes.
Monitaur cites an Association for the Advancement of Artificial Intelligence survey finding that 90 percent of respondents spend more than 10 percent of their time on AI evaluation, while 40 percent cite a lack of suitable evaluation methodologies as their biggest challenge.
“Especially for our most consequential and high-impact systems, we should assume AI will encounter situations not anticipated, designed, or evaluated for,” Clark comments. “FlightSim complements developers’ efforts and prepares our companies with a broader confidence and understanding of AI’s fit for purpose and readiness before use.”
FlightSim remains available as part of the Monitaur platform, where it supports governance automations and continuous production monitoring.
Monitaur provides AI governance technology for regulated enterprises, combining governance controls, objective measurement and operational guidance to help organizations prove AI systems perform as intended.
Monitaur, Model Governance Platform for Highly-Regulated Industries, Raises $6M