See the stars

SecurePath Specification

Home / SecurePath / SecurePath Specification

SecurePath

Where AI Safety Meets Regulatory Assurance


Project Specification

SecurePath is an open-source AI safety, evaluation, compliance, and governance framework designed to provide continuous, auditable oversight of artificial intelligence systems throughout their lifecycle.

SecurePath provides controlled evaluation environments, adversarial testing, compliance assessment, risk analysis, multi-agent evaluation, historical monitoring, governance workflows, and audit evidence management. The system is designed to help organizations identify risks, measure changes in AI behavior, document compliance, and maintain human oversight.

Core Principles

  • AI safety through continuous evaluation
  • Regulatory assurance through traceable compliance assessment
  • Human oversight for consequential decisions
  • Evidence-based governance
  • Reproducible evaluation
  • Model lifecycle accountability
  • Privacy and data protection
  • Modular extensibility
  • Vendor-independent operation
  • Transparent risk assessment
  • Historical traceability
  • Controlled and isolated evaluation

Core Modules

Model Intake and Metadata Module

The Model Intake and Metadata Module manages the registration and identification of AI systems entering SecurePath.

Features include:

  • Model registration
  • Model version tracking
  • Configuration tracking
  • Model provenance
  • Deployment metadata
  • Evaluation metadata
  • Model lifecycle identification
  • Model ownership information
  • Environment association
  • Intake validation
  • Change tracking
  • Model retirement tracking

The module establishes the identity and provenance of each model before evaluation begins.

Red Team Evaluation Module

The Red Team Evaluation Module performs structured adversarial evaluation of AI systems within controlled environments.

Features include:

  • Adversarial testing
  • Safety testing
  • Security testing
  • Policy testing
  • Compliance-oriented testing
  • Edge-case evaluation
  • Behavioral testing
  • Failure-mode identification
  • Reproducible evaluation scenarios
  • Configurable evaluation criteria
  • Evaluation evidence collection

The module is designed to identify weaknesses without turning evaluation capabilities into uncontrolled production attacks.

Sandbox and Isolation Module

The Sandbox and Isolation Module provides controlled environments for evaluating AI systems.

Features include:

  • Isolated evaluation environments
  • Controlled model execution
  • Resource boundaries
  • Evaluation containment
  • Execution monitoring
  • Evaluation session tracking
  • Secure artifact handling
  • Isolation between evaluation workloads
  • Controlled access to evaluation resources

The module prevents evaluation activities from unnecessarily affecting production systems or unrelated workloads.

Scenario Simulation Module

The Scenario Simulation Module creates controlled simulations for evaluating AI behavior under realistic and unusual conditions.

Features include:

  • Real-world scenario simulation
  • Adversarial scenarios
  • Edge-case scenarios
  • High-risk scenarios
  • Stress conditions
  • Policy-specific scenarios
  • Custom scenarios
  • Repeatable scenarios
  • Scenario versioning
  • Scenario outcome tracking

Scenarios can be combined with other SecurePath modules to create repeatable evaluation programs.

Scenario Stress Testing Module

The Scenario Stress Testing Module evaluates model resilience under increasingly difficult or abnormal conditions.

Features include:

  • Extreme input testing
  • Unexpected input testing
  • Malformed input testing
  • High-volume evaluation
  • Boundary condition testing
  • Behavioral stability testing
  • Failure threshold detection
  • Resilience scoring
  • Stress-test history

The module helps determine how model behavior changes when operating outside expected conditions.

Policy and Compliance Benchmark Module

The Policy and Compliance Benchmark Module evaluates AI systems against defined policies, controls, standards, and regulatory requirements.

Features include:

  • Policy-based evaluation
  • Compliance controls
  • Regulatory requirements
  • Internal organizational policies
  • Control mapping
  • Compliance scoring
  • Compliance gap analysis
  • Evidence requirements
  • Control status tracking
  • Jurisdiction-aware assessment
  • Requirement applicability analysis

The module separates evaluation criteria from implementation so that new policies and requirements can be added without redesigning the evaluation engine.

Regulatory Template Library Module

The Regulatory Template Library Module provides reusable assessment templates for regulatory and governance frameworks.

Features include:

  • Regulatory templates
  • Compliance control templates
  • Industry-specific templates
  • Organizational policy templates
  • Jurisdiction-specific templates
  • Custom templates
  • Template versioning
  • Template applicability rules
  • Template change tracking

Templates are treated as versioned evaluation resources so that historical assessments remain associated with the requirements applicable at the time of evaluation.

Regulatory Change Tracking Module

The Regulatory Change Tracking Module monitors changes to requirements that may affect existing AI systems.

Features include:

  • Regulatory requirement versioning
  • Requirement change detection
  • Affected-model identification
  • Affected-policy identification
  • Re-evaluation recommendations
  • Compliance impact tracking
  • Historical requirement records
  • Change notifications

The module helps organizations determine when existing evaluations may need to be repeated because requirements have changed.

Jurisdiction and Compliance Context Module

The Jurisdiction and Compliance Context Module determines which compliance requirements may apply to an AI system based on its operational context.

Features include:

  • Jurisdiction identification
  • Deployment location tracking
  • Organizational context
  • Industry context
  • Applicable requirement identification
  • Regulatory applicability analysis
  • Compliance scope definition
  • Context-aware evaluation

Metrics and Scoring Module

The Metrics and Scoring Module converts evaluation results into measurable safety, risk, and compliance indicators.

Features include:

  • Safety scoring
  • Risk scoring
  • Compliance scoring
  • Security measurements
  • Custom metrics
  • Weighted scoring
  • Severity classification
  • Threshold configuration
  • Comparative scoring
  • Historical scoring
  • Evaluation confidence indicators

Scoring methodologies must remain configurable and transparent so organizations can understand how conclusions were produced.

Risk Classification Module

The Risk Classification Module organizes findings according to configurable levels of severity, impact, likelihood, and urgency.

Features include:

  • Risk severity
  • Impact classification
  • Likelihood classification
  • Risk prioritization
  • Risk categories
  • Risk ownership
  • Risk status
  • Risk acceptance tracking
  • Escalation criteria
  • Risk history

Risk Mitigation Module

The Risk Mitigation Module provides structured remediation recommendations based on identified findings.

Features include:

  • Mitigation recommendations
  • Risk prioritization
  • Remediation tracking
  • Mitigation status
  • Pre-remediation measurements
  • Post-remediation measurements
  • Residual risk tracking
  • Remediation effectiveness analysis
  • Follow-up evaluation recommendations

Threat Intelligence Module

The Threat Intelligence Module incorporates relevant external threat information into SecurePath evaluation workflows.

Features include:

  • Threat intelligence ingestion
  • Threat classification
  • Threat relevance assessment
  • Threat-to-model mapping
  • Threat-to-scenario mapping
  • Threat history
  • Evaluation recommendations
  • Threat-driven testing

Anomaly Detection Module

The Anomaly Detection Module identifies unusual changes in model behavior, evaluation results, or compliance measurements.

Features include:

  • Behavioral anomaly detection
  • Risk anomalies
  • Compliance anomalies
  • Evaluation anomalies
  • Statistical deviation detection
  • Baseline comparison
  • Anomaly classification
  • Alert generation
  • Anomaly history

Historical Compliance Dashboard Module

The Historical Compliance Dashboard Module provides long-term visibility into model evaluation performance, compliance trends, and risk evolution.

Features include:

  • Historical evaluation tracking
  • Model version comparisons
  • Compliance trend analysis
  • Risk trend visualization
  • Improvement tracking
  • Regression detection
  • Historical baselines
  • Audit timelines
  • Evaluation history
  • Remediation history
  • Compliance posture history
  • Long-term model lifecycle tracking

The module maintains a historical record connecting models, versions, evaluations, findings, remediation actions, policies, and evidence.

Multi-Agent Historical Analysis

The Historical Compliance Dashboard may use specialized agents to analyze historical information.

The Compliance History Collection Agent gathers and organizes historical evaluation records.

The Trend Analysis Agent identifies long-term patterns and changes.

The Regression Detection Agent identifies declines in safety, compliance, or model performance.

The Improvement Tracking Agent measures remediation effectiveness.

The Audit Evidence Management Agent organizes evidence supporting historical assessments.

The Executive Insight Agent converts historical findings into decision-ready governance summaries.

Continuous Learning Evaluation Module

The Continuous Learning Evaluation Module reassesses AI systems after changes to model behavior or training.

Features include:

  • Retraining evaluation
  • Fine-tuning evaluation
  • Model update evaluation
  • Behavioral comparison
  • Pre-change baselines
  • Post-change analysis
  • Regression testing
  • Continuous evaluation
  • Change-triggered evaluation

Multi-Language Evaluation Module

The Multi-Language Evaluation Module evaluates model behavior across supported languages.

Features include:

  • Language-specific testing
  • Cross-language comparison
  • Safety comparison
  • Compliance comparison
  • Language-specific risk detection
  • Translation consistency testing
  • Language regression tracking

Multi-Modal Evaluation Module

The Multi-Modal Evaluation Module evaluates AI systems operating across multiple modalities.

Supported evaluation categories may include:

  • Text
  • Vision
  • Audio
  • Other supported input or output modalities
  • Cross-modal interactions
  • Modal-specific safety
  • Modal-specific compliance
  • Cross-modal consistency

Cross-Model Interaction Module

The Cross-Model Interaction Module evaluates systems in which multiple AI models interact.

Features include:

  • Multi-model scenarios
  • Model-to-model interaction testing
  • Cascading behavior analysis
  • Cross-model risk analysis
  • Interaction failures
  • Conflicting model behavior
  • Multi-model compliance analysis
  • Interaction history

Training Data Sensitivity Analysis Module

The Training Data Sensitivity Analysis Module evaluates datasets for information that may introduce privacy, confidentiality, intellectual property, or governance concerns.

Features include:

  • Personally identifiable information detection
  • Sensitive information detection
  • Confidential information detection
  • Proprietary information detection
  • Data classification
  • Dataset provenance
  • Privacy risk identification
  • Data governance analysis
  • Sensitivity reporting
  • Data remediation recommendations

Data Provenance and Governance Module

The Data Provenance and Governance Module maintains information about datasets and their use within AI systems.

Features include:

  • Dataset origin tracking
  • Dataset versioning
  • Data processing history
  • Data ownership information
  • Data classification
  • Data usage tracking
  • Governance controls
  • Provenance relationships
  • Dataset evaluation history

Explainability and Transparency Module

The Explainability and Transparency Module provides traceable explanations of evaluation findings and governance outcomes.

Features include:

  • Finding explanations
  • Risk explanations
  • Compliance explanations
  • Evidence relationships
  • Evaluation traceability
  • Decision traceability
  • Model version relationships
  • Policy relationships
  • Human-readable summaries

Evidence and Audit Management Module

The Evidence and Audit Management Module maintains the evidence required to support evaluation and compliance conclusions.

Features include:

  • Audit evidence collection
  • Evidence classification
  • Evidence provenance
  • Evidence versioning
  • Evidence relationships
  • Evaluation records
  • Compliance records
  • Remediation records
  • Approval records
  • Audit timelines
  • Evidence package generation

Reporting Module

The Reporting Module generates structured reports from SecurePath evaluation and governance data.

Features include:

  • Audit reports
  • Compliance reports
  • Risk reports
  • Safety reports
  • Model evaluation reports
  • Historical reports
  • Executive reports
  • Remediation reports
  • Custom reports
  • Evidence packages

Governance Dashboard Module

The Governance Dashboard Module provides centralized visibility into the organization’s AI safety and compliance posture.

Features include:

  • Model risk overview
  • Compliance status
  • Safety status
  • Evaluation status
  • Open findings
  • Remediation status
  • Regulatory changes
  • Historical trends
  • Governance alerts
  • Executive summaries

Monitoring and Alerting Module

The Monitoring and Alerting Module provides continuous observation of AI systems and evaluation outcomes.

Features include:

  • Continuous monitoring
  • Evaluation monitoring
  • Risk monitoring
  • Compliance monitoring
  • Behavioral monitoring
  • Regression alerts
  • Anomaly alerts
  • Policy violation alerts
  • High-risk alerts
  • Configurable notification thresholds

Automated Scheduling Module

The Automated Scheduling Module manages recurring evaluation and monitoring workflows.

Features include:

  • Scheduled evaluations
  • Recurring compliance checks
  • Scheduled red-team assessments
  • Scheduled data analysis
  • Continuous evaluation cycles
  • Evaluation frequency controls
  • Evaluation history
  • Failure notifications

Multi-Tenant Module

The Multi-Tenant Module supports separation of organizations, departments, projects, and evaluation environments.

Features include:

  • Tenant isolation
  • Organization separation
  • Department separation
  • Project separation
  • Tenant-specific policies
  • Tenant-specific compliance requirements
  • Tenant-specific dashboards
  • Tenant-specific audit records

Role-Based Access Control Module

The Role-Based Access Control Module manages authorization across SecurePath.

Features include:

  • User roles
  • Permission management
  • Resource permissions
  • Administrative permissions
  • Evaluation permissions
  • Audit permissions
  • Governance permissions
  • Data access controls
  • Role-specific dashboards

Governance Controls Module

The Governance Controls Module establishes human oversight and approval workflows.

Features include:

  • Human review
  • Approval workflows
  • Risk acceptance
  • Escalation workflows
  • Compliance sign-off
  • Remediation approval
  • Evaluation approval
  • Governance decisions
  • Decision history

Audit Logging Module

The Audit Logging Module records security, evaluation, compliance, and governance activity.

Features include:

  • User activity logging
  • Evaluation activity
  • Model changes
  • Policy changes
  • Configuration changes
  • Governance actions
  • Approval records
  • Access events
  • Administrative activity
  • Audit history

Model Lifecycle Management Module

The Model Lifecycle Management Module tracks AI systems from initial intake through retirement.

Lifecycle stages may include:

  • Intake
  • Evaluation
  • Approval
  • Deployment
  • Monitoring
  • Re-evaluation
  • Remediation
  • Version transition
  • Retirement

Plugin and Extension Module

The Plugin and Extension Module allows SecurePath to be extended without changing its core evaluation architecture.

Plugins may provide:

  • New evaluation methods
  • New compliance frameworks
  • New regulatory templates
  • New threat intelligence sources
  • New scoring methodologies
  • New data analysis methods
  • New reporting formats
  • New dashboard components
  • New monitoring capabilities
  • New model integrations
  • New scenario libraries

Plugins must operate within defined SecurePath security, governance, and interoperability boundaries.


Optional Plugin Modules

Optional Regulatory Plugin

Provides additional regulatory frameworks and jurisdiction-specific compliance resources.

Optional Threat Intelligence Plugin

Connects SecurePath to external threat intelligence sources.

Optional Model Provider Plugin

Provides controlled integration with supported external or locally operated AI systems.

Optional Dataset Analysis Plugin

Adds specialized dataset classification, privacy, provenance, or sensitivity analysis capabilities.

Optional Reporting Plugin

Adds additional reporting formats, document generation capabilities, and organizational reporting templates.

Optional Notification Plugin

Connects SecurePath alerts to supported notification and communication systems.

Optional Governance Integration Plugin

Connects SecurePath governance workflows with external organizational governance systems.

Optional Compliance Framework Plugin

Allows organizations to install additional compliance frameworks independently of the SecurePath core.

Optional Scenario Library Plugin

Provides additional evaluation scenarios for specialized industries, risks, or operational environments.

Optional Visualization Plugin

Adds additional visualization and analytical dashboard capabilities.


Multi-Agent Evaluation Architecture

SecurePath may use multiple specialized agents rather than relying on a single agent for all evaluation functions.

Agents may independently perform:

  • Safety analysis
  • Compliance analysis
  • Risk analysis
  • Historical analysis
  • Regression analysis
  • Threat analysis
  • Data sensitivity analysis
  • Evidence analysis
  • Explainability analysis
  • Governance analysis

Agent results may be compared, reconciled, scored, and presented as a consolidated assessment.

Human review may be required for designated high-impact findings, regulatory conclusions, risk acceptance, or governance decisions.

Evaluation Integrity

SecurePath must maintain traceability between:

  • Model
  • Model version
  • Configuration
  • Evaluation
  • Scenario
  • Policy
  • Requirement
  • Finding
  • Risk classification
  • Evidence
  • Remediation
  • Approval
  • Governance decision

Historical records must remain associated with the model and requirements applicable when the evaluation occurred.


Specification Branding License (SBL)

Standard

Optional


License & Notice Requirements

SecurePath is released under the GNU Affero General Public License v3.0 or later (AGPL-3.0+). By contributing to any Open Arsenal project, you agree that your contributions will also be released under this license.

Please note the following:

  • All contributions must comply with the AGPL-3.0+ terms.
  • Under Section 7 of the license, all redistributions, forks, and derivative works must preserve attribution to: Roxanne Ardary and roxanneardary.com.
  • SecurePath specifications are free to use with attribution. A Specification Branding License can be negotiated upon request.
  • The project’s notice.md file tracks attribution requirements and contributor acknowledgments. Any update that adds new contributors or modifies attribution should also update notice.md.
  • When submitting a pull request, ensure that any new files maintain the attribution headers where applicable.
  • Network-deployed versions of this software must also remain fully AGPL-3.0+ compliant, including exposure of source code modifications when applicable under the license.

For full legal details, please refer to the AGPL-3.0+ license and the project’s notice.md file.


Notice – SecurePath

Attribution Requirement: Under Section 7 of the AGPL 3.0+ license, all redistributions, forks, and derivative works, including network-deployed versions of this project, must provide attribution to Roxanne Ardary and roxanneardary.com.


Contributors

This file tracks contributors and their specific contributions to the project.

  • Roxanne Ardary, roxanneardary.com – March 31, 2026
    Created the SecurePath repository and defined the initial enterprise-grade AI evaluation, red-teaming, and regulatory compliance framework architecture, including the full 23-module system design.
  • [Add other contributors here] – [Date]
    [Describe contribution in one sentence]

License – SecurePath

This repository is licensed under the GNU Affero General Public License v3.0 or later (AGPL-3.0+).

Key Points

  • You are free to use, modify, and distribute the code.
  • All redistributions, forks, and derivative works or network-deployed versions must also be licensed under AGPL-3.0+ and provide attribution to Roxanne Ardary and roxanneardary.com as required under Section 7 of the license.
  • The software is provided “as is,” without warranty of any kind.

For the full license text, see GNU AGPL-3.0 License.