rotalabs-probe
v0.1.0Detection tools for strategic underperformance in AI systems. Activation probes, behavioral analysis, and sandbagging detection with 90-96% accuracy.
Open Source
Research tools for AI trust and reliability. AGPL-3.0 licensed.
Core Libraries
Production-ready tools for detecting and managing AI system failures.
rotalabs-cascade
v0.1.0Trust-based decision routing for multi-tier verification. 5-level cascade with adaptive pattern learning and 21 condition operators.
rotalabs-steer
v0.1.1Runtime behavior control via activation steering. Guide model outputs toward desired behaviors using contrastive activation addition.
rotalabs-verify
v0.1.0Verified code synthesis with Z3 solver. Correctness verification for AI-generated code with CE2P feedback and CEGIS synthesis.
rotalabs-redqueen
v0.1.0Evolutionary adversarial testing. Red-teaming with quality-diversity optimization, MAP-Elites archive, and multi-provider LLM targets.
rotalabs-graph
v0.1.0GNN-based trust propagation. Model trust relationships with PageRank, EigenTrust, and learned propagation algorithms.
Infrastructure
Evaluation, acceleration, and compliance tools.
rotalabs-eval
v0.1.0Comprehensive LLM evaluation with statistical rigor. Lexical, semantic, LLM-judge, and RAG metrics with confidence intervals and significance testing.
rotalabs-accel
v0.2.0Inference acceleration with Triton kernels and speculative decoding. RMSNorm, SwiGLU, RoPE, INT8 quantization, and KV-cache compression.
rotalabs-comply
v0.1.0Compliance evaluations for AI systems. EU AI Act, SOC2 Type II, and HIPAA frameworks with encrypted audit trails and report generation.
rotalabs-audit
v0.1.0Reasoning chain capture for auditing. Extract and analyze CoT, ReAct, and Tree-of-Thought reasoning with anomaly detection.
Installation
# Core detection and control
pip install rotalabs-probe # Sandbagging detection
pip install rotalabs-steer # Activation steering
pip install rotalabs-cascade # Trust-based routing
pip install rotalabs-verify # Formal verification
pip install rotalabs-redqueen # Adversarial testing
pip install rotalabs-graph # Trust propagation
# Infrastructure
pip install rotalabs-eval # LLM evaluation
pip install rotalabs-accel # Inference acceleration
pip install rotalabs-comply # Compliance checking
pip install rotalabs-audit # Reasoning captureCore Libraries
Production-ready tools for detecting and managing AI system failures.
@rotalabs/probe
v0.0.1Sandbagging detection via metacognitive probes. Behavioral analysis and strategic underperformance detection for AI systems.
@rotalabs/cascade
v0.0.1Domain-agnostic trust cascade routing. Multi-tier verification with adaptive pattern learning.
@rotalabs/steer
v0.0.1Runtime behavior control with steering vectors. Guide model outputs toward desired behaviors.
@rotalabs/verify
v0.0.1Verified code synthesis with CE2P hypothesis. Correctness verification for AI-generated code.
@rotalabs/redqueen
v0.0.1Evolutionary adversarial testing. Red-teaming with quality-diversity optimization.
@rotalabs/graph
v0.0.1GNN-based trust propagation. Model trust relationships with graph algorithms.
Infrastructure
Evaluation, acceleration, and compliance tools.
@rotalabs/eval
v0.0.1Distributed LLM evaluation at scale. Statistical rigor with confidence intervals and significance testing.
@rotalabs/accel
v0.0.1Inference acceleration with speculative decoding. Optimized for Node.js environments.
@rotalabs/comply
v0.0.1Compliance evaluations for AI agents. Framework support for regulatory requirements.
@rotalabs/audit
v0.0.1Reasoning chain capture for auditing. Extract and analyze AI reasoning patterns.
Installation
# Core detection and control
npm install @rotalabs/probe # Sandbagging detection
npm install @rotalabs/steer # Steering vectors
npm install @rotalabs/cascade # Trust-based routing
npm install @rotalabs/verify # Code verification
npm install @rotalabs/redqueen # Adversarial testing
npm install @rotalabs/graph # Trust propagation
# Infrastructure
npm install @rotalabs/eval # LLM evaluation
npm install @rotalabs/accel # Inference acceleration
npm install @rotalabs/comply # Compliance checking
npm install @rotalabs/audit # Reasoning captureGet Notified
Star repositories on GitHub for release notifications, or subscribe below for research updates.