๐Ÿ” NullSec ModelAudit

March 7, 2026 ยท View on GitHub

๐Ÿ” NullSec ModelAudit

ML Model Security Auditing Framework

Python License NullSec

Comprehensive security auditing for deployed machine learning models


๐ŸŽฏ Overview

NullSec ModelAudit is a security auditing framework for machine learning models. It inspects model files for hidden payloads (pickle deserialization, Lambda layers), checks for backdoors via Neural Cleanse and Meta Neural Analysis, evaluates robustness boundaries, and generates compliance-ready audit reports covering OWASP ML Top 10 risks.

โšก Features

FeatureDescription
File InspectorDetect pickle exploits, malicious Lambda layers, hidden ops
Backdoor ScanNeural Cleanse, Meta Neural Analysis, fine-pruning checks
Robustness EvalAutomated adversarial boundary testing
Supply ChainVerify model provenance and hash integrity
Fairness AuditBias detection across protected attributes
OWASP ML Top 10Map findings to OWASP ML risk categories
Report EngineHTML/PDF/JSON audit reports with severity ratings

๐Ÿ“‹ Audit Checks

CheckCategorySeverity
Pickle RCEDeserializationCritical
Lambda InjectionModel ArchitectureCritical
Backdoor TriggerIntegrityHigh
Adversarial FragilityRobustnessHigh
Training Data LeakagePrivacyHigh
Model WatermarkProvenanceMedium
Bias / FairnessComplianceMedium
Dependency VulnSupply ChainVariable

๐Ÿš€ Quick Start

# Full security audit of a model file
nullsec-modelaudit scan --model model.pt --format pytorch --output audit-report.html

# Check for deserialization exploits in pickle files
nullsec-modelaudit inspect --model model.pkl --check deserialization

# Backdoor detection scan
nullsec-modelaudit backdoor --model model.h5 --dataset validation/ --num-classes 10

# Supply chain verification
nullsec-modelaudit verify --model model.onnx --expected-hash sha256:abc123...
ProjectDescription
nullsec-adversarialAdversarial ML attack toolkit
nullsec-datapoisoningTraining data poisoning detection
nullsec-llmredLLM red-teaming framework
nullsec-promptinjectPrompt injection payloads
nullsec-linuxSecurity Linux distro (140+ tools)

For authorized security auditing only. Always obtain proper authorization before auditing third-party models.

๐Ÿ“œ License

MIT License โ€” @bad-antics


Part of the NullSec AI/ML Security Suite