Public benchmark
PII detection accuracy benchmark for NeutralAI
This page summarizes our reproducible benchmark comparing a Presidio-vanilla baseline against the current NeutralAI detection stack across multilingual and multi-entity prompt samples.
Benchmark cases
1587
NeutralAI overall F1
100.0%
PERSON F1
100.0%
False positive rate
0.0%
Tracked exact-match accuracy
100.0%
Tracked extra entity rate
0.0%
Headline result
NeutralAI clears the current public acceptance guard with strong overall recall and a bounded multilingual PERSON quality profile.
NeutralAI
- Precision
- 100.0%
- Recall
- 100.0%
- F1
- 100.0%
- False positive rate
- 0.0%
Presidio vanilla baseline
- Precision
- 100.0%
- Recall
- 17.3%
- F1
- 29.5%
- False positive rate
- 0.0%
Overall F1 uplift
70.5%
Overall recall uplift
82.7%
PERSON F1 uplift
5.5%
Exact-match uplift
82.7%
What NeutralAI adds beyond the baseline
We use proven open components as a foundation, but the product difference is the operational layer we add around detection: multilingual entity coverage, PERSON false-positive calibration, locale-aware context gating, masking and tokenization flows, and enforcement inside the gateway and browser extension.
Detection hardening
Context-aware rules reduce false positives on names, phone numbers, and locale-specific identifiers while keeping recall high across supported languages.
Product enforcement
Detection is wired into masking, audit-safe handling, tenant controls, and extension enforcement so the benchmark reflects product behavior rather than a standalone recognizer demo.
Methodology note
This is a reproducible product benchmark, not an academic corpus. The public report is synthetic by design, tracks the published entity set, and compares a Presidio-vanilla baseline against the current NeutralAI production configuration. Internal shadow and holdout packs are used separately to watch for overfitting and generalization drift.
Coverage by language
The current public benchmark includes English, Turkish, Spanish, French, and German prompt samples.
| Language | Precision | Recall | F1 | False positive rate |
|---|---|---|---|---|
| DE | 100.0% | 100.0% | 100.0% | 0.0% |
| EN | 100.0% | 100.0% | 100.0% | 0.0% |
| ES | 100.0% | 100.0% | 100.0% | 0.0% |
| FR | 100.0% | 100.0% | 100.0% | 0.0% |
| TR | 100.0% | 100.0% | 100.0% | 0.0% |
Coverage by entity
This benchmark release tracks the entity families most relevant to our current public product posture.
CREDIT_CARD
- Precision
- 100.0%
- Recall
- 100.0%
- F1
- 100.0%
- False positive rate
- 0.0%
EMAIL_ADDRESS
- Precision
- 100.0%
- Recall
- 100.0%
- F1
- 100.0%
- False positive rate
- 0.0%
IP_ADDRESS
- Precision
- 100.0%
- Recall
- 100.0%
- F1
- 100.0%
- False positive rate
- 0.0%
PERSON
- Precision
- 100.0%
- Recall
- 100.0%
- F1
- 100.0%
- False positive rate
- 0.0%
PHONE_NUMBER
- Precision
- 100.0%
- Recall
- 100.0%
- F1
- 100.0%
- False positive rate
- 0.0%
TR_ID_NUMBER
- Precision
- 100.0%
- Recall
- 100.0%
- F1
- 100.0%
- False positive rate
- 0.0%
UK_BANK_ACCOUNT_NUMBER
- Precision
- 100.0%
- Recall
- 100.0%
- F1
- 100.0%
- False positive rate
- 0.0%
UK_COMPANIES_HOUSE_NUMBER
- Precision
- 100.0%
- Recall
- 100.0%
- F1
- 100.0%
- False positive rate
- 0.0%
UK_COURT_CASE_NUMBER
- Precision
- 100.0%
- Recall
- 100.0%
- F1
- 100.0%
- False positive rate
- 0.0%
UK_DRIVING_LICENCE
- Precision
- 100.0%
- Recall
- 100.0%
- F1
- 100.0%
- False positive rate
- 0.0%
UK_HMRC_UTR
- Precision
- 100.0%
- Recall
- 100.0%
- F1
- 100.0%
- False positive rate
- 0.0%
UK_LAND_REGISTRY_TITLE
- Precision
- 100.0%
- Recall
- 100.0%
- F1
- 100.0%
- False positive rate
- 0.0%
UK_NATIONAL_INSURANCE_NUMBER
- Precision
- 100.0%
- Recall
- 100.0%
- F1
- 100.0%
- False positive rate
- 0.0%
UK_NHS_NUMBER
- Precision
- 100.0%
- Recall
- 100.0%
- F1
- 100.0%
- False positive rate
- 0.0%
UK_SORT_CODE
- Precision
- 100.0%
- Recall
- 100.0%
- F1
- 100.0%
- False positive rate
- 0.0%
UK_SRA_ID
- Precision
- 100.0%
- Recall
- 100.0%
- F1
- 100.0%
- False positive rate
- 0.0%