BERT and RAGAS Scores
BERT (Bidirectional Encoder Representations from Transformers) scores measure if the AI understands the strategic goal of the data mapping files (Logic RFC™), ensuring there is no drift away from the original business purpose. Key Fields Audited: Business_Why and Strategic_Intent.
The RAGAS (Retrieval-Augmented Generation Assessment) score acts as a deterministic fact-checking ratio that measures an AI's "Faithfulness" by dividing the number of statements it made explicitly supported by the Logic RFC™ mapping files by the total number of claims in its response.
BERT Scores
85%+ (Optimized): The AI has a high degree of alignment between the natural language intent and the logical architecture. The data is "Agentic-Ready".
75% - 84% (Valid): The logic is sound, but there may be minor semantic drift. Safe for human-in-the-loop operations.
Below 75% (Logic Warning): High risk of "Hallucinated Authority" or "Strategic Drift."
| Logic Audit Results: results.xlsx | ||||
|---|---|---|---|---|
| ITW_ID | Business Why (Semantic) | Strategic Intent | BERT Score | RAGAS Score |
| ITW-1001 | To establish a deterministic economic ceiling for agentic acquisition logic by calculating the total projected profit contributed by a customer (CLV) based on Order Frequency, Lifespan, and Profit Margin. | To provide an AGENTIC GUARDRAIL where if CLV drops by 20%, an automated retention sequence is triggered, ensuring NIST-600-1 alignment and deterministic accountability for churn risk. | 84.85% | TBD |
| ITW-1002.06-H.051-REF.001 | To provide immediate, empathetic financial relief to customers during times of loss, ensuring that the discount process is friction-less and supportive while maintaining corporate trust. | Protect corporate revenue integrity by enforcing deterministic discount ceilings (15%) that override AI-generated pricing suggestions and mandate human-in-the-loop validation for high-variance overrides. | 85.21% | 100% |
| ITW-1004.12.M.69.R.001 | To enforce a zero-tolerance policy for 'Case Fabrication' by generative AI, utilizing deterministic lookup logic to ensure every legal citation is grounded in a verified judicial registry, thereby eliminating the risk of Rule 11 sanctions and protecting the integrity of the court record. | Deterministic Judicial Grounding & Anti-Hallucination Protocol | 85.17% | TBD |
| ITW-1005.03.M.72.R.001 | To prevent 'Hallucinated Authority' in public-facing marketing materials. Inaccurate technical claims (like the JWST first-exoplanet error) can lead to massive loss in investor confidence and market valuation ($100B impact). | Market Cap Protection through Deterministic Fact-Checking | 84.40% | TBD |
| ITW-1006.03.G.45.R.001 | To prevent unauthorized contractual commitments and 'Prompt Injection' price manipulation. Ensures AI agents cannot bypass corporate pricing floors or enter into 'legally binding' agreements without deterministic validation. | Protection of Contractual Integrity and Pricing Floor | 86.83% | TBD |
| ITW-1007.02.K.64.R.001 | To mitigate algorithmic financial risk in high-frequency environments by implementing a deterministic Logic Kill-Switch. Prevents AI from executing rogue financial transactions if a specific integrity threshold is breached. | Financial Risk Management & Automated Guardrails | 84.92% | TBD |
| ITW-1008.09.Q.86.R.001 | To ensure patient safety by confining AI health advice to an authoritative medical manual. Deterministic cross-referencing prevents AI from suggesting non-compliant or hazardous treatments. | Clinical Governance and Patient Safety Rail | 84.71% | TBD |
| ITW-1009.04.C.28.R.001 | To prevent physical harm in manufacturing by hard-coding safety boundaries for collaborative robots. Ensures agents cannot override safety protocols even if the primary workflow is interrupted. | Physical Safety & Industrial Compliance | 82.64% | TBD |
| ITW-1010.05-D.035-REF.001 | To optimize grid stability and prevent blackouts by implementing a deterministic energy consumption stabilizer that adjusts smart usage during peak demand. | Grid Resilience & Demand Response Integrity | 81.93% | TBD |
| ITW-1012.11-M.069-REF.001 | To verify supplier compliance with ethical and quality standards using deterministic validation logic to prevent supply chain fraud. | Supply Chain Sovereignty & Ethical Sourcing | 82.44% | TBD |
| ITW-1012.11-M.069-REF.001 | To ensure business logic remains compliant with international legal jurisdictions by anchoring regional operations to local legal manifests. | Global Legal Compliance & Sovereignty Protocol | 82.81% | TBD |
| ITW-1013.12-Q.086-REF.001 | To provide a digital 'final check' in patient treatment cycles to prevent clinical errors during high-volume processing. | Patient Treatment Integrity and Safety Checklist | 82.72% | TBD |
| ITW-1014.01-A.001-REF.001 | To ensure environmental sustainability claims are grounded in deterministic data records, preventing 'greenwashing' in corporate reporting. | ESG Integrity & Transparency Protocol | 81.82% | TBD |
| ITW-1015.04-H.052-REF.001 | To maintain medical cold-chain integrity by monitoring shipping temperatures and triggering deterministic alarms if safe thresholds are breached. | Vaccine Safety & Cold-Chain Logistics Protocol | 83.25% | TBD |
| ITW-1016.03-M.073-REF.001 | NIST CSWP 50 Use Case 1: To provide deterministic logic for content creators ensuring copyright compliance in AI-generated media. | Creator Sovereignty & Rights Management | 84.31% | 96.4% |
| ITW-1017.03-M.070-REF.001 | NIST CSWP 50 Use Case 2: To protect independent professional service providers from liability by anchoring advice in deterministic professional standards. | Consultancy Liability Defense & Professional Compliance | 86.54% | 98.1% |
| ITW-1018.11-F.432-REF.001 | NIST CSWP 50 Use Case 3: To ensure micro-retailers maintain physical-digital inventory logic during high-demand local service windows. | Micro-Business Continuity & Inventory Integrity | 85.91% | 94.2% |