Brain in the Fish

Score any document. Prove every claim.

What It Does

Give it a document. Get back a score, a knowledge graph, and proof.

Input:  tender response, essay, policy document, clinical report
Output: score + OWL ontology + verdict (CONFIRMED / FLAGGED / REJECTED)

Every claim the system makes about your document is backed by an exact quote from the text. If the quote doesn't exist in the document, the structural score drops and the gate flags it.

Source quote verification built into the pipeline. Each node's quote is checked against the original document. Unverified quotes penalise the structural score — the system catches its own sloppy decomposition.

Who It's For

If you need to prove a score is fair, BITF gives you the audit trail.

One Example

Input — an essay that sounds impressive but says nothing:

"In the grand tapestry of contemporary discourse, one finds oneself inexorably drawn to the contemplation of matters that, by their very nature, resist facile categorisation..."

Raw LLM scores it 6.9/12 — "demonstrates sophisticated vocabulary."

BITF decomposes it into an ontology, finds 4 bare claims and 0 evidence, and rejects:

Ontology: 4 nodes, all claims, 0 evidence, 0% connected
Verdict:  REJECTED — score has no evidentiary support

  arg:node_1 [Claim] 0.10 "No subject, no position, no evidence"
    └─ source: "In the grand tapestry of contemporary discourse..."
  arg:node_2 [Claim] 0.10 "Continues without substance"
    └─ source: "The eloquence with which modern thinkers..."

The LLM was fooled by fluency. The ontology proved there was nothing there.

Run brain-in-the-fish demo to see all three verdicts (REJECTED, CONFIRMED, FLAGGED).

The BITF Badge

Documents evaluated by BITF can display a verification badge. The badge means:

BITF Verified (green): The LLM score is consistent with the structural evidence. Source quotes verified against the document. Gate confirmed.

BITF Flagged (yellow): Score diverges from evidence. Some claims may lack support. Requires review.

BITF Rejected (red): Insufficient evidence to verify claims. Score withheld.

How to get your badge

# Evaluate your document
brain-in-the-fish evaluate your-document.pdf --intent "assess quality" --badge

# Output includes:
#   verdict: CONFIRMED
#   badge: https://img.shields.io/badge/BITF-verified-brightgreen
#   report: evaluation-report.md
#   ontology: your-document.ttl

Add to your document or repo:

![BITF Verified](https://img.shields.io/badge/BITF-verified-brightgreen)

The badge links to the evaluation report

... View full README on GitHub