
AI citation checks: why a working link can't prove a quote
AI citation checks need more than working links. Our synthetic lab shows why exact quote matching catches altered numbers that token overlap accepts.
Tag archive

AI citation checks need more than working links. Our synthetic lab shows why exact quote matching catches altered numbers that token overlap accepts.

RAG faithfulness with Ragas and LlamaIndex: what the score measures, how to read it and why a faithful answer can still be wrong during on-call.

I put up a new video walkthrough on Hy4: it fabricates answers 89% of the time on our adversarial set...

I published a new walkthrough yesterday: https://www.youtube.com/shorts/7swT71hR-A4 — and it exists...
DeepSeek V4 Pro runs 1.6 trillion parameters, 49 billion of them active, and scores 44 on the...

An agent's summary is a story about the session; the tool log is the record. How to test each sentence of the summary and see what the record backs.

We gave 44 page-head tasks to Sonnet and Haiku. Valid syntax hid a made-up currency, a self-awarded rating and an unsupported language code.

Sonnet and Haiku each got 19 of 24 social posting API questions right alone and missed the same five. A skill fixed them, though its first wording br…
Confident, plausible, wrong. The detection layers that stop invented facts from reaching users.

Sonnet wrote 16 of 23 job posts right alone, Haiku 15. With a skill, 21 and 20, though two Sonnet posts that passed alone then failed.

We gave 24 small tables to Sonnet and Haiku and told both to use only printed figures. Sonnet still computed its own on eight tables, Haiku on none.
Large Language Models (LLMs) are becoming increasingly capable, but working with a general-purpose...