‹ 首页

check-answer-consistency

@contextjet-ai · 收录于 1 周前

Use this to get a cheap, reference-free signal that an LLM answer might be made up, by sampling the same prompt a few times and measuring agreement. Trigger on "is this answer reliable", "flag low-confidence answers", "cheap hallucination check", "confidence score without a ground truth", "self-consistency check". Ships a runnable, tested scorer you can put inline or on sampled traffic.

适合你,如果需要在无标准答案时快速判断LLM输出可信度

/ 通过 npx 安装 校验哈希
npx oh-my-skill add contextjet-ai/awesome-llm-observability/check-answer-consistency
/ 通过 bash 安装
curl -fsSL https://oh-my-skill.com/install.sh | bash -s -- contextjet-ai/awesome-llm-observability/check-answer-consistency
/ 已经装过?验证本机副本,不用重装
npx oh-my-skill verify contextjet-ai/awesome-llm-observability/check-answer-consistency
安装目标可用 --agent / --scope 或 --to 明确指定;省略时只会在唯一已存在的 agent 目录上自动选择,零命中或多命中会停止并提示。content_hash 缺失或不一致均拒装。
19GitHub stars
~577最小装载
~954含声明引用
~1.2K文本包总量
索引托管

评论

登录即可评论;带「已验证安装」的,是发布者名下有本店的安装或持有记录。