Braintrust's Hossein Niazmandi on why eval platforms are hard to build
Read original source →youtube.com
Talk from Braintrust's West solutions-engineering lead argues measuring agent quality is more than putting a UI on a spreadsheet, covering the two pillars of agent evaluation. Most teams start evals in spreadsheets and struggle to grow out of them.
1 source
More stories today
Every builds company agent on Claude Managed Agents
Claude·2 hours ago
Perplexity cuts Decision API pricing to 2 cents per million input tokens
Aravind Srinivas·2 hours ago
Musubi releases PolicyLM-1.7B for real-time content moderation
Musubi's open-weights decision model applies plain-English content policies to messages in under 50 milliseconds, without retraining when policies change. Co-founder Filip Jankovic says it lets platforms label content proactively as volume grows.
TechCrunch·2 hours ago
Reddit user shares Krea 2 realism workflow for Pinterest-style images
A user with three months of AI image generation experience posted a Krea 2 workflow built on a character LoRA, tweaked from Koo's Discord workflow. It runs on an RTX 5060 8GB with 16GB DDR3 RAM.
r/StableDiffusion·2 hours ago
Together AI, IBM Cloud and NVIDIA launch dedicated B300 inference cluster
Together AI is the first customer on a dedicated NVIDIA B300 GPU inference cluster on IBM Cloud, using Spectrum-X Ethernet networking. Together says it serves hundreds of trillions of tokens per month to over a million developers.
Together AI Blog·2 hours ago
Qwen3.8-Flash-Next vs Claude Opus 5.5 tested on same Rust feature
A developer ran Qwen3.8-Flash-Next locally on an ASUS ROG Strix Halo laptop against Claude Opus 5.5 on the same high-complexity feature in LlamaStash, a large Rust project. The comparison covers weeks of local coding work.
r/LocalLLaMA·2 hours ago
Anthropic expands Cyber Verification Program to three access tiers
Verified security professionals get reduced blocking classifiers and access to Claude Opus 5.5, Sonnet 5.5, and Mythos 5.1. The program merges Project Glasswing and the original CVP, which ran for six months.
Anthropic News·2 hours ago
Boris Cherny: Talk to Claude like a coworker, no secret to prompting
Boris Cherny·2 hours ago