Chip Huyen explains how to cut inference costs without new hardware

Waymo's AI team is hosting an AMA session to discuss their work on foundation models, simulation, and scaling the Waymo Driver. The discussion covers technical topics including multimodality and end-to-end architectures.

r/LocalLLaMA poster asks whether a two-Spark DGX Spark cluster can run DeepSeek 4.1 Flash or whether three or four units are required. No benchmarks or memory figures are given.

Reddit user assembled a 128GB VRAM, 256GB DDR4 server for roughly $3,000, using 4x V620 GPUs at $1,400, 256GB DDR4 RDIMM 2666 at $610, and a Huanandzhi D12D board at $410. They returned a Lenovo P620 workstation first, citing proprietary Lenovo components.

Yifan Zhang's RLT technical report carries decoder state across every token, looping 96 blocks per token with unbounded temporal depth. In standard decoder-only LLMs, nothing computed at token t's last layer feeds token t+1's first layer.

A hobbyist connected a simulated fly brain to the PCSX2 emulator with a virtual PS controller and dopamine readout, using Mr. Mosquito as the first visual cue test. The builder says the project has no real-world value and is a way to learn about spiking neural networks, with a quasi-universal trainer in progress.