AI At Home Part 2: Multi GPU Drifting
Read original source →jdagostino.github.io
Blog post walks through squeezing performance out of a multi-GPU home server running LLMs with llama.cpp, covering transformer basics and multi-GPU parallelism. Focuses on practical settings and techniques, not new kernels.
1 source
More stories today
Akamai's Thorsten Hans demos serverless AI agents on WebAssembly
Talk shows building MCP servers and AI agents with Spin, the open-source WebAssembly framework, deployed on Akamai Functions to eliminate cold starts, proprietary SDKs and single-region deployments.
YouTube·1 hour ago
ChatGPT Astra users on $20 plan hit usage limits fast
A Reddit user reports a single "extra high" prompt on ChatGPT Astra consumed the 5-hour limit twice before producing an answer. The workload was an xlsx with 10 sheets and a 150-page .docx.
r/ChatGPT·2 hours agoSenate report: AI data centers shift costs to ratepayers
Warren, Blumenthal and Van Hollen released a 27-page report, "Power and Profits: How the AI Data Center Boom Costs Households and Communities," after a nearly yearlong investigation. Letters went to Amazon, Google, Meta, Microsoft, CoreWeave, Digital Realty and Equinix on December 15, 2025; the report says the companies keep seeking subsidies and using NDAs.
Hacker News·2 hours agoSuleyman: Superintelligence containment is an engineering and governance challenge
Mustafa Suleyman·2 hours agoGitHub's Jose Palafox on scaling custom Copilot agents to CI
Talk walks through taking a custom agent from a single laptop to org-wide use and into the CI pipeline. Palafox has spent six and a half years at GitHub and now works with companies on Copilot adoption.
YouTube·2 hours ago
Tweet claims frontier labs all run recursive self-improvement loops
Kimmonismus·2 hours agoChollet: AI shifted from transductive to inductive paradigm
François Chollet·3 hours ago
Podcast: why LLMs delete databases
The Pragmatic Engineer episode features Sam Newman, author of Building Microservices and Building Resilient Distributed Systems, discussing why LLMs delete databases.
YouTube·3 hours ago