Pathway BDH post-transformer matches GPT2 scaling from 10M to 1B params
Post-transformer architecture BDH from Pathway matches GPT2 scaling from 10M to 1B params trained from scratch, and runs on standard GPUs.
1 source
Daily brief
Get tomorrow's AI brief in your inbox
More stories today
- Gemma team to hold special event on August 20
- Situational Awareness invests $400M in chip startup Source Foundry
- Developer creates ChipTycoon to learn chip manufacturing via LLM simulation
- Reddit user creates AI-generated Big Bang Theory sitcom with ComfyUI
- Prompt injection is the most common way scammers attack people and agents