Together AI achieves under 100ms AI responses using NVIDIA full stack

Together AI's VP of Kernels Dan Fu explains how they leverage NVIDIA GPUs to deliver AI responses in under 100ms with industry-low token costs. They developed a megakernel that fits an entire model into a single CUDA kernel.