Inferact was founded by the creators and core maintainers of vLLM, the de facto standard open-source inference engine. T...
AI teams struggle to run fast, efficient model inference across diverse and rapidly changing model architectures and accelerator hardware.
Inferact builds open-source and commercial inference systems (based on vLLM) that provide high-performance, day-zero compatible LLM serving across 200+ model architectures and major accelerator platforms.
Developers and AI/ML platform teams at companies and cloud providers deploying and serving large language models in production.