Open-Source Reinforcement Learning (RL) & Fine-tuning for LLMs.
Training and customizing LLMs with reinforcement learning is slow, resource-intensive, and difficult for builders to do efficiently.
Unsloth provides open-source RL and fine-tuning tooling with optimized kernels to train custom LLMs much faster using significantly less memory.
AI developers and ML engineers building and fine-tuning custom large language models.
I was at NVIDIA making algorithms like TSNE 2000x faster. I also found and fixed 20+ bugs in open source LLMs like Gemma, Llama, Mistral and Phi. I also maintain the OSS package Hyperlearn making ML faster for NASA & Microsoft engineers.
Hi guys - love building, designing and more. If you ever want help with fine-tuning or LLMs be sure to reach out!