Open-Source Infrastructure for LLMs

Slides
Video Lecture

References

  1. https://github.com/pytorch/torchtune
  2. https://github.com/vllm-project/vllm
  3. https://huggingface.co/models
  4. https://lmsys.org/
  5. https://ollama.com/
  6. https://github.com/ggerganov/llama.cpp