Deploy open LLMs with vLLM on Hugging Face Inference Endpoints
May 2, 2024 — HuggingFace, LLM, Llama 3
Index
2024 April
Efficiently fine-tune Llama 3 with PyTorch FSDP and Q-Lora
April 22, 2024 — HuggingFace, LLM, Training, GenerativeAI
Deploy Llama 3 on Amazon SageMaker
April 18, 2024 — HuggingFace, LLM, SageMaker, GenerativeAI
Accelerate Mixtral 8x7B with Speculative Decoding and Quantization on Amazon SageMaker
April 2, 2024 — HuggingFace, LLM, SageMaker, GenerativeAI
2024 March
Deploy Llama 2 70B on AWS Inferentia2 with Hugging Face Optimum
March 26, 2024 — HuggingFace, LLM, SageMaker, GenerativeAI
Fine-Tune & Evaluate LLMs in 2024 with Amazon SageMaker
March 12, 2024 — HuggingFace, LLM, SageMaker, GenerativeAI
Evaluate LLMs with Hugging Face Lighteval on Amazon SageMaker
March 5, 2024 — HuggingFace, LLM, SageMaker, GenerativeAI
How to fine-tune Google Gemma with ChatML and Hugging Face TRL
March 1, 2024 — HuggingFace, LLM, RLHF, GenerativeAI
2024 January
RLHF in 2024 with DPO & Hugging Face
January 23, 2024 — HuggingFace, LLM, RLHF, GenerativeAI
How to Fine-Tune LLMs in 2024 with Hugging Face
January 23, 2024 — HuggingFace, LLM, Opensource, GenerativeAI
Scale LLM Inference on Amazon SageMaker with Multi-Replica Endpoints
January 11, 2024 — LLAMA, HuggingFace, LLM, SageMaker