Warning: Turing cards are not supported on Ubuntu 24 due to compatibility with flash-attn 1.x. flash-attn 2.x plans to support Turing cards in the future but for now are Ampere and up. pip3 install flash-attn==1.0.9 <– Latest 1.x release Install for Turing cards on Ubuntu 22 Configuration documentation for .yaml files: https://axolotl-ai-cloud.github.io/axolotl/docs/config.html – https://modal.com/docs/examples/llm-finetuning HTTP …
Continue reading “Install Axoltol on Ubuntu 24 with Nvidia Cuda 12.”