Text-to-LoRA (T2L): Instant Transformer Adaption
🛠️ Installation
Install uv if you don't have uv (see https://docs.astral.sh/uv/getting-started/installation/)
With uv installed, run the following to install the dependencies.
git clone https://github.com/SakanaAI/text-to-lora.git cd text-to-lora # make sure you have `uv` installed # (see https://docs.astral.sh/uv/getting-started/installation/) uv self update uv venv --python 3.10 --seed uv sync # we use the following wheel for installation # you might have to change the wheel to be compatible with your hardware uv pip install https://github.com/Dao-AILab/flash-attention/releases/download/v2.6.3/flash_attn-2.6.3+cu123torch2.3cxx11abiFALSE-cp310-cp310-linux_x86_64.whl uv pip install src/fishfarm
🚀 Demo
Downloading trained T2L
⚠️ You need to download the checkpoints before running any of the demos. ⚠️
⚠️ You need a >16GB GPU to handle both models simultaneously to run any of these demos. ⚠️
uv run huggingface-cli login uv run huggingface-cli download SakanaAI/text-to-lora --local-dir . --include " trained_t2l/* "
... continue reading