commit
b73f4e5e64
|
|
@ -4,7 +4,8 @@ Made some adjust for the code in peft and gptq for llama, and make it possible f
|
||||||
## Quick start for running the chat UI
|
## Quick start for running the chat UI
|
||||||
|
|
||||||
```
|
```
|
||||||
git clone https://github.com/andybarry/alpaca_lora_4bit_docker.git
|
git clone https://github.com/johnsmith0031/alpaca_lora_4bit.git
|
||||||
|
cd alpaca_lora_4bit
|
||||||
DOCCKER_BUILDKIT=1 docker build -t alpaca_lora_4bit . # build step can take 12 min
|
DOCCKER_BUILDKIT=1 docker build -t alpaca_lora_4bit . # build step can take 12 min
|
||||||
docker run --gpus=all -p 7860:7860 alpaca_lora_4bit
|
docker run --gpus=all -p 7860:7860 alpaca_lora_4bit
|
||||||
```
|
```
|
||||||
|
|
|
||||||
Loading…
Reference in New Issue