ilotoki_thu
/
alpaca_lora_4bit
2
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

Merge branch 'main' of github.com:andybarry/alpaca_lora_4bit_docker

This commit is contained in:
Andy Barry 2023-04-06 00:31:29 -04:00
parent 3076eaf4aa 0a51b6b0ee
commit 1b8b6e193c
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
README.md
View File

@ -1,7 +1,7 @@
# Run LLM chat in realtime on an 8GB NVIDIA GPU
## Dockerfile for alpaca_lora_4bit
Based on https://github.com/johnsmith0031/alpaca_lora_4bit
This repo is a Dockerfile wrapper for https://github.com/johnsmith0031/alpaca_lora_4bit
## Use
Can run real-time LLM chat using alpaca on a 8GB NVIDIA/CUDA GPU (ie 3070 Ti mobile)