This commit is contained in:
Andy Barry 2023-04-06 00:30:28 -04:00
parent 6130b9bd0f
commit 3076eaf4aa
2 changed files with 2 additions and 0 deletions

View File

@ -23,6 +23,8 @@ Point your browser to http://localhost:7860
## Results
It's fast on a 3070 Ti mobile. Uses 5-6 GB of GPU RAM.
![](alpaca_lora_4bit_penguin_fact.gif)
The model isn't all that good, sometimes it goes crazy. But hey, as I always say, "when 4-bits _you reach_ look this good you will not."

Binary file not shown.

After

Width:  |  Height:  |  Size: 347 KiB