109 B
109 B
LLM server
A quick script to host my model useing batching. Exists so more interesting projects can use it.
A quick script to host my model useing batching. Exists so more interesting projects can use it.