k/llmServer
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
No description
ai
5 commits 1 branch 0 tags 40 KiB
Find a file
Exact
k 8e576ae332 Now handling temperature and max_tokens correctly
2026-03-04 00:55:29 -05:00
bot.py Now handling temperature and max_tokens correctly 2026-03-04 00:55:29 -05:00
model.py Basic version working. 2026-03-03 21:52:30 -05:00
README.md Add readme 2026-03-03 13:42:41 -05:00

README.md

LLM server

A quick script to host my model useing batching. Exists so more interesting projects can use it.