k/llmServer
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
No description
ai
4 commits 1 branch 0 tags 40 KiB
Find a file
k a37d05a2de basic version of OpenAI api implimented
2026-03-04 00:28:46 -05:00
bot.py basic version of OpenAI api implimented 2026-03-04 00:28:46 -05:00
model.py Basic version working. 2026-03-03 21:52:30 -05:00
README.md Add readme 2026-03-03 13:42:41 -05:00

README.md

LLM server

A quick script to host my model useing batching. Exists so more interesting projects can use it.