diff --git a/README.md b/README.md new file mode 100644 index 0000000..4901808 --- /dev/null +++ b/README.md @@ -0,0 +1,3 @@ +# LLM server +A quick script to host my model useing batching. +Exists so more interesting projects can use it. \ No newline at end of file