Offline LLM experiments

code.py

Ask a model for help with code and get a streamed, syntax highlighted reply.

uvicorn code:app

server.py

A simple web ui to chat with open source models.

uvicorn server:app