I Hacked Terminal Chat to Use ollama+codellama Locally

9 days ago
3

OOB Win Terminal Chat only works with Azure OpenAI Services... so I hacked it to insert my own dotnet API to forward requests to any OpenAI compliant completions endpoint, and I demo how to set it up with ollama + codellama locally.

Given the amount of time it takes to setup an Azure OpenAI Service and Deploy a Model... especially waiting a day or two for approval to use it... this is probably a faster way to get things up and running! So, why not!

Loading comments...