Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
Show HN: I built local copilot alternative using Codellama (visualstudio.com)
38 points by ex3ndr on Nov 21, 2023 | hide | past | favorite | 6 comments
Hey, HN!

I was trying to find a good Copilot alternative since my experience with copilot degraded a lot and recent OpenAI drama leaves me no hope for improvement and i decided to take a look at self-hosting options. At the same time Copilot net is a small one - just 12b parameters and 2k of context. You can run much bigger networks locally in 2023.

I have figured out that there are no good local options: most of the VS Code plugins simply connect neural networks to the code while copilot has extensive post and pre processing steps. Some of them still work with original copilot plugin (ie sends data to MS), some require complicated setup to make it work.

I implemented very basic ones to check if this would work and in my experience it works really good and i wanted to share it on HN. Feedback is appreciated!

Sources are here: https://github.com/ex3ndr/llama-coder



I think this tool can be extremely valuable for companies that value privacy and data integrity. I see how much data is collected by Github Copilot, so a self-hosted solution is a must-have.


I have a theory that you can fine tune them as well on consumer gpus on your codebase, which would be even more interesting for self hosting.


Nice work, thanks for making it! A few nice-to-haves: 1. it didn’t mention in readme that ollama has to be started manually in terminal. But I figured that out. 2. have a short video showing how it works in coding work, especially for people who never used gh copilot.


Yeah, this is my plans to add as well. I want to refine it a little bit from coding standpoint first.


Looks interesting! What are the main differences between this and https://github.com/TabbyML/tabby ?


That looks promising - will give it a try tomorrow




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: