this post was submitted on 05 Jun 2023
11 points (100.0% liked)
Open Source
31063 readers
553 users here now
All about open source! Feel free to ask questions, and share news, and interesting stuff!
Useful Links
- Open Source Initiative
- Free Software Foundation
- Electronic Frontier Foundation
- Software Freedom Conservancy
- It's FOSS
- Android FOSS Apps Megathread
Rules
- Posts must be relevant to the open source ideology
- No NSFW content
- No hate speech, bigotry, etc
Related Communities
Community icon from opensource.org, but we are not affiliated with them.
founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
When I was sick with Covid in April I built Turbopilot, a weekend hack to get code autocomplete models (like GitHub Autopilot) to run locally on low spec machines using the library behind llama.cpp. The models I used were codegen from salesforce and the idea is that if you're running these models locally it's free and you're not sending your source code back to the microsoft/github mothership.
Since then I've not really had time to work on it very much as my day job has been pretty busy but I really want to carry on development. I've got experimental nvidia acceleration building and I'm working on shipping a windows version at the moment.
BTW If anyone is interested, I'm looking for some help and I'm willing to offer some technical mentoring (I have a background in AI/ML and a dozen years exp doing software engineering professionally)