Ask HN: Cheapest way to use LLM coding assistance?

3 pointsby iamlucaswolf2 anni fa4 comments

I would like to toy around with LLM assistance (Chat/Copilot) for my coding side projects. Given that I will only use this sporadically (20hrs per week max, with variation between weeks), I was wondering if there was a cheaper way to access these tools than paying for an OpenAI/GitHub Copilot subscription.

Has someone here done the math on self-hosting on the cloud/running locally/using the APIs directly/just paying for the subscriptions?

Some additional details on my specific situation (but also interested in general considerations):

- I’m living in Germany (26ct/kWh, no access to Claude) - I already have access to a box with 64GB RAM, no GPU though)

4 comments

b-mmxx2 anni fa

Cody was mentioned already. Continue [0] is another tool that you could give a shot, load local llm etc.

[0] https://github.com/continuedev/continue

AtomicOrbital2 anni fa

checkout the cody extension https://github.com/sourcegraph/cody available for various editors like vscode

iamlucaswolf2 anni fa

Thanks, that seems to be exactly what I was looking for!

Any insights on the business model? Is this just to advertise the pro tier or do they monetize usage in another way (e.g. selling training data)?

jdorfman2 anni fa

Advertise pro. Sourcegraph doesn't sell or retain data with any LLM providers for both free and pro versions https://sourcegraph.com/terms/cody-notice