HackerTrans
TopNewTrendsCommentsPastAskShowJobs

ssabev

no profile record

Submissions

Local OpenAI compatible Grok 3 server with a client, CLI and proxy

github.com
3 points·by ssabev·पिछला वर्ष·1 comments

Is our universe trapped inside a black hole?

space.com
7 points·by ssabev·पिछला वर्ष·2 comments

Evaluating Frontier Model Capabilities

klu.ai
4 points·by ssabev·2 वर्ष पहले·0 comments

comments

ssabev
·पिछला वर्ष·discuss
Came here to agree.

Initially I thought it's a bloody stupid idea, however at this stage I reckon we need it or a lot of boomers are going to be ones hotted into singing away all their wealth away.
ssabev
·पिछला वर्ष·discuss
love grok3? can't wait for official api?

now you can run an openai-compatible proxy for all of your "local model" needs.

currently using it as my custom provider in repoprompt

pkg includes: client, cli, and proxy
ssabev
·2 वर्ष पहले·discuss
Would recommend just picking up a gateway that you can deploy and act as an OpenAI compatible endpoint.

We built something like this for ourselves here -> https://www.npmjs.com/package/@kluai/gateway?activeTab=readm....

Documentation is a bit sparse but TL;DR - deploy it in a cloudflare worker and now you can access about 15 providers (the one that matter - OpenAI, Cohere, Azure, Bedrock, Gemini, etc) all with the same API without any issues.