HackerTrans
TopNewTrendsCommentsPastAskShowJobs

FitchApps

no profile record

Submissions

Show HN: WebLLM and WebGPU enabled LLM app – CodexLocal

codexlocal.com
3 points·by FitchApps·9 months ago·0 comments

Show HN: CodexLocal – Offline, Privacy-First AI Coding Tutor (WebLLM and RAG)

codexlocal.com
1 points·by FitchApps·9 months ago·0 comments

comments

FitchApps
·29 days ago·discuss
I tried all sorts of automation in the past and always get banned at the end. Not worth it. Use AI or whatever to generate your social media content but always post it manually for best engagement and not getting banned
FitchApps
·4 months ago·discuss
Have you tried WebLLM? Or this wrapper: CodexLocal.com Basically, you would have a rather simple but capable LLM right in your browser using WebLLM and GPU
FitchApps
·4 months ago·discuss
Right. What about to K.I.S.S (Keep It Simple Stupid)? If I need a bunch of agents and various levels of orchestration to simply close a bunch of Jira tasks then we have a problem. Also, what happens in a few years when this start failing and human operators are no longer able to troubleshoot the issue, forget fixing it.
FitchApps
·4 months ago·discuss
I don't think it's about ideas or even the code. It's about execution, marketing, talking to your customers and doing sales. This is something AI can't do...yet
FitchApps
·4 months ago·discuss
This. I'm also using an LLM very similarly and treat it like a knowledgeable co-worker I can ask for an advice or check something. I want to be the one applying changes to my codebase and then running the tests. Ok, agents may improve the efficiency but it's a slippery slope. I don't want to sit here all day watching the agents modify and re-modify my codebase, I want to do this myself because it's still fun though not as much fun as it was pre-AI
FitchApps
·4 months ago·discuss
This is awesome. So your job as a tech lead or agent manager is to make sure the "team" plays nice and stays productive. I wonder if an agent can feel resentment towards another agent, just like a human would. Is there an HR agent that can mitigate the conflict :)
FitchApps
·4 months ago·discuss
"AI Company with Soul" - yeah right until competitors show up / revenue drops / bad quarter results then anything goes. Sadly, this is another large enterprise that puts profits before ethics and everyone's wellbeing
FitchApps
·5 months ago·discuss
So true that's why I love the Google? interview question: how does a modern browser work (basically one needs to understand the entire journey from a file on the server, through DNS, and browser rendering engine). Sadly, this is becoming lost to many folks.

Pre-AI, I worked with Devs that didn't even know what an HTTP request is (difference between GET/POST/etc) - we were building an enterprise software where higher level libraries abstracted that away..With AI, it's becoming even worse now - just ask Claude
FitchApps
·5 months ago·discuss
And get hacked via prompt injection
FitchApps
·5 months ago·discuss
Is it possible to get insurance as an expat living in a foreign country, yet spend time in the states? Would that be a good coverage for retirees that want to split time between US and other countries?
FitchApps
·5 months ago·discuss
New agent framework / platform every week now. It's crazy how fast things move...just when you get comfortable with an AI flow something new comes out...
FitchApps
·5 months ago·discuss
I'm seeing things that are seriously alarming though. Claude can now write better documentation and document things 95% there (we're building a set of MCP tools and API end-points for a large enterprise..) - Claude is already either writing code or fixing bugs or suggesting fixes. We have a PM, who has access to both React and API projects, on our team who saw one of the services return 500; they used Claude to pinpoint the bug to exact database call and suggest a fix. So now, it's quite common for PMs to not only post bugs but also "suggested fixes" from the agents. In a not so distant future, developers here will be simply redundant since PM can just use Claude to code and support the entire app. Right now, they still rely on us for support and deployments but that could go away too.
FitchApps
·5 months ago·discuss
This is all wonderful and all but what happens when these tools aren't available - you lose internet connection or the agent is misconfigured or you simply ran out of credits. How would someone support their business / software / livelihood? First, the agents would take our software writing tasks then they encroach on CI/CD and release process and take over from there...

Now, imagine a scenario of a typical SWE in todays or maybe not-so-distant future: the agents build your software, you simply a gate-keeper/prompt engineer, all tests pass, you're now doing a production deployment at 12am and something happens but your agents are down. At that point, what do you do if you haven't build or even deployed the system? You're like a L1 support at this point, pretty useless and clueless when it comes to fully understanding and supporting the application .
FitchApps
·5 months ago·discuss
100% there....it's getting to a point where a project manager reports a bug AND also pastes a response from Claude (he ran Claude against our codebase) on how to fix the bug..Like I'm just copying what Claude said and making sure the thing compiles (.NET). What makes me sleep at night...for now is the fact that Claude isn't supporting 9pm deployments and AWS Infra support ...it's already writing code but not supporting it yet...
FitchApps
·6 months ago·discuss
Russia doesn't just "visit" your country. Lookup what Ruskiy Mir (Russian world) really means, basically your country gets subjugated by the Russians and I'm not talking about civilized or professional Russian forces - I'm talking about drunk and poor 20yo boys from a remote Russian villages that are now seeing the spoils of western civilization for the first time (do lookup what happened in Bucha, Kyiv suburbs in 2022 at the onset of invasion). Then of course the refusal of the Russians to recognize any other culture or language...the list goes on and on. So - yes, you could escape with a drink but then "If Not Me, Then Who"?
FitchApps
·6 months ago·discuss
The problem with other freedom-loving nations, the EU, etc is that they're a bunch of cowards and I feel like America is the only place that can stand up to the regimes like Iran/China. Who else if not US?
FitchApps
·6 months ago·discuss
Such a cool project. Thanks for building it. Amazing what one can do with a tiny VPS.
FitchApps
·7 months ago·discuss
Text Editor that doesn't use AI :)
FitchApps
·7 months ago·discuss
170k after taxes leaves you with about 130k net, maybe 140k; if you live in a big city and have a family, it's almost impossible to save 100 grand of that 140k. More realistic you would save about 50k and still come out ok, but lets be realistic noone is saving 100k from 170k gross salary
FitchApps
·8 months ago·discuss
Try WebLLM - it's pretty decent and all in-browser/offline even for light tasks, 1B-1.5B models like Qwen2.5-Coder-1.5B-Instruct. I put together a quick prototype - CodexLocal.com but you can essentially a local nginx and use webllm as an offline app. Of course, you can just use Ollama / LM Studio but that would require a more technical solution