HackerTrans
TopNewTrendsCommentsPastAskShowJobs

osbre

no profile record

comments

osbre
·17 dagen geleden·discuss
Laravel has a similar library https://laravel.com/docs/13.x/ai-sdk
osbre
·6 maanden geleden·discuss
"Local LLMs" sounds expensive compared to a 20$ subscription. You'd have to pay for years of usage upfront by purchasing those GPUs.
osbre
·6 maanden geleden·discuss
Sounds like something Dokku's official K3S scheduler meant to solve:

- https://dokku.com/docs/deployment/schedulers/k3s

- https://dokku.com/tutorials/other/deploying-to-k3s
osbre
·2 jaar geleden·discuss
But wouldn't using a connection pool solve this problem of "stressing out the database"? I assumed a single connection from the pool would be considered "occupied" until we hear back from the database.

Or are you saying that processing lots of requests/tasks in Rails while waiting for the database would quickly eat up all the CPU? It seems like a good thing - "resource utilization" = servers should do things whenever possible rather than just waiting. Although now that I think about it you'd only want maximum resource utilization if your database is on a separate server.
osbre
·2 jaar geleden·discuss
> More concurrency is not always ideal

Is this due to increased memory usage? Does the same apply to Sidekiq if it was powered by Fibers?
osbre
·2 jaar geleden·discuss
Thank you! We'll add it on our roadmap
osbre
·2 jaar geleden·discuss
Thank you! We do have one - `runAndWait`. I will shortly update the docs and I agree that using SSE would be more efficient than polling. Will add that next!