HackerTrans
TopNewTrendsCommentsPastAskShowJobs

osbre

no profile record

comments

osbre
·hace 17 días·discuss
Laravel has a similar library https://laravel.com/docs/13.x/ai-sdk
osbre
·hace 6 meses·discuss
"Local LLMs" sounds expensive compared to a 20$ subscription. You'd have to pay for years of usage upfront by purchasing those GPUs.
osbre
·hace 6 meses·discuss
Sounds like something Dokku's official K3S scheduler meant to solve:

- https://dokku.com/docs/deployment/schedulers/k3s

- https://dokku.com/tutorials/other/deploying-to-k3s
osbre
·hace 2 años·discuss
But wouldn't using a connection pool solve this problem of "stressing out the database"? I assumed a single connection from the pool would be considered "occupied" until we hear back from the database.

Or are you saying that processing lots of requests/tasks in Rails while waiting for the database would quickly eat up all the CPU? It seems like a good thing - "resource utilization" = servers should do things whenever possible rather than just waiting. Although now that I think about it you'd only want maximum resource utilization if your database is on a separate server.
osbre
·hace 2 años·discuss
> More concurrency is not always ideal

Is this due to increased memory usage? Does the same apply to Sidekiq if it was powered by Fibers?
osbre
·hace 2 años·discuss
Thank you! We'll add it on our roadmap
osbre
·hace 2 años·discuss
Thank you! We do have one - `runAndWait`. I will shortly update the docs and I agree that using SSE would be more efficient than polling. Will add that next!