HackerTrans
TopNewTrendsCommentsPastAskShowJobs

osbre

no profile record

comments

osbre
·17 дней назад·discuss
Laravel has a similar library https://laravel.com/docs/13.x/ai-sdk
osbre
·6 месяцев назад·discuss
"Local LLMs" sounds expensive compared to a 20$ subscription. You'd have to pay for years of usage upfront by purchasing those GPUs.
osbre
·6 месяцев назад·discuss
Sounds like something Dokku's official K3S scheduler meant to solve:

- https://dokku.com/docs/deployment/schedulers/k3s

- https://dokku.com/tutorials/other/deploying-to-k3s
osbre
·2 года назад·discuss
But wouldn't using a connection pool solve this problem of "stressing out the database"? I assumed a single connection from the pool would be considered "occupied" until we hear back from the database.

Or are you saying that processing lots of requests/tasks in Rails while waiting for the database would quickly eat up all the CPU? It seems like a good thing - "resource utilization" = servers should do things whenever possible rather than just waiting. Although now that I think about it you'd only want maximum resource utilization if your database is on a separate server.
osbre
·2 года назад·discuss
> More concurrency is not always ideal

Is this due to increased memory usage? Does the same apply to Sidekiq if it was powered by Fibers?
osbre
·2 года назад·discuss
Thank you! We'll add it on our roadmap
osbre
·2 года назад·discuss
Thank you! We do have one - `runAndWait`. I will shortly update the docs and I agree that using SSE would be more efficient than polling. Will add that next!