HackerTrans
TopNewTrendsCommentsPastAskShowJobs

chasers

no profile record

comments

chasers
·há 2 anos·discuss
Not a free car because I paid them.

Funny enough their dashboard showed a payment so I just screenshot that for them to look up in their own db!
chasers
·há 2 anos·discuss
Rivian lost my full payment for an R1S.
chasers
·há 2 anos·discuss
btw recently cleaned up my wal cache busting code quite a bit if you're interested.

https://github.com/Logflare/logflare/blob/main/lib/logflare/...

Need to make a lib out of this!!
chasers
·há 3 anos·discuss
I've helped with this one. Happy to answer any questions also.
chasers
·há 3 anos·discuss
We use :telemetry to collect usage data per tenant for Supabase Realtime.

We do this for rate limiting but it also makes it very easy for us to attach a listener (https://github.com/supabase/realtime/blob/main/lib/realtime/...) which ships these (per second) aggregates to BigQuery (via Logflare), which then the billing team can aggregate further to display and actually bill people with.
chasers
·há 3 anos·discuss
We just had some orphaned database connections (our bug) to a tenant and were able to find and kill them because of Erlang's observability:

https://gist.github.com/chasers/e4aa33625e6ea39ecb89f03383dd...

edit: link to gist
chasers
·há 3 anos·discuss
Yo :D This is what Supabase Realtime does!

https://github.com/supabase/realtime

Spin up a Supabase database and then subscribe to changes with WebSockets.

You can play with it here once you have a db: https://realtime.supabase.com/inspector/new
chasers
·há 3 anos·discuss
supabase dev here...

this was a very fun load test to run. happy to answer any questions.

shoutout to José Valim and the Dashbit team for the help on Supavisor. elixir and erlang are amazing tools.

connection limits, even with pgbouncer, have been a big support burden for us. supavisor should let us be more liberal with connections we allot to folks.

supavisor is rolled out and available for all projects to use today. contact support[0] and we can expose the supavisor connection string in your dashboard. we'll be proactively exposing it to everyone gradually over the next ~1 month. we'll run pgbouncer and supavisor both for you for probably ~5 months before you need to switch to supavisor.

also very excited at the potential features a custom postgres proxy can unlock.

[0] https://supabase.com/dashboard/support/new
chasers
·há 3 anos·discuss
yes otel across all of Supabase in on our radar for sure. we just added ingest support for otel payloads to Logflare (docs coming soon) so when we have that you'll get them on the platform and locally.

if you haven't seen the metrics endpoint we do have an endpoint you can scrape for all your Supabase metrics, and we just improved the example repo quite a bit on how to ship those somewhere: https://github.com/supabase/grafana-agent-fly-example/
chasers
·há 3 anos·discuss
> although ensuring that only a single client is writing to a database at any time is (mostly) left to the application

Sounds like trouble.
chasers
·há 3 anos·discuss
Yeah as in zero ops needed. Maybe NoOps.
chasers
·há 3 anos·discuss
I hadn't seen WalEx. Looks rad!!
chasers
·há 3 anos·discuss
Phoenix.PubSub is basically a noop service. It really just works.

If discovering nodes is difficult in your env, try using a listen/notify libcluster strategy:

https://github.com/supabase/supavisor/blob/main/lib/cluster/...
chasers
·há 3 anos·discuss
Triggers can affect throughput quite a bit on busy tables.

And we didn't want people schemas polluted with triggers.

But also we use Erlang distribution and Phoenix.PubSub because with a global network clients connected to the same node in the same region will get normal Broadcast messages to each other faster. If we ran them through Postgres or Redis the added latency wouldn't work for a global thing.
chasers
·há 3 anos·discuss
Accepting pull requests if anyone is interested :D
chasers
·há 3 anos·discuss
Happy Livebook user here!

Congrats on all the new stuff this week. Really great work.
chasers
·há 3 anos·discuss
Also fwiw, if this is self-hosted I'm sure you can export them from BigQuery in an acceptable format.

And if this is Supabase hosted, you can reach out to support and we can do that for you.

Log drains is high on the list for the hosted platform too.
chasers
·há 3 anos·discuss
I work on logs at Supabase.

What format(s) would you need?
chasers
·há 3 anos·discuss
For sure > https://github.com/supabase/supavisor/issues/69
chasers
·há 3 anos·discuss
Appreciate the detailed feedback here.

Frankly these are all things I've wanted to address. We've just had to prioritize other tasks.

We're definitely going to keep iterating.

Thanks for taking the time to try it!