HackerTrans
TopNewTrendsCommentsPastAskShowJobs

munch-o-man

no profile record

Submissions

Show HN: I built a S3 proxy that combines storage from S3/clouds into one target

github.com
2 points·by munch-o-man·4 miesiące temu·1 comments

comments

munch-o-man
·3 miesiące temu·discuss
the first thing you made - as a non-engineer - is a monetized gambling app? ok. I see no issues with this.
munch-o-man
·3 miesiące temu·discuss
yeah but that analogy is sort of false. A better analogy...but then it would make you look absurd...would be "if you don't know how to take apart and re-assemble the engine of a vehicle you shouldn't be allowed to drive it on the road". You get a driver's license if you can remember a few common sense facts and spend a bit of monitored time behind the wheel without doing anything absurdly illegal or injuring/killing somebody
munch-o-man
·3 miesiące temu·discuss
because claude wasn't using enough data center resources we need to give him additional servers in data centers on demand?
munch-o-man
·3 miesiące temu·discuss
why would I need to sign up for something I self host?
munch-o-man
·4 miesiące temu·discuss
how is this any different than the real time stock prices I can get online anyways? I can already ask an agent to analyze stuff for a stock. I'm confused what this offers that is worth paying for. I am also very suspicious of any AI project involving money where all that is posted is a website where I can sign up but no code is shared.
munch-o-man
·4 miesiące temu·discuss
this looks very interesting...I'm gonna give it a test drive later. Threw a star on the repo so I won't forget to come back to it.
munch-o-man
·4 miesiące temu·discuss
at least you didn't put your ticker at seizure-speed like the other post that looks just like this.
munch-o-man
·4 miesiące temu·discuss
I just don't understand the concept of a social network for computer bots...like...is the goal to just use up as much electricity as possible for a product that isn't for people and has no value to advertisers and generates nothing of value? Why would non-real things need to socialize? They aren't people...people need to socialize....computers are just fancy counting machines...they don't have social lives or the concept of social lives. Like, this sounds like a fun high school science experiment if it was run on a small scale but in reality there is no point in something like this existing and I have yet to see anyone explain to me why it should despite having seen posts about social media for ai bots countless times.

Not trying to knock your work, although you didn't even bother to post a description of what you did or why and your only link is to a product site that is painful to the eyes and feels like watching an Indian news station, and you didn't link any code, so I am inclined to believe you are just spamming some crappy ai product that is just super gluing other people's products together haphazardly. Seriously that scrolling ticker on the page makes me want to vomit and have a seizure....it is more visually assaulting than the illegal streaming site I used to watch blacked out dodgers games last year that was covered in communist dating site ads and russian sports betting ads and was hosted in tehran. Ask your bots if they can design a website that doesn't look like a seizure-inducing virus factory.

Prove me wrong, tell us about your project and what issues you ran into and decisions you made. Maybe you actually did something really cool and I just can't tell because your website has temporarily blinded me and left me foaming at the mouth.
munch-o-man
·4 miesiące temu·discuss
seems pretty interesting. So is this meant for actual container/workload orchestration or just monitoring/managing what is already running? Trying to figure out how this compares to something like Nomad.
munch-o-man
·4 miesiące temu·discuss
this is pretty neat. I often toy with making music related shit...I love music theory...went to a music conservatory and then accidentally ended up in software years later...simple ear training is a skill that especially guitar players lack and having an easy way to drill yourself in private is great!

FYI when I went through the third cycle of it, it got stuck cycling through keys but repeating the major arpeggio followed by the note to identify being the ii pattern probably 4 times. Not sure if that was random chance or an actual issue...but very cool. Where is the code? I'd love to star it so that I remember to keep an eye on it..or even drill myself every now and then haha.

This probably won't mean much to a lot of people here, especially since there is sort of an assumed level of understanding going in (scale degrees, roman numeral chord notation with uppercase for major and lowercase for minor, or what a cadence is or what those different types of cadences are) but for those of us that went to music school...especially those who hadn't had a traditional music education from an early age with ear training...definitely would have actually drilled myself with this.
munch-o-man
·4 miesiące temu·discuss
how does it compare to lynx and links2?
munch-o-man
·4 miesiące temu·discuss
I think I saw this on reddit earlier. Looks neat...I starred your repo on github so I can remember to check it out later when I have time.
munch-o-man
·4 miesiące temu·discuss
[dead]
munch-o-man
·4 miesiące temu·discuss
I mean...it works just fine without internet...host your own registry...or just build your own from Dockerfiles locally. Not saying it is the right use case for everything but I'm confused what you mean by docker doesn't work without the internet. Neither does pip, rubygems, apt, etc...unless you build locally or host your own repository. Can you elaborate on what exactly you mean because you probably have a point that I am just missing.
munch-o-man
·4 miesiące temu·discuss
author here: I've been running this in my homelab nomad/consul/vault cluster for a while now and it has been working great. My temporal job that does nightly backups of nomad/consul/vault/postgres now has an extra step to push to s3-orchestrator too and if it gets an error that no backend has available space it will delete the oldest backup of that type and then try again. Right now I have it doing "spread" routing between OCI and Cloudflare s3-compatible storage because they offer the best always-free s3 storage and I was already using cloudflare and running four nomad clients on oracle cloud connected to my cluster via wireguard (I would never give oracle a cent of my money but when they are offering 26gb of compute in always-free tier I'll take every bit of it thanks).

The coolest way to test this out is to just clone it and then run either:

make nomad-demo

make kubernetes-demo

that will spin up the docker-compose crap used for integration testing (two minio instances and a postgres) then start kubernetes via k3d or nomad via -dev mode, build the docker image, ingest it, run it, and print out a handy list of urls for different dashboards/metrics/ui/etc. The grafana dashboard in the repo is automatically ingested by grafana in the two "-demo" modes so you can literally run one command to run it and immediately play with the ui, see visualizations of the metrics, and start playing with it in a safe sandboxed environment.

For people that aren't just trying to get as much free storage as possible the storage and api/ingress/egress quotas can still be super useful in cost management since you can cap yourself.

The other cool use is if you needed data replicated across two different clouds for [reasons] this will do all that work for you if you set a replication factor and your application doesn't have to know anything about it...just point it at this instead of the actual s3 backend.

Also the ability to drain a backend could be super useful if you are trying to get off a certain cloud without taking downtime.

This is engineered to be highly durable...instead of failing it degrades and returns to healthy when conditions improve and the postgres is back...and it stops all writes when postgres is down since no usage would be tracked.

also, if you have an existing bucket that you want to bring under management by the s3-orchestrator it has sync functionality...the only thing it can't import is the monthly api-calls/ingress/egress from before the sync.

I'm open to all advice and comments. Pretty nervous sharing this.