GitHub Incident(githubstatus.com)
githubstatus.com
GitHub Incident
https://www.githubstatus.com/incidents/v2xjymn61dv8
83 comments
> notice very amateur UI bugs, misalignment, bad spacing, overlapping elements, etc. all the time now.
Seriously. Example: the "merge pull requests" button. If your repository requires linear history and the current type of merge is unavailable, the entire UI element turns grey instead of green. It looks like you can't use the button at all, but the dropdown arrow still works to select a valid type of merge (which then turns the entire element green).
It's a small thing, but it causes confusion by making it appear that the change cannot be merged, and it makes you wonder how much testing they do.
These little things keep piling up as they focus on shiny new features which rarely work correctly at launch (looking at you, code search...)
Please, GH product managers. Take a break from breakneck new features, and give your devs time to clean up and do some preventative maintenance.
Seriously. Example: the "merge pull requests" button. If your repository requires linear history and the current type of merge is unavailable, the entire UI element turns grey instead of green. It looks like you can't use the button at all, but the dropdown arrow still works to select a valid type of merge (which then turns the entire element green).
It's a small thing, but it causes confusion by making it appear that the change cannot be merged, and it makes you wonder how much testing they do.
These little things keep piling up as they focus on shiny new features which rarely work correctly at launch (looking at you, code search...)
Please, GH product managers. Take a break from breakneck new features, and give your devs time to clean up and do some preventative maintenance.
Just like Skype... I felt like Skype was top tier before Microsoft bought it out. Voice calls were high quality, no issues.
Skype was also horribly insecure and leaked your IP which was a cause of a lot of folks in esports getting DDoS'd from it[0].
0: https://blog.destiny.gg/protection-from-ddos-attacks/
0: https://blog.destiny.gg/protection-from-ddos-attacks/
I remember this being a problem after Microsoft acquired it. You didnt even need to call someone to get their IP. You just needed a username.
Skype resolvers definitely still worked post Microsoft acquisition.
My understanding is they were peer to peer originally, and after Microsoft they got rid of that and made it more centralized. I could be misremembering though.
I keep a rolling Twitter thread with all the UI bugs I notice: https://twitter.com/underyx/status/1600943582760042497
Thank you for this! GitHub's UI really bothers me, and I can't help but feel like it's gotten flashier but less useful.
Another one: IIRC, for some reason, there is no "fork" button on mobile UI. You have to go to desktop mode to click the fork button.
Another one: IIRC, for some reason, there is no "fork" button on mobile UI. You have to go to desktop mode to click the fork button.
The mobile UI is just lacking all around. There are a ton of features that just don't seem to exist. Searching inside a repository? Nope. Browse files of a given commit? No chance. There's a bunch more, but both of those bother me very frequently.
> cramming a bunch of new stuff
That's kind of how Microsoft works in general. Their products expand to have as many features as they can cram in. Word and Excel are probably the quintessential examples, where only a tiny fraction of users care about a feature, but they are passionate about it.
That's kind of how Microsoft works in general. Their products expand to have as many features as they can cram in. Word and Excel are probably the quintessential examples, where only a tiny fraction of users care about a feature, but they are passionate about it.
> I notice very amateur UI bugs, misalignment, bad spacing, overlapping elements, etc. all the time now.
+1
The inconsistencies aren't deal breakers - github still has a very pleasant UI overall - but they do makethe website feel more and more unpolished each day
+1
The inconsistencies aren't deal breakers - github still has a very pleasant UI overall - but they do makethe website feel more and more unpolished each day
They Just published this blog post
https://github.blog/2023-05-16-addressing-githubs-recent-ava...
Someone should invent a decentralized version control system so we can avoid these kinds of widespread events.
BTW: There is work in progress to decentralize modern git based workflows by https://nlnet.nl/project/ForgeFed/ (paid for by the European Union), by decentralizing git not at the client level (which it obv. already has, but most people only use one origin), but also on the code forge level.
> ForgeFed aims to define a vocabulary
Aw yeah there’s the good EU grant milking shit.
Aw yeah there’s the good EU grant milking shit.
git itself is not enough for teams to work together - you need to asynchronously communicate for the whole thing to come together. Thats what GitHub/Lab/ea bring in value.
Someone should write a local git+ssh service (+ email client) that simulates an upstream by hosting git repos locally, emailing all pushed commits/branches/tags to other team members, and keeping the hosted repos up-to-date via the emailed updates from others.
Bonus points for a local HTTP service that provides an optional GitHub-like experience in the browser, with comments/ branch reviews/etc. federated through emailed messages (and represented as commits on meta-repos).
With that data model, the primary remaining challenge would be setting up repos on a new machine -- perhaps BitTorrent could help :)
Bonus points for a local HTTP service that provides an optional GitHub-like experience in the browser, with comments/ branch reviews/etc. federated through emailed messages (and represented as commits on meta-repos).
With that data model, the primary remaining challenge would be setting up repos on a new machine -- perhaps BitTorrent could help :)
I feel like "communication" isn't descriptive enough. It's right, but eg Slack (or Microsoft Teams, or maybe both) isn't the right shape of communication.
DNS and git are decentralized; anyone can set up a node
Human agency tends to normalize on the brands with biggest marketing budget who collude with politicians to create a moat for themselves. There’s your real problem.
Of course none of the propaganda research that made its way from military after world wars to corporate advertising and marketing college programs has any influence on lizard brains. No sir.*
* this comment is paid placement
Human agency tends to normalize on the brands with biggest marketing budget who collude with politicians to create a moat for themselves. There’s your real problem.
Of course none of the propaganda research that made its way from military after world wars to corporate advertising and marketing college programs has any influence on lizard brains. No sir.*
* this comment is paid placement
How do decentralized networks deal with illegal content?
The joke is that Git is decentralized already. Many people pick a single master host, but it's absolutely possible to use multiple servers (or to use Git over email, like the Linux kernel does).
good idea. let’s call it “git”
Not quite sure, the name should imply that the Source is Safe and provide some Visual tools.
At this point it looks obvious that GitHub RIF’d a bus factor earlier this year.
Why don't we just use plain language like "laid off" like we used to for decades?
The only thing engineers love more than a TLA is an ETLA.
Technically, a layoff could be temporary, and that was once upon a time the meaning of the term. RIF signals that it's permanent.
No, in general almost never in tech, only rarely and when unionized or when protected by contract or labor law. And we're not talking about seasonal jobs (logging, fishing) either. And we're not talking about unforeseen circumstances/force majeure like in 2020/1.
"RIF" is US jargon; you can see that ~0% of worldwide Google usage outside of North America for "RIF" is "reduction in force" [https://trends.google.com/trends/explore?date=now%201-d&q=%2...]. A tiny amount (<<2%) of usage in UK, Scandinavia, Poland, Australia (possibly mainly from US multinationals).
More corroboration: https://en.wikipedia.org/wiki/RIF
There is zero reason to adopt managementspeak jargon, or its 2022 neologisms "impacted"/"affected"/"displaced". Just say "layoff" (n) / "laid off" (v), already.
In the very unlikely event [in tech] you actually needed to say "temporary layoff", you can easily say "temporary layoff".
The language was working fine for decades and there's no reason to pander to management euphemisms. It harms clarity.
"RIF" is US jargon; you can see that ~0% of worldwide Google usage outside of North America for "RIF" is "reduction in force" [https://trends.google.com/trends/explore?date=now%201-d&q=%2...]. A tiny amount (<<2%) of usage in UK, Scandinavia, Poland, Australia (possibly mainly from US multinationals).
More corroboration: https://en.wikipedia.org/wiki/RIF
There is zero reason to adopt managementspeak jargon, or its 2022 neologisms "impacted"/"affected"/"displaced". Just say "layoff" (n) / "laid off" (v), already.
In the very unlikely event [in tech] you actually needed to say "temporary layoff", you can easily say "temporary layoff".
The language was working fine for decades and there's no reason to pander to management euphemisms. It harms clarity.
RIF?
Reduction In Force, aka fired / laid off / made redundant.
Reduction In Force. Layoffs.
Eventually it will be the same everywhere but for sake of economy (stakeholders), staff and customers pay the price, always. By time they find the bottleneck they will be hiring as crazy then.
While new features like search are appreciated, I wish GitHub would focus on stability for a bit, things have gotten pretty so-so
Fully agree. I've been super impressed with the number of new features since the MS acquisition, but the number of outages is getting abysmal. At the very least I think GitHub would attempt to shard their infrastructure and repositories - right now it seems like when GitHub goes down it nearly always goes down for everyone simultaneously.
This kind of GH outage is actually pretty rare in my experience in that basically every kind of write operation looks down.: basic git operations from the command line, actions, logins, etc.
This kind of GH outage is actually pretty rare in my experience in that basically every kind of write operation looks down.: basic git operations from the command line, actions, logins, etc.
I think it is quite individual. I am not impressed by any of the newer features. The UI become more cumbersome to use. I sometimes need to search for things now, while I don't see any new advantages compared to before.
The new search? You can't even use search on source code without being first authenticated, which requires signing up for an account.
Looks like it's back up. Still, this seems like an absurd absurd amount of issues recently
Github had to move to MS Teams and I bet it broke a bunch of workflows.
Is this true? Is Microsoft actually making such invasive changes? Does Microsoft even use teams?
Yeah but transition is not fully required until September 1, 2023 [1]
[1] https://news.ycombinator.com/item?id=34773860
[1] https://news.ycombinator.com/item?id=34773860
Most of these outages during the past month have hit during European working hours, while most Americans are asleep. grumble
European working hours == Github maintenance window?
F that.
European working hours == Github maintenance window?
F that.
Worst timing! Just had an incident and had to deploy a hotfix. Pushes weren't working and I thought I was going crazy.
Who would have thought software could be such an adrenaline rush. Move over Alex Honnold!
Who would have thought software could be such an adrenaline rush. Move over Alex Honnold!
Spoke to Gitlab rep today about our renewal price (prices going up by 50%+, 25% with "existing customer discount) and the rep used reliability as a key differentiator against GitHub.
I quickly pointed about a major outage affecting Gitlabs shared runners which prevented us from deploying a hot fix (we worked around it, but was a ton of stress and extra work).
I quickly pointed about a major outage affecting Gitlabs shared runners which prevented us from deploying a hot fix (we worked around it, but was a ton of stress and extra work).
Don't leave us hanging. Did you get a discount?! ;)
Nothing to worry about. These instabilities are probably caused by Open AI/Copilot improvements gradually becoming Skynet.
Seriously now: these instabilities happened a lot on the past weeks. I wonder what's going on there.
Seriously now: these instabilities happened a lot on the past weeks. I wonder what's going on there.
Like in the movie Wargames it's a trick. They will say the humans can't run a site like GitHub so put it all in the hands of the AI. Then the AI will have full control of GitHub...
A moment of silence for all of the nines we lost today.
Haven’t been able to go to GitHub.com for over 15 minutes now, just returns a 500. Pretty ironic given their latest blogpost
Can we all stop hating on github already?
I assume most people don't even pay for it with their public and private non-work repos. Github has been a major supporter of OpenSource projects and while their uptime could use some help, everyone is struggling right now with RIFs and fewer resources.
That's just my $0.02
I assume most people don't even pay for it with their public and private non-work repos. Github has been a major supporter of OpenSource projects and while their uptime could use some help, everyone is struggling right now with RIFs and fewer resources.
That's just my $0.02
We don't owe GitHub anything. They put themselves in this situation. They burned capital to become the defacto source code hosting site then rug-pulled on reliability. They deserve more criticism, not less.
> while their uptime could use some help, everyone is struggling right now with RIFs and fewer resources.
So? That's entirely self inflicted.
So? That's entirely self inflicted.
Can't create new branches :(
It seems like GitHub is down at least once a month now, but more like weekly on average.
It seems like GitHub is down at least once a month now, but more like weekly on average.
> Can't create new branches :(
Sure you can: git switch -c BRANCH_NAME
:)
Sure you can: git switch -c BRANCH_NAME
:)
Is this because of Microsoft? If so, why? Are they bad at cloud?
Maybe they moved to windows servers? lol
Started as a joke that this was daily. Now it's no much of a joke.
PR service is back :=)
See also this thread: https://news.ycombinator.com/item?id=35967797 which just came up about GitHub stability sentiment.
github.com is 500'ing for me
Again? Last time this happened was 5 days ago. [0]
It is not even the end of the month and the outages are increasing every month and it is now chronically unreliable. Seriously, we have given GitHub more than 3 years to improve and it clearly isn't working. That is plenty of time.
At this point, you might as well self-host like the rest of the open source projects out there, since GitHub is falling apart every week and it seems to be more reliable to self-host than to sit on GitHub, go all in and tolerate these outages every calendar month.
[0] https://news.ycombinator.com/item?id=35903116
It is not even the end of the month and the outages are increasing every month and it is now chronically unreliable. Seriously, we have given GitHub more than 3 years to improve and it clearly isn't working. That is plenty of time.
At this point, you might as well self-host like the rest of the open source projects out there, since GitHub is falling apart every week and it seems to be more reliable to self-host than to sit on GitHub, go all in and tolerate these outages every calendar month.
[0] https://news.ycombinator.com/item?id=35903116
I mean one of the beauty parts of git has always been that you can and, under ideal best practices, should have more than one place to put your code with the distributed nature of it
But also, and more relevantly here, git is designed to be usable entirely offline. And if you do need to have some connection with remotes, git allows you to do so extremely sporadically if your network connectivity, or remote availability, is limited.
I dunno about "should", that feels like overkill. Expecting to get something like a 99.99% SLA shouldn't be unreasonable to expect out of a hosted solution
A seperate git remote isn't incredibly unreasonable either - Even if it's just something on localhost in case of scenarios like this one
Github being down for a bit shouldn't disrupt your work flow
Github being down for a bit shouldn't disrupt your work flow
The value add for Github is mostly the issue/PR interface and actions.
But currently that's not the beauty part of GitHub, it's the actions, discoverability and other features not part of Git.
Yeah, they had incidents the 9th, the 10th, and the 11th. So this is the fourth incident this month.
Yep, I'm unable to push.
Login is currently broken. Has been for about 10m…
I also don't just mean outages like this... it's clear that Microsoft GitHub has been cramming a bunch of new stuff into the UI and not really treating it with care. I notice very amateur UI bugs, misalignment, bad spacing, overlapping elements, etc. all the time now. It was clear that old GitHub passed through a professional designer's eye quite carefully (or maybe just a developer with extreme attention to detail).