Visualizing observed deaths using polar coordinates(mcculley.github.io)
mcculley.github.io
Visualizing observed deaths using polar coordinates
https://mcculley.github.io/VisualizingObservedDeaths/
73 comments
> the area under the excess deaths is misleadingly large
Yes, it's always a trade-off of course, but I generally prefer to sqrt() the radial axis of this kind of plot so it is equal-area.
Yes, it's always a trade-off of course, but I generally prefer to sqrt() the radial axis of this kind of plot so it is equal-area.
Author here. That is a good idea. I will try that.
I have regenerated the graphs to use the square root of the count as the radius to keep the area constant, as others have suggested. I appreciate the feedback.
Hey, nice one — I’m glad I could give a useful suggestion…
Unfortunately it doesn’t make the numbers less tragic.
Unfortunately it doesn’t make the numbers less tragic.
Curious how this works, trying to do the maths in my head, but polar integration not my strong subject.
Area of a slice is angle/2 x r^2.
Whole circle (angle = 2 x pi) is pi x r^2
Whole circle (angle = 2 x pi) is pi x r^2
>It’s important to look at and account for the number of deaths directly attributed to COVID, isn’t it?
Some people don't trust that data. I've heard people tell me that when COVID started the hospitals started marking everyone who died as having COVID regardless of what the real cause was.
>Shared hundreds of times on Facebook, posts claim: “Every time a hospital admits, discharges, or loses a patient to Covid-19, they are compensated 15% more according to the CARES ACT, SEC 4409”. The posts also say that New York City hospitals are “inflating all of their #coronavirus numbers” to take advantage of this section of the act.
https://www.reuters.com/article/uk-factcheck-more-money-for-...
Some people don't trust that data. I've heard people tell me that when COVID started the hospitals started marking everyone who died as having COVID regardless of what the real cause was.
>Shared hundreds of times on Facebook, posts claim: “Every time a hospital admits, discharges, or loses a patient to Covid-19, they are compensated 15% more according to the CARES ACT, SEC 4409”. The posts also say that New York City hospitals are “inflating all of their #coronavirus numbers” to take advantage of this section of the act.
https://www.reuters.com/article/uk-factcheck-more-money-for-...
I've heard that often enough from a family member, often condensed into "they didn't die of COVID, they died with COVID" (which let to the obvious shot back later that year from me being "they didn't die of the vaccine, they died with the vaccine").
There is obvious borderline cases when COVID merely accelerated another disease (heart failure), but I bet in 99% of cases, the ultimate cause of death is one or multiple organ failure due to COVID.
There is obvious borderline cases when COVID merely accelerated another disease (heart failure), but I bet in 99% of cases, the ultimate cause of death is one or multiple organ failure due to COVID.
The thing these graphs show (and I agree with the criticism that plotting it in polar makes the excess volume look much larger) is that you can completely ignore why anyone died and still see a very clear pattern that 2020 stands out as very different than previous years, and the plot of the delta between 2020 and those other years exactly matches the numbers that CDC attributes to COVID-19.
In other words, even if you question their categorization of deaths, it’s impossible to deny that something out of the ordinary caused 600k excess deaths in the US, and that “something” happened to coincide perfectly with the COVID-19 surges.
In other words, even if you question their categorization of deaths, it’s impossible to deny that something out of the ordinary caused 600k excess deaths in the US, and that “something” happened to coincide perfectly with the COVID-19 surges.
The important bit is the number of excess deaths, which is higher than previous 5 years' averages.
To draw a parellel, if someone started getting more tips at the restaurn they worked at, or more Tinder matches than usual, they should notice "Hey, something's changed..." and wonder what the reason behind it is..
To draw a parellel, if someone started getting more tips at the restaurn they worked at, or more Tinder matches than usual, they should notice "Hey, something's changed..." and wonder what the reason behind it is..
The problem is, that some countries do not report covid properly, because its "defeated" and thus no longer allowed to appear in propaganda. Covid still exists, but is written down as pneumonia - or another "wasting" disease.
This creates the illusion, if one takes those countries media for real, that in other countries the disease is not as ravaging or non-existant. One should trust democratic countries data more and signal distrust on data/ positions / declarations from authoritarian regimes.
This however is not happening much on online plattforms, were one dictators "cheerful" lies are equally loud represented next to a loyal servant of a democratic state giving "grim" news.
The platforms thus help to creates the impression, that authoritarian regimes are dealing "better" with the situation and those wishing for a return to the "before" times, seeing those before times seemingly alive, thus steer towards totalitarian propaganda.
Lies for money subvert the system allowing to sell lies for money as a business model.
This problem solves itself.
If a government is caught lying, its previous statements to a fact should be auto-corrected and future statements be overwritten with a extrapolated truth, given by someone proofen to be trust worthy.
This creates the illusion, if one takes those countries media for real, that in other countries the disease is not as ravaging or non-existant. One should trust democratic countries data more and signal distrust on data/ positions / declarations from authoritarian regimes.
This however is not happening much on online plattforms, were one dictators "cheerful" lies are equally loud represented next to a loyal servant of a democratic state giving "grim" news.
The platforms thus help to creates the impression, that authoritarian regimes are dealing "better" with the situation and those wishing for a return to the "before" times, seeing those before times seemingly alive, thus steer towards totalitarian propaganda.
Lies for money subvert the system allowing to sell lies for money as a business model.
This problem solves itself.
If a government is caught lying, its previous statements to a fact should be auto-corrected and future statements be overwritten with a extrapolated truth, given by someone proofen to be trust worthy.
> I've heard people tell me that when COVID started the hospitals started marking everyone who died as having COVID regardless of what the real cause was.
From what I've heard, it went both ways, depending on the point in time. E.g. Poland had an election coming up mid-pandemic, and around that period, many people believed the government is underreporting COVID deaths, by making doctors classify them as caused by any of the comorbidities present in the deceased (and past certain age, pretty much everyone had some comorbidity, e.g. a weak cardiovascular system, or cancer).
COVID statistics were always heavily politicized. I think the most reliable way of getting to the truth was, and still is, looking at the excess death counts (i.e. how many more people died in a given month over the average of deaths in that month in last few pre-pandemic years).
From what I've heard, it went both ways, depending on the point in time. E.g. Poland had an election coming up mid-pandemic, and around that period, many people believed the government is underreporting COVID deaths, by making doctors classify them as caused by any of the comorbidities present in the deceased (and past certain age, pretty much everyone had some comorbidity, e.g. a weak cardiovascular system, or cancer).
COVID statistics were always heavily politicized. I think the most reliable way of getting to the truth was, and still is, looking at the excess death counts (i.e. how many more people died in a given month over the average of deaths in that month in last few pre-pandemic years).
Even comparing excess deaths can be misleading, because you're comparing deaths during lockdown to deaths in previous years not in lockdown. In other words, you're not isolating a single variable (SARS-CoV-2 pandemic vs no pandemic) but rather multiple (pandemic plus non pharmaceutical interventions vs no pandemic).
We can sanity check the number fairly easily. COVID has a case fatality rate of ~0.5%, so if everyone in the US had caught the coronavirus there would be around 150k excess deaths. Probably multiply that by a 80% fudge factor to at least acknowledge that some of people who die of COVID were probably frail to start with and likely to get taken out by normal disease and aging.
0.5% of 300,000,000 is 1.5 million dead.
[deleted]
There may have been some shenanigans, of course, but some of the claims I heard came from misunderstanding the hospital classifications.
Hospitals got economic relief from Covid because they couldn't take in other patients for fear of the contagiousness of Covid. So they got "credit" for "Covid patients" for financial reimbursement claim purposes.
But that wasn't the "cause of death" on the death certificate. The COD was listed as whatever it was.
There looked to be some deliberate attempt to conflate these assignments in the minds of people by some bad actors last year.
But again, that's not saying that it didn't happen. But when it was being talked about last year it seemed like it was being used for political purposes.
Hospitals got economic relief from Covid because they couldn't take in other patients for fear of the contagiousness of Covid. So they got "credit" for "Covid patients" for financial reimbursement claim purposes.
But that wasn't the "cause of death" on the death certificate. The COD was listed as whatever it was.
There looked to be some deliberate attempt to conflate these assignments in the minds of people by some bad actors last year.
But again, that's not saying that it didn't happen. But when it was being talked about last year it seemed like it was being used for political purposes.
Misattributions could be referring to two possible things:
A) Uncertainty about how deaths are effectively false positives, and how many "deaths due to COVID" weren't counted. This is a combination of plain uncertainty, not having testing available for everything, all the way up to people fudging numbers (perhaps by choosing not to test categories of deaths).
B) It's unclear (as in people will argue, on both sides) if "deaths with COVID" vs "deaths due to COVID (with some definition of 'due')" is the right measure.
The failures is just shit talking (shit talk can be both deserved and undeserved) the government responses. The basis of the shit talking is that the red and green lines should be far closer to the previous baselines.
A) Uncertainty about how deaths are effectively false positives, and how many "deaths due to COVID" weren't counted. This is a combination of plain uncertainty, not having testing available for everything, all the way up to people fudging numbers (perhaps by choosing not to test categories of deaths).
B) It's unclear (as in people will argue, on both sides) if "deaths with COVID" vs "deaths due to COVID (with some definition of 'due')" is the right measure.
The failures is just shit talking (shit talk can be both deserved and undeserved) the government responses. The basis of the shit talking is that the red and green lines should be far closer to the previous baselines.
Author here. Yes, I mean both kinds of misattributions. We don't have thorough enough testing to use case numbers or what is written on a death certificate. Just using excess deaths, it is much clearer to me.
As for shit talking, I have been frustrated since March of 2020 at the impotence and incompetence of our culture and government to respond and I'm tired of arguing with Trump and Biden apologists. I could probably word all of that better.
As for shit talking, I have been frustrated since March of 2020 at the impotence and incompetence of our culture and government to respond and I'm tired of arguing with Trump and Biden apologists. I could probably word all of that better.
> It’s important to look at and account for the number of deaths directly attributed to COVID, isn’t it? Is there some discrepancy between the excess YoY deaths implied here and the number directly attributed to COVID? Also would be good to normalize per-capita, just to fully factor out population growth?
If that's important to you than just use Cartesian graph. Polar graph shows better seasonal patterns as it does not cut abruptly at the end of the each year.
If that's important to you than just use Cartesian graph. Polar graph shows better seasonal patterns as it does not cut abruptly at the end of the each year.
Author here: I originally started doing this for my state, Florida. I wanted to show what our normal cycle of deaths looks like. We generally have the most deaths during the dry, cold weeks of at the end of January and the beginning of February. We generally have the fewest deaths during August, when it is hottest and most humid.
There was a lot of discussion around how many more deaths were caused by COVID versus normal expected causes. I wanted to make that clearer.
You make a good point about the area being misleadingly large. I had not thought of that.
As for population growth, I thought about that but I'm not sure where to get reliable numbers for each region. As is, one can see that in 2017-2019, the curves were showing steady growth as expected to correlate with population.
There was a lot of discussion around how many more deaths were caused by COVID versus normal expected causes. I wanted to make that clearer.
You make a good point about the area being misleadingly large. I had not thought of that.
As for population growth, I thought about that but I'm not sure where to get reliable numbers for each region. As is, one can see that in 2017-2019, the curves were showing steady growth as expected to correlate with population.
Author here. I have regenerated the graphs to use the square root of the count as the radius to keep the area constant, as others have suggested. I appreciate the feedback.
I was thinking about that while reading these plots too. But I also wonder if readers will understand the slopes.
What would remove the distortion would be a 3D plot on the surface of a cylinder.
However, connecting the end of one year to the start of the next is not what's important. Having a undistorted line graph that plots each year would be much more informative.
However, connecting the end of one year to the start of the next is not what's important. Having a undistorted line graph that plots each year would be much more informative.
Visualizations are tough. It seems there is always a visualization you can use to show the story you are trying to tell, almost like "p-hacking", but "chart searching."
For this data, I'm not at all clear on why a standard line chart isn't better. I'll confess, I don't find these charts bad; I just don't see them as clearer than the standard charts. What is the specific advantage?
The commentary on lag of reporting being a surprise is, itself, surprising at this point. That was a big point of contention earlier, but I'm not sure I have seen it pan out in a way that matters.
I'm torn on the commentary of the failure of governments. Policy choices have been very hard with more emotion driving choices than analyzed results. I'm personally in the bend of "be overly cautious," but I also get an uneasy feeling in just how little control there is in comparisons. About the only thing I know not to do now, is get cocky for any region and assume that anyone is already through this.
For this data, I'm not at all clear on why a standard line chart isn't better. I'll confess, I don't find these charts bad; I just don't see them as clearer than the standard charts. What is the specific advantage?
The commentary on lag of reporting being a surprise is, itself, surprising at this point. That was a big point of contention earlier, but I'm not sure I have seen it pan out in a way that matters.
I'm torn on the commentary of the failure of governments. Policy choices have been very hard with more emotion driving choices than analyzed results. I'm personally in the bend of "be overly cautious," but I also get an uneasy feeling in just how little control there is in comparisons. About the only thing I know not to do now, is get cocky for any region and assume that anyone is already through this.
>It seems there is always a visualization you can use to show the story you are trying to tell, almost like "p-hacking", but "chart searching."
Is there a visualization that tells the story that deaths due to covid weren't a big issue?
The only way(other than just making up numbers) I have seen this done is to look at the last few months and use the reporting lag to mislead people into thinking there were fewer deaths than past years.
Is there a visualization that tells the story that deaths due to covid weren't a big issue?
The only way(other than just making up numbers) I have seen this done is to look at the last few months and use the reporting lag to mislead people into thinking there were fewer deaths than past years.
Fair. There are some stories that can't be told with the data anymore.
That said, I haven't seen that one attempted. Unless it is to get and show good non uniform the risk involved is.
The main question/story seems to be around just how preventable this was. And on that one, stories are all over the place.
That said, I haven't seen that one attempted. Unless it is to get and show good non uniform the risk involved is.
The main question/story seems to be around just how preventable this was. And on that one, stories are all over the place.
[deleted]
[deleted]
Three such visualizations: data that are confusing to the layperson, and data that minimize personal danger, and data that bend the brain's ability to comprehend.
A plot of Case Fatality Rate would go down over time as the number of cases goes up. A somewhat related, slightly confusing example is cumulative deaths on a log plot. A handful of people would look at the line without much focus on the axes or title.
A plot of Covid deaths by age group could make it more likely that young people engage in riskier activities, since it downplays the risk for "most" people---well, except someone else's grandparents who were gonna die soon anyway.
And, in the WTF category: https://images.theconversation.com/files/330304/original/fil...
A plot of Case Fatality Rate would go down over time as the number of cases goes up. A somewhat related, slightly confusing example is cumulative deaths on a log plot. A handful of people would look at the line without much focus on the axes or title.
A plot of Covid deaths by age group could make it more likely that young people engage in riskier activities, since it downplays the risk for "most" people---well, except someone else's grandparents who were gonna die soon anyway.
And, in the WTF category: https://images.theconversation.com/files/330304/original/fil...
> Is there a visualization that tells the story that deaths due to covid weren't a big issue?
Yes, sort of. There was a great paper in CHI this year discussing how heterodox communities use visualizations (https://dl.acm.org/doi/fullHtml/10.1145/3411764.3445211). The rough conclusion is that visualizations do not just empower people to express the truth but are also used in skilled ways by heterodox communities.
Yes, sort of. There was a great paper in CHI this year discussing how heterodox communities use visualizations (https://dl.acm.org/doi/fullHtml/10.1145/3411764.3445211). The rough conclusion is that visualizations do not just empower people to express the truth but are also used in skilled ways by heterodox communities.
“Chart hacking” is a great term, thanks. I’m gonna start using that.
Author here. Maybe I am too strident in my commentary on the failure of governments. I firmly believe there have been many failures. We should have implemented testing at scale in March of 2020. Now we are doomed to have partisan arguments about vaccinations and masks after having spent trillions on handouts.
I wish I knew how the partisan debate became the debate. :(
For myself, I am not convinced we know what the world would have looked like given any alternative response. I do not think we should give up. I just don't know what has actually worked. Hard to argue against more testing, though.
Edit: also, to be clear, I am not trying to argue you shouldn't do the charts this way. Rather, saying I probably need some training to align to what you think this makes more clear. And I believe it could just be different licks, and all that.
For myself, I am not convinced we know what the world would have looked like given any alternative response. I do not think we should give up. I just don't know what has actually worked. Hard to argue against more testing, though.
Edit: also, to be clear, I am not trying to argue you shouldn't do the charts this way. Rather, saying I probably need some training to align to what you think this makes more clear. And I believe it could just be different licks, and all that.
I think that there is any confusion at all is more an indication that I have failed to make a good case for this being more useful. I found it more useful for my own needs looking at my state and trying to understand the normal expected seasonal variation versus 2020-2021.
This is the kind of feedback I was looking for. Thank you.
This is the kind of feedback I was looking for. Thank you.
Thanks for sharing! I see you got pointed suggestions for moving the legend and changing the scale. Looking forward to seeing them after those changes.
I have regenerated the graphs to use the square root of the count as the radius to keep the area constant, as others have suggested. I appreciate the feedback.
I don't know if this makes it better but my mental model of the calendar year is a circle divided into quarters.
Years are cyclic, no?
EDIT: Months to be precise.
EDIT: Months to be precise.
But a year over year line chart already shows trends well enough.
Splitting not by month, but by season, would be neat to see. But I'm sceptical there are any learnings to be had here.
Splitting not by month, but by season, would be neat to see. But I'm sceptical there are any learnings to be had here.
Nightingale rose diagram
https://en.wikipedia.org/wiki/Pie_chart#Polar_area_diagram
https://en.wikipedia.org/wiki/Pie_chart#Polar_area_diagram
Someone mentioned how the area under the curve could be misleading, and this link addresses how to correct for that:
"The radius of each sector would be proportional to the square root of the death count for the month, so the area of a sector represents the number of deaths in a month."
"The radius of each sector would be proportional to the square root of the death count for the month, so the area of a sector represents the number of deaths in a month."
Author here. Yes, I didn't think of that. I will change the code to do that. Thanks.
Numberphile made a video about them 5 months ago for the same use as presented here https://youtu.be/VTdVPNvwULM
"Using this kind of graph one can more easily see"
False, I cannot tell what is happening in this graph.
It's hard to go back and forth between the graph and the legend to tell what year it is. One way to improve the readability is to have the color shift uniformly between one PAST color and one PRESENT color so I can follow the line from the past to the present.
While animation rarely improves graphs, it really can if time is the 3rd dimension your 2d visualization (image) needs. Something like this http://www.climate-lab-book.ac.uk/spirals/ (first gif)
It's hard to go back and forth between the graph and the legend to tell what year it is. One way to improve the readability is to have the color shift uniformly between one PAST color and one PRESENT color so I can follow the line from the past to the present.
While animation rarely improves graphs, it really can if time is the 3rd dimension your 2d visualization (image) needs. Something like this http://www.climate-lab-book.ac.uk/spirals/ (first gif)
Interesting idea! I wonder if this provides additional visualisation than just a line graph with a horizontal axis of Jan-Dec. Wouldn't it show the same differences year to year?
I looked for a CSV of the data that created the chart, but I failed.
And perhaps the polar chart gives a false impression of higher values being much worse than they are, because the area is skewed so large the further out it is.
I looked for a CSV of the data that created the chart, but I failed.
And perhaps the polar chart gives a false impression of higher values being much worse than they are, because the area is skewed so large the further out it is.
Author here.
The CSV[0] comes from the CDC website[1] and you can find it in the code[2].
[0]: https://data.cdc.gov/api/views/xkkf-xrst/rows.csv?accessType...
[1]: https://www.cdc.gov/nchs/nvss/vsrr/covid19/excess_deaths.htm
[2]: https://github.com/mcculley/ObservedDeathVisualizer/blob/mai...
The CSV[0] comes from the CDC website[1] and you can find it in the code[2].
[0]: https://data.cdc.gov/api/views/xkkf-xrst/rows.csv?accessType...
[1]: https://www.cdc.gov/nchs/nvss/vsrr/covid19/excess_deaths.htm
[2]: https://github.com/mcculley/ObservedDeathVisualizer/blob/mai...
I realized I should have anchored the line in the source code to a particular commit: https://github.com/mcculley/ObservedDeathVisualizer/blob/f29...
I originally was doing this just for Florida. Because Florida generally has the most deaths during the dry, cold weeks at the end of January, it made it harder for me to see and show that trend on the horizontal chart as it wrapped across both ends.
There are a lot of very nice articles showing the mortality in France during Covid-19 compared to other years and events (epidemics, heat waves), good reads.
https://www.insee.fr/en/statistiques/5359584
https://www.insee.fr/en/statistiques/5359584
I think looking at individual state charts bring more meaning and accuracy.
What caught my eye was that while many states almost returned to pre-pandemic death rate, Florida and Texas have been running above average while their governor's are fighting masking mandates.
What caught my eye was that while many states almost returned to pre-pandemic death rate, Florida and Texas have been running above average while their governor's are fighting masking mandates.
[deleted]
Is this just number of deaths without population context? If so, it's falsely accumulating. Probably not a huge deal given the period and growth rate, but still, not hard to adjust.
USA population growth is about 0.6%/year. Adjust total population on a per month basis and show the deaths per population instead of the total deaths.
Would love to see a bunch of age-stratified versions.
USA population growth is about 0.6%/year. Adjust total population on a per month basis and show the deaths per population instead of the total deaths.
Would love to see a bunch of age-stratified versions.
https://www.cdc.gov/nchs/nvss/vsrr/covid_weekly/index.htm has the age-stratified data for the US you are looking for. I think they adjust for population growth, but I am not sure.
https://euromomo.eu/graphs-and-maps/ has similar data for most of Europe and Israel, and they adjust for population growth and a seasonal component (looks like a sine wave of period 1 year).
https://euromomo.eu/graphs-and-maps/ has similar data for most of Europe and Israel, and they adjust for population growth and a seasonal component (looks like a sine wave of period 1 year).
From this it looks like "April May June July 2021" are almost back to the "normal" number of deaths, and not too much excess.
Wonder what that means. Maybe that everyone who was gonna die from COVID-19 exposure already did. Maybe something else.
We can be sure that "December January February 2022" will show some excess.
Wonder what that means. Maybe that everyone who was gonna die from COVID-19 exposure already did. Maybe something else.
We can be sure that "December January February 2022" will show some excess.
The only benefit of this compared to overlapping yearly line charts is to connect December with January, which does not justify losing the ability to quickly compare values on a straight linear axis.
What caused the excess death in early 2018?
Maybe flu? 2017-2018 flu season was relatively rough.
Cyclonic blizzard over the East coast.
See also this similar plot for the UK: https://www.cebm.net/covid-19/covid-19-florence-nightingales...
In Microsoft Excel: “radar chart”.
Uhu. April is the cruelest month.
In Germany less people died through the pandemic than died in normal years. At least in 2020.
What happened was that people were overly careful - in all parts of life, e.g. meeting people, wearing masks (less of a flu season = less deaths) and going to a doctor when sick - hospital s greatly increased their capacity and afaik Germany never had the dramatic situations where people couldn't get oxygen or staff was at the edge of quitting.
What happened was that people were overly careful - in all parts of life, e.g. meeting people, wearing masks (less of a flu season = less deaths) and going to a doctor when sick - hospital s greatly increased their capacity and afaik Germany never had the dramatic situations where people couldn't get oxygen or staff was at the edge of quitting.
> Using this kind of graph one can more easily see how changes year-to-year in total observed deaths have been affected by COVID-19.
It’s important to look at and account for the number of deaths directly attributed to COVID, isn’t it? Is there some discrepancy between the excess YoY deaths implied here and the number directly attributed to COVID? Also would be good to normalize per-capita, just to fully factor out population growth?
> Using total observed deaths, one can disregard the (mis)attribution of deaths to COVID-19 and more clearly see the failure of federal and state governments.
Out of curiosity, what are the misattributions and failures being referred to? Just confused a little since the source data is federal (CDC) and has this exact same graph showing the excess death rate this year, just on a horizontal plot.