SAS is on the brink of something(thomaswdinsmore.com)
thomaswdinsmore.com
SAS is on the brink of something
https://thomaswdinsmore.com/2018/03/07/sas-is-on-the-brink-of-something/
51 comments
SAS have shown some belated movement towards a more modern architecture. You can install SAS servers using a package management system, and automate the process using Ansible.
But their licensing model is straight out of the 90’s. there’s no point using automated load balancing if your license costs are a fixed multi-million dollar per year cost.
They have moved to a web-based client. It’s great that it’s not stuck on Windows. But it’s a very closed client in that it only works with SAS products. As the article says, no Python or R. And as a web based IDE it’s a pale shadow of the likes of Cloud 9.
If’s disheartening (but not surprising) to hear a SAS employee say they don’t care about the core language any more, they make most of their money from BI tools aimed at non-programmers.
But their licensing model is straight out of the 90’s. there’s no point using automated load balancing if your license costs are a fixed multi-million dollar per year cost.
They have moved to a web-based client. It’s great that it’s not stuck on Windows. But it’s a very closed client in that it only works with SAS products. As the article says, no Python or R. And as a web based IDE it’s a pale shadow of the likes of Cloud 9.
If’s disheartening (but not surprising) to hear a SAS employee say they don’t care about the core language any more, they make most of their money from BI tools aimed at non-programmers.
Nitpicking: Maybe I'm stupid, but I don't know what SAS is. I have learned to always introduce abbreviations before using them. I think more people should do this.
Since this comment is so high, save you a click:
SAS (previously "Statistical Analysis System") is a software suite developed by SAS Institute for advanced analytics, multivariate analyses, business intelligence, data management, and predictive analytics.
SAS was developed at North Carolina State University from 1966 until 1976, when SAS Institute was incorporated. SAS was further developed in the 1980s and 1990s with the addition of new statistical procedures, additional components and the introduction of JMP. A point-and-click interface was added in version 9 in 2004. A social media analytics product was added in 2010.
According to IDC, SAS is the largest market-share holder in "advanced analytics" with 35.4 percent of the market as of 2013. It is the fifth largest market-share holder for business intelligence (BI) software with a 6.9% share and the largest independent vendor. It competes in the BI market against conglomerates, such as SAP BusinessObjects, IBM Cognos, SPSS Modeler, Oracle Hyperion, and Microsoft BI. SAS has been named in the Gartner Leader's Quadrant for Data Integration Tool and for Business Intelligence and Analytical Platforms. A study published in 2011 in BMC Health Services Research found that SAS was used in 42.6 percent of data analyses in health service research, based on a sample of 1,139 articles drawn from three journals.
— https://en.m.wikipedia.org/wiki/SAS_(software)
TL;DR: It’s kind of a big deal in analytics.
SAS (previously "Statistical Analysis System") is a software suite developed by SAS Institute for advanced analytics, multivariate analyses, business intelligence, data management, and predictive analytics.
SAS was developed at North Carolina State University from 1966 until 1976, when SAS Institute was incorporated. SAS was further developed in the 1980s and 1990s with the addition of new statistical procedures, additional components and the introduction of JMP. A point-and-click interface was added in version 9 in 2004. A social media analytics product was added in 2010.
According to IDC, SAS is the largest market-share holder in "advanced analytics" with 35.4 percent of the market as of 2013. It is the fifth largest market-share holder for business intelligence (BI) software with a 6.9% share and the largest independent vendor. It competes in the BI market against conglomerates, such as SAP BusinessObjects, IBM Cognos, SPSS Modeler, Oracle Hyperion, and Microsoft BI. SAS has been named in the Gartner Leader's Quadrant for Data Integration Tool and for Business Intelligence and Analytical Platforms. A study published in 2011 in BMC Health Services Research found that SAS was used in 42.6 percent of data analyses in health service research, based on a sample of 1,139 articles drawn from three journals.
— https://en.m.wikipedia.org/wiki/SAS_(software)
TL;DR: It’s kind of a big deal in analytics.
I fully agree. To me, SAS is either an airline company or british special forces, so I have no idea which company this blogpost is about - and I'm not going to start researching to find out which company a blog post about a company is talking about.
However, to be somewhat of a hypocrite, I don't mind abbreviations for broadly known terms, such as SaaS, DevOps or db. I guess it boils down to the context.
However, to be somewhat of a hypocrite, I don't mind abbreviations for broadly known terms, such as SaaS, DevOps or db. I guess it boils down to the context.
> However, to be somewhat of a hypocrite, I don't mind abbreviations for broadly known terms, such as SaaS, DevOps or db. I guess it boils down to the context.
Well, at least SaaS and DevOps are easily googleable. Still, in any type of written article, I would just take the time to write out the abbreviated thing in full the first time. Takes maybe 2 seconds and 10 letters more, and you won't have people like me complaining :)
Well, at least SaaS and DevOps are easily googleable. Still, in any type of written article, I would just take the time to write out the abbreviated thing in full the first time. Takes maybe 2 seconds and 10 letters more, and you won't have people like me complaining :)
* Flashbacks to when I was learning to program and people were dropping mysterious acronyms like SaaS (and its _aaS compadres)
Hi. I wrote the blog post. (Someone else published the link on HN.) Thanks for reading. SAS is not an acronym. And since I write for an audience of people who work with data science and machine learning, I assume that readers know the largest vendor in the category.
Thank you for your answer, I understand now. SAS not being an acronym mostly voids my critique. I am reading your blog post somewhat out of context, since I am not a data scientist.
That said, the rest of the article is very accessible for me - my only confusion was what SAS is. Maybe a link to a page that explains what SAS is would be a good solution?
That said, the rest of the article is very accessible for me - my only confusion was what SAS is. Maybe a link to a page that explains what SAS is would be a good solution?
Appreciate the feedback. I write for an audience that is familiar with the leading vendors in data science and machine learning.
Anybody who studied Bachelor of Science in Statistics knows what is SAS. It is a statistics application. It is just like R, SPSS, and Minitab. If you don't know any of these you might know Jupyter Notebook. Also the buzzword for "Statistics" nowadays is "Big Data".
Yeah, I thought something was wrong with Scandinavian Airlines.
A few years back, I was an out-and-out SAS guy. This was mainly because the company I worked for had everything in SAS.
Then, our company acquired a competitor to SAS; SAS was booted out and literally, overnight, we were asked to stop using SAS and switch over. Thanks to this development, my team and I scrambled to port it over to the new tool. Of course, the transition wasn't smooth and a lot of our programs couldn't be migrated. This is when I began exploring Python and fell in love with it. I rediscovered programming, powerful ML libraries and the awesomeness of the open-source paradigm.
I end my random anecdote to say that I'm grateful for this (unexpected) development that helped me accelerate my career in data science, which would have definitely not happened if the abrupt removal of SAS hadn't taken place. I would've most likely still be churning regular dashboards built on legacy SAS code for some bank.
Then, our company acquired a competitor to SAS; SAS was booted out and literally, overnight, we were asked to stop using SAS and switch over. Thanks to this development, my team and I scrambled to port it over to the new tool. Of course, the transition wasn't smooth and a lot of our programs couldn't be migrated. This is when I began exploring Python and fell in love with it. I rediscovered programming, powerful ML libraries and the awesomeness of the open-source paradigm.
I end my random anecdote to say that I'm grateful for this (unexpected) development that helped me accelerate my career in data science, which would have definitely not happened if the abrupt removal of SAS hadn't taken place. I would've most likely still be churning regular dashboards built on legacy SAS code for some bank.
About a year ago, a sales guy from SAS came to give a talk about Viya at our uni. They even brought a data scientist (whom I believe was actually a smart kid and feeling uneasy about being dragged into a sales pitch). Traditionally, SAS has pushed a lot of resources in the educational sector. Get them started young, and they'll be customers forever.
So anyway, the presentation includes showing off a Jupyter notebook and showing how you can easily use pandas to load in your data set, build a model (with Viya), and plot the results with matplotlib. Standard data science stuff, but distributed automagically thanks to Viya.
During the QA, I asked the following questions:
- So you are basically attempting the same as what Spark has done, and are just using R/Python/... as a client? Yes, but we're way more powerful, manageable, etc...
- Can I see the source code of your models, or build new ones myself? No... well maybe, you can write them in SAS base and call them.
- Can I at least export the model to something like PMML? Oh yes you can export (shows this off)... to SAS base code.
- Do you have GPU support for those fancy convolutional neural networks? No (although I've heard this has changed, though I would still put my trust more towards Tensorflow or Pytorch).
It kind of seems like a last attempt to get some new lock-in going. Even Apple's re-open sourcing of turi (https://github.com/apple/turicreate) is more honest (and more powerful, actually).
I like SAS, they have some very smart people working there and some great consultants (PhD's, often), but there's too much sales going on. This is what killed IBM as well.
So anyway, the presentation includes showing off a Jupyter notebook and showing how you can easily use pandas to load in your data set, build a model (with Viya), and plot the results with matplotlib. Standard data science stuff, but distributed automagically thanks to Viya.
During the QA, I asked the following questions:
- So you are basically attempting the same as what Spark has done, and are just using R/Python/... as a client? Yes, but we're way more powerful, manageable, etc...
- Can I see the source code of your models, or build new ones myself? No... well maybe, you can write them in SAS base and call them.
- Can I at least export the model to something like PMML? Oh yes you can export (shows this off)... to SAS base code.
- Do you have GPU support for those fancy convolutional neural networks? No (although I've heard this has changed, though I would still put my trust more towards Tensorflow or Pytorch).
It kind of seems like a last attempt to get some new lock-in going. Even Apple's re-open sourcing of turi (https://github.com/apple/turicreate) is more honest (and more powerful, actually).
I like SAS, they have some very smart people working there and some great consultants (PhD's, often), but there's too much sales going on. This is what killed IBM as well.
> Traditionally, SAS has pushed a lot of resources in the educational sector. Get them started young, and they'll be customers forever.
If that is the strategy I'm not entirely sure it is well implemented. The version available for windows using students requires running a virtualized linux in the background to access a browser based, sluggish IDE like interface.
Compared to SAS, R and Python look like an usability dream.
If that is the strategy I'm not entirely sure it is well implemented. The version available for windows using students requires running a virtualized linux in the background to access a browser based, sluggish IDE like interface.
Compared to SAS, R and Python look like an usability dream.
Out of the 100 or so data scientists in my division, I know of less than 5 people who still occasionally use SAS. It's all either (decreasingly) R or (increasingly) Python.
edit: scala with spark is increasing in use as well.
edit: scala with spark is increasing in use as well.
What’s a SAS
analytics software: https://www.sas.com
Just five years back, this question would've been sacrilege in the 'data analytics' community.
5 years ago, I worked at a company that did a lot of data analytics stuff (though I did not; I was responsible with some web applications). They swore by SAS. To read the comments here are pretty jarring, considering that previous history and how entrenched they seemingly were. I remember conversations with the SAS users and saying if I were to go in that arena, I'd most likely be a bigger fan of using R which seemed like sacrilege in the context of the conversation.
Granted, I worked about 30 minutes from SAS's HQ in Cary, but still.
Granted, I worked about 30 minutes from SAS's HQ in Cary, but still.
Kind of like COBOL, an old-school legacy thing originating from mainframes that some people still use.
Most of the worlds largest enterprises run tons of this legacy cobol mainframe stuff. They solve really hard problems using this technology and we would be wise not to be dismissive but instead to learn.
Right they do, but they are also all working really hard on their transition plans away from it. See the original link for concrete data on that.
It depends. I work professionally with Fortune 500 companies and for many of them mainframes are here to stay. It’s true that many of them wish to modernize and move away from mainframes; but they don’t want to get rid of them entirely.
Do people solve really hard problems with COBAL? I thought it was primarily a business language that replaces a lot of manual work. What sort of things has it found a niche for? Similar to how FORTRAN is used a lot in big data/physics?
Every bank, insurance, airline, and electric utility in the world older than 25 years old has a mountain of critical, working, and legacy software running COBOL and FORTRAN.
With the generation of programmers who wrote the code retiring it’s even more entrenched because even though they rely on that code dearly, few if any people remember why it does what it does how it does it.
With the generation of programmers who wrote the code retiring it’s even more entrenched because even though they rely on that code dearly, few if any people remember why it does what it does how it does it.
> With the generation of programmers who wrote the code retiring
For many big COBOL systems that’s long past; in many cases the programmers that were coming on board when that generation retired are near retirement.
For many big COBOL systems that’s long past; in many cases the programmers that were coming on board when that generation retired are near retirement.
[deleted]
I've often thought it's probably a cracking time to be get some COBOL skills - you could jack your day rate up to the point you could probably name your price. There's an institutional incentive to replace it eventually, so not a long term thing, but you could probably milk it for a good few years.
I know COBOL programmers whose day rate is considerably north of £1000
That doesn't address the question I was asking, of course there are a lot of legacy COBOL systems out there.
Do any of those legacy systems work on "hard problems" similar to how FORTRAN is still used in fluid dynamics, physics, crystallography and chemistry?
Do any of those legacy systems work on "hard problems" similar to how FORTRAN is still used in fluid dynamics, physics, crystallography and chemistry?
Where would one look if one wanted to learn COBOL though? There's a free C implementation, but barely anything else surrounding it.
Where would one look if one wanted to learn COBOL though?
One would look at google. https://www.tutorialspoint.com/cobol/index.htm
One would look at google. https://www.tutorialspoint.com/cobol/index.htm
We use SAS Enterprise Guide as a Business Intelligence/analytics tool at my work (Industrial Plant) - most of our production reporting is SAS based. We also use it for adhoc analysis/troubleshooting. I.e to spot long term declines in yield and that sort of thing.
Where SAS succeeds is they make it very easy for non programmers to do things like query databases extract, transform, merge data, create computed columns and output graphs and reports.
Enterprise Guide is 100% scriptable and has a programming language underneath it the "SAS langauge" basically anything you can do in the GUI has code that is generated in the backend which user can edit directly if they desire. In old versions of Enterprise Guide code the GUI generated tended to be pretty inefficient (especially the SQL side of things) so a lot of people hacked the code directly and bypassed the GUI - nowadays it has gotten pretty good not as much need to hand optimize things.
Best analogy I can give is Enterprise Guide is like Excel on steroids.
SAS also has very powerful statistical capabilities beyond what something like Excel offers. We leverage a lot of this stuff when we need to build engineering models, things like Time Series Analysis, Statistical Process Control, Linear and Non Linear Modelling (Including Stepwise and Logistic Regressions). There is even some Optimization solver type stuff I've used in past (though MATlab is more often used in my org for this work). SAS kind of takes the kitchen sink approach in R you need to install external packages from CRAN to unlock all this stuff in SAS tends to be "baked in". I've found if I read about a statistical technique in a paper good chance it is available in SAS - good example is a few years ago a grad student came to our plant and helped us perform some analysis using a technique called "Projection to Latent Structures" (PLS) to identify relationships between various factors on plant causing yield loss. At the time this wasn't very common - I think it is used in machine learning nowadays but SAS had a PLS procedure available for us to use (kind of like a function in other programming languages) and the documentation SAS provided was very good (especially for someone like me with engineering background rater than stats background).
The only other tool I know of that is remotely similar to Enterprise Guide is IBM's Cognos software and that is vastly more limited as far as the statistical modelling features are concerned.
My work is keen to try other software, in part due to license costs, I think. In the Last 6 months I've been on two training course for Microsoft Power BI, and Microsoft R-Open (which I think is just Open source R-Studio with some extra proprietary stuff thrown in).
I've now used both tools to do my day to day job. I managed to get by with each of them but I found usability fell short of ease of use of enterprise guide.
Power BI was nice and I think it has something to offer as far as data visualization but you need to do the actual modelling in some other language so doesn't really eliminate needs for SAS - more like compliments it.
R on the other hand is a lot lower level it has all the advanced statistics but you have to write the low level code yourself to unlock them which requires learning an entire programming language to build simple models. It will be a pretty hard sell getting Engineers (I'm talking mechanical, chemical engineers not software kind) and finance analyst people to use a tool like R.
I think R would hugely benefit from something like an "Enterprise Guide for R" - I.e a drag and drop GUI which generated R code for you.
Also I wouldn't say the SAS Languge itself is strictly an old-school legacy language (sure the origins of SAS are from the 70's and 80's and there is a lot of legacy cruft in the SAS programming language I'll give you that) - For me SAS is a little like C++ there is a heap of stuff that lives in the langauge for backwards compatibility with old programs but modern C++ program looks very different from early 90's C++ - same with SAS code.
I've found modern ODS graphics (SGplot, SGpannel, etc) was very much on par with "ggplot2" functionality in R which is what the training course covered for producing reports using R.
SAS to me is a bit like MATLAB (and hey we use both in Engineering world). Everyone hates this software and wants something better but nothing else approaches the usability of these tools so models continue to be built using them.
Where SAS succeeds is they make it very easy for non programmers to do things like query databases extract, transform, merge data, create computed columns and output graphs and reports.
Enterprise Guide is 100% scriptable and has a programming language underneath it the "SAS langauge" basically anything you can do in the GUI has code that is generated in the backend which user can edit directly if they desire. In old versions of Enterprise Guide code the GUI generated tended to be pretty inefficient (especially the SQL side of things) so a lot of people hacked the code directly and bypassed the GUI - nowadays it has gotten pretty good not as much need to hand optimize things.
Best analogy I can give is Enterprise Guide is like Excel on steroids.
SAS also has very powerful statistical capabilities beyond what something like Excel offers. We leverage a lot of this stuff when we need to build engineering models, things like Time Series Analysis, Statistical Process Control, Linear and Non Linear Modelling (Including Stepwise and Logistic Regressions). There is even some Optimization solver type stuff I've used in past (though MATlab is more often used in my org for this work). SAS kind of takes the kitchen sink approach in R you need to install external packages from CRAN to unlock all this stuff in SAS tends to be "baked in". I've found if I read about a statistical technique in a paper good chance it is available in SAS - good example is a few years ago a grad student came to our plant and helped us perform some analysis using a technique called "Projection to Latent Structures" (PLS) to identify relationships between various factors on plant causing yield loss. At the time this wasn't very common - I think it is used in machine learning nowadays but SAS had a PLS procedure available for us to use (kind of like a function in other programming languages) and the documentation SAS provided was very good (especially for someone like me with engineering background rater than stats background).
The only other tool I know of that is remotely similar to Enterprise Guide is IBM's Cognos software and that is vastly more limited as far as the statistical modelling features are concerned.
My work is keen to try other software, in part due to license costs, I think. In the Last 6 months I've been on two training course for Microsoft Power BI, and Microsoft R-Open (which I think is just Open source R-Studio with some extra proprietary stuff thrown in).
I've now used both tools to do my day to day job. I managed to get by with each of them but I found usability fell short of ease of use of enterprise guide.
Power BI was nice and I think it has something to offer as far as data visualization but you need to do the actual modelling in some other language so doesn't really eliminate needs for SAS - more like compliments it.
R on the other hand is a lot lower level it has all the advanced statistics but you have to write the low level code yourself to unlock them which requires learning an entire programming language to build simple models. It will be a pretty hard sell getting Engineers (I'm talking mechanical, chemical engineers not software kind) and finance analyst people to use a tool like R.
I think R would hugely benefit from something like an "Enterprise Guide for R" - I.e a drag and drop GUI which generated R code for you.
Also I wouldn't say the SAS Languge itself is strictly an old-school legacy language (sure the origins of SAS are from the 70's and 80's and there is a lot of legacy cruft in the SAS programming language I'll give you that) - For me SAS is a little like C++ there is a heap of stuff that lives in the langauge for backwards compatibility with old programs but modern C++ program looks very different from early 90's C++ - same with SAS code.
I've found modern ODS graphics (SGplot, SGpannel, etc) was very much on par with "ggplot2" functionality in R which is what the training course covered for producing reports using R.
SAS to me is a bit like MATLAB (and hey we use both in Engineering world). Everyone hates this software and wants something better but nothing else approaches the usability of these tools so models continue to be built using them.
Thanks for this very informative interesting write-up, notes such as these are what makes Hacker News so great.
I’m curious, what do you think of SQL?
I come from a finance background was an Excel guru but now prefer PostgreSQl, amazing what you can do with their Windows Functions, Recursive CTEs, Lateral Join Set Functions, Custom Aggregates, also has Python and R built in. I don’t like PowerBi too disjointed from Excel and v weak SQL support why does Microsft have to keep imposing their own languages on us instead of alloing us to use far superior SQL, would be awesome to have SQL in Excel (python Exel wings offers this but limited and clunky)Main proble with PowerBi for me is you can’t update the database without obtuse hacks.
I used to work in a large international bank where SAS was the standard and while it can be used you can really feel the age of the technology.
Now I work in a startup bank and since I could chose the tools we're now running PostgreSQL/R/Python (RStudio and Spyder). Lately the marketing department are also using Tableu.
It's another world when it comes to output and efficiency of the team I lead compared to using enterprise guide.
Now I work in a startup bank and since I could chose the tools we're now running PostgreSQL/R/Python (RStudio and Spyder). Lately the marketing department are also using Tableu.
It's another world when it comes to output and efficiency of the team I lead compared to using enterprise guide.
Where I currently work, we teach all of our BAs (regardless of how technical they start out), to use SQL (with redash), and some of them use Tableu. As this approach has been running quite smoothly for us, would SAS offer anything that a team like ours might be missing?
You can run R in SQL Server and Excel has the Data Model/PowerPivot now.
Yeah I thought - Special Air Service or SaaS
Or the Scandinavian Airline
Surfers Against Sewage!
In my defence, I'll simply note that there's history here:
https://groups.google.com/forum/#!topic/comp.soft-sys.sas/oF...
https://groups.google.com/forum/#!topic/comp.soft-sys.sas/oF...
https://www.youtube.com/watch?v=2v1m-75I3_o
Both actors appearing in that clip are total muppets but it seems relevant ;-)
Both actors appearing in that clip are total muppets but it seems relevant ;-)
Serial Attached SCSI?
SAS is dying slowly, but deservedly.
The airline? Don't know any other users of this TLA.
It's very confusing that you don't get even a basic insight of what the article is about.
It's very confusing that you don't get even a basic insight of what the article is about.
No, the huge enterprise software suite used for analytics and all other sorts of stuff.
I also thought the airline first, but most people in USA have not heard of Scandinavian.
I also thought the airline first, but most people in USA have not heard of Scandinavian.
I have to work with SAS now and again in my research. I grit my teeth and bear it.
It’s not a tool for programmers. It’s a toolbox for people doing other jobs, who happen to know how to program.
Would we invest in SAS if we were starting today from scratch? No.
But none of SAS’s biggest customers are starting from scratch, and things like continuity, risk, and embedded institutional expertise are incredibly important to these customers, in a way that might not be obvious if you’re coming from the fast-paced world of startups who have the luxury of starting with nothing.
In the endgame though, I can’t see how SAS will be able to resist the cost pressure coming from the Python/R/Hadoop/FOSS-in-general ecosystem, as those tools continue to mature.
Even COBOL will die one day.