Can we create a thread for some of the best materials on CS available online?
49 comments
The Stanford cryptography class (http://crypto.stanford.edu/~dabo/cs255/) and associated book (https://crypto.stanford.edu/~dabo/cryptobook/BonehShoup_0_4....) is almost everything you'd ever want to know about cryptography. If you really like that and want to see the frontiers of cryptography research, the next (and last!) class is https://crypto.stanford.edu/cs355/23sp/; alternatively, there's a security class (https://cs155.stanford.edu/) more focused on industry and application.
Pro tip: nearly every instance of both these classes is available online (all the way back to 1998!), so if something's not making sense, you can always go back and see if it was explained differently in a prior iteration of the class.
Pro tip: nearly every instance of both these classes is available online (all the way back to 1998!), so if something's not making sense, you can always go back and see if it was explained differently in a prior iteration of the class.
another one application specific: https://www.youtube.com/playlist?list=PL1y1iaEtjSYiiSGVlL1cH...
taught by the creator of webtorrent afaik
taught by the creator of webtorrent afaik
https://teachyourselfcs.com . I have read few books from the list and found it to be comprehensive as well as manageable. The courses and books have been selected so that one can study it outside of regular university course. Books are self contained and full with exercises. It can easily take 1-2 years of serious effort to get through the material.
> It can easily take 1-2 years of serious effort to get through the material.
Still faster than my CS degree.
Still faster than my CS degree.
I have learned a tremendous amount about Linux and DNS and general computing from Julia Evans' zines and her blog. She's also a big fan of "programming playgrounds" [0] or interactive teaching tools.
[0] https://jvns.ca/blog/2023/04/17/a-list-of-programming-playgr...
[0] https://jvns.ca/blog/2023/04/17/a-list-of-programming-playgr...
Lots of great suggestions here.
I'll throw out a recommendation for The Little series of books (e.g., The Little Schemer, The Seasoned Schemer, The Reasoned Schemer, The Little Typer, etc.)
The first book is all you need to grok recursion. You can just toss a copy at any student who struggles with it.
The second book ends with some really non-trivial CS stuff.
They're fantastic examples of the power of good pedagogy to explain interesting and difficult concepts normally relegated to drier texts.
I'll throw out a recommendation for The Little series of books (e.g., The Little Schemer, The Seasoned Schemer, The Reasoned Schemer, The Little Typer, etc.)
The first book is all you need to grok recursion. You can just toss a copy at any student who struggles with it.
The second book ends with some really non-trivial CS stuff.
They're fantastic examples of the power of good pedagogy to explain interesting and difficult concepts normally relegated to drier texts.
Base your studies on Teach Yourself CS. If you finish one item from each of their courses you will be more knowledgeable than even many CS graduates. If you could finish every book and video series they recommend for each course you would be reasonably well prepared for amateur research.
https://teachyourselfcs.com/
https://teachyourselfcs.com/
The quintessential 0 to 1 CS course with amazing teacher and tools to get you started. Also has marked tests to help you learn.
https://cs50.harvard.edu/x/2023/
https://cs50.harvard.edu/x/2023/
From Nand to Tetris: Build a Modern Computer from First Principles
https://www.coursera.org/learn/build-a-computer
Phenomenal look at different systems involved in a computer, and has you build simple versions of logic gates, ALU, assembler, compiler, bootloader, and graphics engine. Highly recommend for folks who didn't study CS in school.
Phenomenal look at different systems involved in a computer, and has you build simple versions of logic gates, ALU, assembler, compiler, bootloader, and graphics engine. Highly recommend for folks who didn't study CS in school.
I have been considering going through this book/program myself. I do have a CS degree, but I really need to brush up on somethings, and I will imagine I will learn a lot of new things too.
However, I noticed there are two versions of the book. Do you think the version matters?
However, I noticed there are two versions of the book. Do you think the version matters?
The book (and course, IIRC) is split across two books. The first one focuses on the lower level systems, and I believe the seconds one deals with the bootloader, language implementation, screen animation, and building the game.
It doesn't look like there are multiple versions of the books, unless I'm missing something. I did the two versions of the course without the book, and really enjoyed both. Although the writers of https://teachyourselfcs.com/ only recommend the first one, so it depends what you want to get out of it and whether the approach resonates.
It doesn't look like there are multiple versions of the books, unless I'm missing something. I did the two versions of the course without the book, and really enjoyed both. Although the writers of https://teachyourselfcs.com/ only recommend the first one, so it depends what you want to get out of it and whether the approach resonates.
There are two editions of the book, but I believe each book covers the whole course.
I was looking at some stuff by Fogus and discovered:
https://github.com/fogus/papers-i-love
Really good resource for a bunch of important papers.
There's also some good information for compilers on github
https://github.com/aalhour/awesome-compilers
https://github.com/fogus/papers-i-love
Really good resource for a bunch of important papers.
There's also some good information for compilers on github
https://github.com/aalhour/awesome-compilers
The MIT's missing semester class (https://missing.csail.mit.edu). For me, it has filled many gaps in my self-teaching journey. I don't have a CS degree.
Surprised to see these introductory courses haven't been mentioned yet.
These courses [0] [1] are on EdX and are taught by UBC Professor Gregor Kiczales. The explanations are so lucid it made recursion click for me. You can audit these courses without paying a single dime. They are based on the book How to Design Programs [2] which has much more stuff than the courses.This book is used in UBC, UWaterloo, NorthEastern and many other places.
Along the same lines there is another book for beginners called A Data-Centric Introduction to Computing [3]. It is used in Brown for their introductory courses.
[0] https://www.edx.org/course/how-to-code-simple-data
[1] https://www.edx.org/course/how-to-code-complex-data
[2] https://htdp.org/
[3] https://dcic-world.org/
These courses [0] [1] are on EdX and are taught by UBC Professor Gregor Kiczales. The explanations are so lucid it made recursion click for me. You can audit these courses without paying a single dime. They are based on the book How to Design Programs [2] which has much more stuff than the courses.This book is used in UBC, UWaterloo, NorthEastern and many other places.
Along the same lines there is another book for beginners called A Data-Centric Introduction to Computing [3]. It is used in Brown for their introductory courses.
[0] https://www.edx.org/course/how-to-code-simple-data
[1] https://www.edx.org/course/how-to-code-complex-data
[2] https://htdp.org/
[3] https://dcic-world.org/
DCIC is my favourite and it's more than a beginner book but the author himself teaches all of it in an accelerated course.
https://cs.brown.edu/courses/cs019/
For undersranding recursion there are two noteworthy books:
* A lot of people say this book made recursion click for them. *
"The Little Schemer"
https://mitpress.mit.edu/9780262560993/the-little-schemer/
* As the title suggests this ones specifically about recursion. (i like this one better because its in python/js) *
"The Recursive Book of Recursion"
https://nostarch.com/recursive-book-recursion
https://cs.brown.edu/courses/cs019/
For undersranding recursion there are two noteworthy books:
* A lot of people say this book made recursion click for them. *
"The Little Schemer"
https://mitpress.mit.edu/9780262560993/the-little-schemer/
* As the title suggests this ones specifically about recursion. (i like this one better because its in python/js) *
"The Recursive Book of Recursion"
https://nostarch.com/recursive-book-recursion
Some Coursera courses I have found to be good:
- Stanford algorithms specialization: https://coursera.org/specializations/algorithms
- University of Melbourne Discrete Optimization: https://coursera.org/learn/discrete-optimization
- Basic Modeling for Discrete Optimization: https://coursera.org/learn/basic-modeling
- Advanced Modeling for Discrete Optimization: https://coursera.org/learn/advanced-modeling
Crafting Interpreters book mentioned elsewhere also very good.
- Stanford algorithms specialization: https://coursera.org/specializations/algorithms
- University of Melbourne Discrete Optimization: https://coursera.org/learn/discrete-optimization
- Basic Modeling for Discrete Optimization: https://coursera.org/learn/basic-modeling
- Advanced Modeling for Discrete Optimization: https://coursera.org/learn/advanced-modeling
Crafting Interpreters book mentioned elsewhere also very good.
"The Algorithm Specialization" that Tim Roughgarden teaches on Coursera/EdX is based on his book series "Algorithms Illuminated" and the lectures, slides and projects are up on the website so you dont need to take it on coursera/edx(UX hell, constant promo emails, time constraint).
https://www.algorithmsilluminated.org/
https://www.algorithmsilluminated.org/
All of Beej's writing is very informational. I especially enjoyed his guide to C, although his guide to network programming is more well known.
https://beej.us/guide/
https://beej.us/guide/
teachyourselfcs is a perfect recommendation as it doesn't include a ton of links thus resulting in analysis paralysis.
https://www.notion.so/wdesert/Curated-Resources-e37b0646f3f1...
This is a list I maintain for myself. It's more about general software development and is not as structured and focused as teachyourselfcs, but you mind find something useful in it
https://www.notion.so/wdesert/Curated-Resources-e37b0646f3f1...
This is a list I maintain for myself. It's more about general software development and is not as structured and focused as teachyourselfcs, but you mind find something useful in it
https://fullstackopen.com/en/
Full Stack Open, a free course by University of Helsinki, is very good on quickly teaching the core concepts for modern frontend and backend in the JS ecosystem. Such a good primer on React and the rest of the things, CI/CD, DB, backend API, auth, etc. involved in fullstack development.
Full Stack Open, a free course by University of Helsinki, is very good on quickly teaching the core concepts for modern frontend and backend in the JS ecosystem. Such a good primer on React and the rest of the things, CI/CD, DB, backend API, auth, etc. involved in fullstack development.
If you ever decide to build a search engine, these are good resources.
Search Engines Information Retrieval in Practice
Croft, Metzler & Strohman (2015)
https://ciir.cs.umass.edu/irbook/
--
Introduction to Information Retrieval
Manning, Raghavan & Schütze (2008)
https://nlp.stanford.edu/IR-book/html/htmledition/irbook.htm...
--
The Anatomy of a Large-Scale Hypertextual Web Search Engine
Page & Brin (2000)
http://infolab.stanford.edu/~backrub/google.html
--
Information Retreival
Rijsbergen (1979)
https://www.dcs.gla.ac.uk/Keith/Preface.html
Search Engines Information Retrieval in Practice
Croft, Metzler & Strohman (2015)
https://ciir.cs.umass.edu/irbook/
--
Introduction to Information Retrieval
Manning, Raghavan & Schütze (2008)
https://nlp.stanford.edu/IR-book/html/htmledition/irbook.htm...
--
The Anatomy of a Large-Scale Hypertextual Web Search Engine
Page & Brin (2000)
http://infolab.stanford.edu/~backrub/google.html
--
Information Retreival
Rijsbergen (1979)
https://www.dcs.gla.ac.uk/Keith/Preface.html
While it may not be the _best_ this book is available from the author online.
Elaine Rich's textbook "Automata, Computability and Complexity: Theory & Applications" https://www.cs.utexas.edu/~ear/cs341/automatabook/index.html
Useful because it covers non-deterministic Turing Machines complexity classes like BPP,ZPP,RP,etc.. that you would run into Monte Carlo methods etc. As the only Non-deterministic Turing machine most people have been introduced to is the maximally lucky guesser from NP's definition it can help with practical solutions.
Unfortunately it doesn't have bounded-error quantum polynomial time (BQP) which would help set expectations for quantum supremacy.
Elaine Rich's textbook "Automata, Computability and Complexity: Theory & Applications" https://www.cs.utexas.edu/~ear/cs341/automatabook/index.html
Useful because it covers non-deterministic Turing Machines complexity classes like BPP,ZPP,RP,etc.. that you would run into Monte Carlo methods etc. As the only Non-deterministic Turing machine most people have been introduced to is the maximally lucky guesser from NP's definition it can help with practical solutions.
Unfortunately it doesn't have bounded-error quantum polynomial time (BQP) which would help set expectations for quantum supremacy.
The digital design and computer architecture course from Onur Mutlu is amazing: https://www.youtube.com/playlist?list=PL5Q2soXY2Zi-EImKxYYY1...
A catalogue/search engine for university courses in computer science, math, and several other subjects that is available publicly:
https://collegecompendium.org/
https://collegecompendium.org/
CS50 hasn't been mentioned yet: https://pll.harvard.edu/course/cs50-introduction-computer-sc...
Great intro to CS.
Great intro to CS.
Here's a pretty good website that gives direction on the path to competence/mastery for various domains of software development.
https://roadmap.sh/
https://roadmap.sh/
Neural Networks: Zero to Hero, by Andrej Karpathy [0].
[0] https://www.youtube.com/playlist?list=PLAqhIrjkxbuWI23v9cThs...
[0] https://www.youtube.com/playlist?list=PLAqhIrjkxbuWI23v9cThs...
This repository contains hundreds of resources for implementing complex systems from scratch https://github.com/codecrafters-io/build-your-own-x
https://platform.intervee.io/
Provides practical challenges with guidance for graduates in various subjects including Linux, Network, Security, and more..
Computer Science can sometimes be theoretical and learning from practical example is a must.
Provides practical challenges with guidance for graduates in various subjects including Linux, Network, Security, and more..
Computer Science can sometimes be theoretical and learning from practical example is a must.
I'm maintaining the following list of freely available books and articles about computer science, programming, math, and physics:
https://github.com/bobeff/programming-math-science
On CodeCrafters.io (YC S22), you can learn to build your own Git, Docker, Redis etc — in any programming language.
It’s a great way to grok a variety of system design principles while getting to master a language of your choice
It’s a great way to grok a variety of system design principles while getting to master a language of your choice
Cornell CS 3110 - OCaml, lectures on YouTube https://www.youtube.com/playlist?app=desktop&list=PLre5AT9Jn...
I collected a large number of awesome resources for myself:
https://github.com/kirillbobyrev/computer-science-resources
https://github.com/kirillbobyrev/computer-science-resources
https://www.csunplugged.org/en/ is pretty nice for computational thinking
Lots of universities offer free online courses:
https://www.classcentral.com/universities
https://www.classcentral.com/universities
Dive Into Systems free book:
https://diveintosystems.org/
https://diveintosystems.org/
# Programming
"A Data-Centric Introduction to Computing"
https://dcic-world.org/
# Programming Language Theory
"Programming Languages: Application and Interpretation"
https://www.plai.org/
"Crafting Interpreters"
https://craftinginterpreters.com/
# Algorithms/Data Structures
* Pure C *
"Algorithmic Thinking: A Problem-Based Introduction"
https://nostarch.com/algorithmic-thinking-2nd-edition
# Competitive Programming/Interviews
"Competitive Programming book, 4th edition (CP4)"
https://cpbook.net/
"Elements of Programming Interviews in Python"
http://elementsofprogramminginterviews.com/
# Compilation
"Essentials of Compilation: An Incremental Approach in Python"
https://github.com/IUCompilerCourse/Essentials-of-Compilatio...
# Database Systems
"CMU: Intro to Database Systems"
https://15445.courses.cs.cmu.edu/
"CMU: Advanced Database Systems"
https://15721.courses.cs.cmu.edu/
# Calculus I/II & Real Analysis
"A Course in Calculus and Real Analysis"
https://link.springer.com/book/10.1007/978-3-030-01400-1
"A Course in Multivariable Calculus and Analysis"
https://link.springer.com/book/10.1007/978-1-4419-1621-1
# Physics
"Matter and Interactions"
https://matterandinteractions.org/
# Linear Algebra & ML
* A Series of books by prof. Joe Suzuki without using any external library for the implementations *
"Statistical Learning with Math and Python"
https://link.springer.com/book/10.1007/978-981-15-7877-9
"Sparse Estimation with Math and Python"
https://link.springer.com/book/10.1007/978-981-16-1438-5
"Kernel Methods for Machine Learning with Math and Python"
https://link.springer.com/book/10.1007/978-981-19-0401-1
# Discrete Mathematics
"CMU 21-228 Discrete Mathematics (prof. Poh-Shen Loh"
https://www.math.cmu.edu/~ploh/2021-228.shtml
# Mathematical Logic
"Mathematical Logic Through Python"
https://www.logicthrupython.org/
# CS Complexity and Theory:
Courses by Ryan O'Donnell at CMU
http://www.cs.cmu.edu/~odonnell/
# Cryptography
"Serious Cryptography: A Practical Introduction to Modern Encryption"
https://nostarch.com/seriouscrypto
# Problem Solving
"Math 235: Mathematical Problem Solving"
https://www.cip.ifi.lmu.de/~grinberg/t/20f
# Computer Graphics
* Also look up the course by @pikuma for a pure c impl without OpenGL *
"Computer Graphics from Scratch: A Programmer's Introduction to 3D Rendering"
https://gabrielgambetta.com/computer-graphics-from-scratch/
"The Ray Tracer Challenge A Test-Driven Guide to Your First 3D Renderer"
https://pragprog.com/titles/jbtracer/the-ray-tracer-challeng...
# Reverse Engineering
"Reverse Engineering for Beginners"
https://beginners.re/
# SAT/SMT
"SAT/SMT by Example"
https://sat-smt.codes/
Also Hakan Kjellerstrand's z3 page:
http://www.hakank.org/z3/
# Game Engine Development
* 2/4 volumes out (no digital format for the 2 pending volumes due to the authors "piracy" concerns *
"Foundations of Game Engine Development"
https://foundationsofgameenginedev.com/
# Creative Coding
"Generative Design: Visualize, Program, and Create with JavaScript in p5.js"
http://www.generative-gestaltung.de/2/
Articles by Tyler Hobbs specially the one on "Flow Fields" :
https://tylerxhobbs.com/essays/2020/flow-fields
Articles by Sighack specially the one on "Watercolor Techniques":
https://sighack.com/post/generative-watercolor-in-processing
"A Data-Centric Introduction to Computing"
https://dcic-world.org/
# Programming Language Theory
"Programming Languages: Application and Interpretation"
https://www.plai.org/
"Crafting Interpreters"
https://craftinginterpreters.com/
# Algorithms/Data Structures
* Pure C *
"Algorithmic Thinking: A Problem-Based Introduction"
https://nostarch.com/algorithmic-thinking-2nd-edition
# Competitive Programming/Interviews
"Competitive Programming book, 4th edition (CP4)"
https://cpbook.net/
"Elements of Programming Interviews in Python"
http://elementsofprogramminginterviews.com/
# Compilation
"Essentials of Compilation: An Incremental Approach in Python"
https://github.com/IUCompilerCourse/Essentials-of-Compilatio...
# Database Systems
"CMU: Intro to Database Systems"
https://15445.courses.cs.cmu.edu/
"CMU: Advanced Database Systems"
https://15721.courses.cs.cmu.edu/
# Calculus I/II & Real Analysis
"A Course in Calculus and Real Analysis"
https://link.springer.com/book/10.1007/978-3-030-01400-1
"A Course in Multivariable Calculus and Analysis"
https://link.springer.com/book/10.1007/978-1-4419-1621-1
# Physics
"Matter and Interactions"
https://matterandinteractions.org/
# Linear Algebra & ML
* A Series of books by prof. Joe Suzuki without using any external library for the implementations *
"Statistical Learning with Math and Python"
https://link.springer.com/book/10.1007/978-981-15-7877-9
"Sparse Estimation with Math and Python"
https://link.springer.com/book/10.1007/978-981-16-1438-5
"Kernel Methods for Machine Learning with Math and Python"
https://link.springer.com/book/10.1007/978-981-19-0401-1
# Discrete Mathematics
"CMU 21-228 Discrete Mathematics (prof. Poh-Shen Loh"
https://www.math.cmu.edu/~ploh/2021-228.shtml
# Mathematical Logic
"Mathematical Logic Through Python"
https://www.logicthrupython.org/
# CS Complexity and Theory:
Courses by Ryan O'Donnell at CMU
http://www.cs.cmu.edu/~odonnell/
# Cryptography
"Serious Cryptography: A Practical Introduction to Modern Encryption"
https://nostarch.com/seriouscrypto
# Problem Solving
"Math 235: Mathematical Problem Solving"
https://www.cip.ifi.lmu.de/~grinberg/t/20f
# Computer Graphics
* Also look up the course by @pikuma for a pure c impl without OpenGL *
"Computer Graphics from Scratch: A Programmer's Introduction to 3D Rendering"
https://gabrielgambetta.com/computer-graphics-from-scratch/
"The Ray Tracer Challenge A Test-Driven Guide to Your First 3D Renderer"
https://pragprog.com/titles/jbtracer/the-ray-tracer-challeng...
# Reverse Engineering
"Reverse Engineering for Beginners"
https://beginners.re/
# SAT/SMT
"SAT/SMT by Example"
https://sat-smt.codes/
Also Hakan Kjellerstrand's z3 page:
http://www.hakank.org/z3/
# Game Engine Development
* 2/4 volumes out (no digital format for the 2 pending volumes due to the authors "piracy" concerns *
"Foundations of Game Engine Development"
https://foundationsofgameenginedev.com/
# Creative Coding
"Generative Design: Visualize, Program, and Create with JavaScript in p5.js"
http://www.generative-gestaltung.de/2/
Articles by Tyler Hobbs specially the one on "Flow Fields" :
https://tylerxhobbs.com/essays/2020/flow-fields
Articles by Sighack specially the one on "Watercolor Techniques":
https://sighack.com/post/generative-watercolor-in-processing
this isn’t nearly as comprehensive, but Michael Collins’ notes on machine learning for NLP are really succinct and IMO intuitive
http://www.cs.columbia.edu/~mcollins/
(search for notes, where he’s listed links to pdfs he uses in classes)
http://www.cs.columbia.edu/~mcollins/
(search for notes, where he’s listed links to pdfs he uses in classes)
[deleted]
Yes
What are some of the best materials (courses, books, notes, video talks, etc) on any CS/programming topic that you have gone through or know of?
Also mention a bit about why it is useful.