The contenders seems to be:
- Linear Algebra Done Right - Sheldon Axler
- Liner Algebra Done Wrong - Sergei Treil
- Introduction to Linea Algebra - Gilbert Strang
- Introduction to Applied Linear Algebra: Vectors, Matrices, and Least Squares by Stephen Boyd and Lieven Vandenberghe
[1] https://www.youtube.com/playlist?list=PLZHQObOWTQDPD3MizzM2x...
I recommend and teach my YouTube Live series out of Fraleigh [1], but unfortunately it's out of print. Lay seems to be a good modern alternative.
Since it doesn't neglect computation, it's great as an introductory text.
After that, and some other math courses you can move on to Linear Algebra Done Right.
I ended up getting a math PhD so it must have done somethings right!
There are some central concepts, and which ones matter to you depends on what you're planning to do with your future. The key points are:
* Matrices/vectors as grids of numbers/computational tools.
* Matrices/vectors as positions and transformations of those positions.
* Matrices/vectors as more abstract geometric objects
* Matrices/vectors as algebraic objects.
There is no 'done right' imo. My sense is LADW is probably the best option for a motivated honors math student, because unlike Axler the author doesn't hate determinants for whatever reason. Strang would work well for engineers. Axler is mostly concerned with the last two, but IMO this makes him kinda niche.
LADW and LADR are great too, for an honors approach with more focus on proofs. To me it would make more sense on a second pass.
That‘s fine, but I would have appreciated notices, which proofs and theorems do not hold in the general case.
It‘s an exercise for the reader.
> This book usually develops linear algebra simultaneously for real and complex vector spaces by letting F denote either the real or the complex numbers. If you and your students prefer to think of F as an arbitrary field, then see the comments at the end of Section 1A. I prefer avoiding arbitrary fields at this level because they introduce extra abstraction without leading to any new linear algebra
And the remarks at the end of 1A are that if you want to, you can think of F as an arbitrary field everywhere except the sections on inner product spaces and where the given field is C you can frequently also use any other algebraically closed field.TBH, I don’t think there are surprises in the “general case” (whatever that is… modules over a PID??) that you can’t see by understanding the real&complex situation.
"[per Treil, LADW is for] a student who, while not yet very familiar with abstract reasoning, is willing to study more rigorous mathematics than what is presented in a “cookbook style” calculus type course."
But yeah it's really attempting to introduce you to higher mathematics rather than get you comfortable doing linear algebra per se.
(I don't doubt it at all! I'm just curious.)
The applications not only provided the context to get a deeper understanding of the concepts, it also made the math relevant to the real world. By showing a range of problems, from the chemical stoichiometry to the algorithmic SVD, it inspires the reader to look for more problems that can be solved with the toolset being introduced.
For a first exposure, these days it's hard to do better than Math Academy [0]. It'll diagnose all your weak points (including what prereqs you might not have) and handle all the scheduling using spaced repetition and knowledge about how the topics relate to each other.
All you have to do is keep showing up and do the work for 30+ minutes per day.
Looks like it may be a useful read after I've mastered the first edition more :)
The FFT and SVD chapters have actually ended up being the basis of a few research projects I've done. The writing really has a way of reframing concepts in very insightful ways.
If you liked 3B1B's style, you will prefer strang over axler. Axler and treil to a greater extent focus on bringing out the abstract elegance and the kind of rigour a math major enjoys. Strang's book also has videos accompanying - on MIT OCW.
B&V VMLS on your list is interesting - they focus a lot on real-world instantiations of the concepts and have you code up things in the (excellent) exercises. Depending on your goals, you can do only this, or strang and then this. Definitely look at the exercises in any case though.
If you are SELF-teaching, you need to learn how to figure things out.
When you can’t, there’s plenty of sources. It’s not the 1990s. Your favorite LLM probably gives good explanations of linear algebra ideas even on fast mode. Gemini was surprisingly good for me.
Axler is more of a pure math textbook - if you want to dive more into proofs and abstractions.
The easiest conceptual handle is geometric: volume expansion, but seeing how this is related to the combinatorial sum over all permutations, or how those two point of views are related to the algebraic one (that a set of equations having a solution or not), is not easy to see even in the 2D case.
I won't be surprised if math professors don't have this issue like you said (especially if someone is comfortable with wedge products), but the vast majority of newcomers who are interested in understanding why something works rather than just how to use it struggle all the time with determinants.
Agreed that it should help if you got to learn wedge products first (I didn't).
I think this is what led me to feel unhappy about determinants when I was a first-year university student. You need to actually prove that the determinant is the volume of the N-dimensional parallelepiped, and the axiomatic proof doesn't do that.
So you need basically two extra lines after proving those things so that people can say "okay, the determinant eats ignores all input vector non-orthogonality so that it gives volume".
But I don't know, it's been a very long time for me. It's good to have a variety of approaches to the subject.
1. Excellent exercises. Challenging. Really make you put the concepts together.
2. Good, opinionated pedagogy. If you agree with the philosophy (among other things, determinants are not a beginner tool), the explanations are good.
LADR is hardly the only book to eschew determinants for a long time. IIRC Lang takes a similar approach, but is not as digestible.
Linear Algebra Done Right 58 points, July 2023, 4 comments https://news.ycombinator.com/item?id=36576114
Linear Algebra Done Right – 4th Edition, 631 points, Oct 2023, 294 comments https://news.ycombinator.com/item?id=38060159
Linear Algebra Done Right [pdf], 85 points, Sept 2024, 39 comments https://news.ycombinator.com/item?id=41416799
linear_algebra_done_right.pdf, 0 pages read, July 2023
linear_algebra_done_right (1).pdf, 0 pages read, Oct 2023
linear_algebra_done_right (2).pdf, 0 pages read, Sept 2024
Downloading (3) now.
and the printable concept maps here: https://minireference.com/static/conceptmaps/linear_algebra_...
I remember from my tutoring days how useful they were to organize the different concepts covered in each lesson: I would start with a blank sheet and make the student add concepts to it as the lesson progressed, then by the end of the lesson use the concept map to review what we learned. Specifically, I would ask them to explain in their own words each "arrow" which was a great way to uncover misconceptions and solidify the material.
Once I'm done with editing the current book[1], I hope to have time to work on making dynamic concept maps that you can click on and explore/zoom-in on. I feel it would be cool to jump between detailed view (concepts), intermediate scale (topics), and high-level view (subjects).
This is the best I know: https://www.youtube.com/watch?v=Fnfh8jNqBlg&list=PLlXfTHzgMR....
[0] I meant natural language
LibFlame has long been abandoned now but their courses were very strong when you had access to the professors. They have been rebranded as the Science of High Performance Computing (SHPC) group.
What polemic? Defining the determinant as the unique multilinear alternating form satisfying certain properties is very normal (and in fact the only way that really makes sense for both finite- and infinite-dimensional vector spaces). There are zero unusual things with this book imo.
https://www.axler.net/DwD.html
A strange and unpopular opinion.
This advanced textbook on linear algebra and geometry covers a wide range of classical and modern topics. Differing from existing textbooks in approach, the work illustrates the many-sided applications and connections of linear algebra with functional analysis, quantum mechanics and algebraic and differential geometry. The subjects covered in some detail include normed linear spaces, functions of linear operators, the basic structures of quantum mechanics and an introduction to linear programming. Also discussed are Kahler's metic, the theory of Hilbert polynomials, and projective and affine geometries. Unusual in its extensive use of applications in physics to clarify each topic, this comprehensice volume should be of particular interest to advanced undergraduates and graduates in mathematics and physics, and to lecturers in linear and multilinear algebra, linear programming and quantum mechanics.
https://ruor.uottawa.ca/items/f66a4ede-e276-486c-9067-9621d5...
Really felt like being thrown in the deep end at the time, especially since it was my first exposure to proofs. Very rewarding when it finally started coming together, though.
Possibly paired with some numerical algebra free text (many on the Internet)
On a daytime episode of David Letterman, Isaac Asimov predicted fiber optics would one day bring about television studios in people's homes: https://youtu.be/cIB1b_8hqB0?si=212sGzZ71VIZORML&t=696
All sources of understanding are so very much appreciated.
Thanks!
I am assuming game developers are interested in the applications of Linear Algebra and there are many other books that are far suited for that.
Anyone from game dev community care to elaborate ?
i think lot of ppl are under the impression that long courses are a prerequiste to even start exploring ai/ml.
doing long prerequeste courses is why lot of ppl drop out even before getting to ai
As with most textbooks, it fails to motivate why reading it is worth the investment. Perhaps it is a millennial old tradition of the Greek mystery schools, that the rite of passage came by proving your commitment to material knowledge without anything but fate in the school itself as motivation.
Rigor before Worth.
(Yes this is a pet peeve of mine :)