I got my PhD in math and took a few grad-level physics class since.
TeX-based notes in many math classes is very doable. I got to the point during my math degree that I could type equations way faster than the professor could write in the board. I still type faster than I write on the board when I teach. Functional analysis and algebra were the best for typewritten notes; numerical analysis was the worst due to the number of matrices.
TeX-based notes in a physics class (especially less theoretical ones) is a slow-moving disaster. Visualization and diagrams (at least for me) are way more important in physics than they were for my math classes.