If you're into math in general or want to get into the deep tech of game development (or 3D immersive media in general) I recommend reading these books first
The essential absolute starting textbook for core math, transformations, and ray tracing.
Fundamentals of Computer Graphics, Fourth Edition
The comprehensive classic encyclopedia of computer graphics algorithms, hardware, and mathematics.
Computer Graphics: Principles and Practice - James D. Foley
A highly visual guide targeting vector math, coordinate spaces, and matrices.
3D Math Primer for Graphics and Game Development
The ultimate definitive reference for graphics pipelines, shading, and global illumination.
Real-Time Rendering Fourth Edition
An advanced math resource covering geometry, lighting, and visibility determination.
Mathematics for 3D Game Programming and Computer ...
The industry-standard bible for photorealistic ray tracing and light simulation.
Physically Based Rendering: From Theory to Implementation
