I can whole-heartedly recommend "The Ray Tracer Challenge" by Jamis Buck. It's a fun project-based book without all the computer graphics theory, where you focus on building a ray tracer in small increments while Jamis holds your hand until you can walk on your own. As a small bonus, you get to generate some awesome images pretty quickly.