This book offers a unique pathway to methods of parallel optimization by introducing parallel computing ideas into both optimization theory and into some numerical algorithms for large-scale optimization problems. The three parts of the book bring together relevant theory, careful study of algorithms, and modeling of significant real world problems such as image reconstruction, radiation therapy treatment planning, financial planning, transportation and multi-commodity network flow problems, planning under uncertainty, and matrix balancing problems.