The book consists of three parts. The first part introduces concepts and algorithms in optimization theory, which have been used in neural network research. The second part covers main neural network models and their theoretical analysis. The third part of the book introduces various neural network models for solving nonlinear programming problems and combinatorial optimization problems. Audience: Graduate students and researchers who are interested in the intersection of optimization theory and artificial neural networks. The book is appropriate for graduate courses.