A number of lattice dynamical systems modeling evolution of biological or artificial neural networks will be introduced. An emphasis will be given to the interconnection structures of the neural networks and how they affect the stability of the networks. Effects of uncertain external input and/or time delays in responding to activation will also be addressed. Mathematical tools and techniques used to study the dynamics of these networks will be presented.