Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems (Paperback)

by Peter Dayan (Author), L. F. Abbott (Author) "Neurons are remarkable among the cells of the body in their ability to propagate signals rapidly over large distances..." (more)
Key Phrases: nonbranching cable, softmax distribution, temporal difference rule, Mathematical Appendix, Monte Carlo (more...)

Editorial Reviews

Review
"It will not be surprising if this book becomes the standard text for students and researchers entering theoretical neuroscience for years to come."
— M. Brandon Westover, Philosophical Psychology

"Not only does the book set a high standard for theoretical neuroscience, it defines the field."
— Dmitri Chklovskii, Neuron

Product Description
Theoretical neuroscience provides a quantitative basis for describing what nervous systems do, determining how they function, and uncovering the general principles by which they operate. This text introduces the basic mathematical and computational methods of theoretical neuroscience and presents applications in a variety of areas including vision, sensory-motor integration, development, learning, and memory.

The book is divided into three parts. Part I discusses the relationship between sensory stimuli and neural responses, focusing on the representation of information by the spiking activity of neurons. Part II discusses the modeling of neurons and neural circuits on the basis of cellular and synaptic biophysics. Part III analyzes the role of plasticity in development and learning. An appendix covers the mathematical methods used, and exercises are available on the book's Web site.

See all Editorial Reviews

Product Details

• Paperback: 480 pages
• Publisher: The MIT Press; 1 edition (September 1, 2005)
• Language: English
• ISBN-10: 0262541858
• ISBN-13: 978-0262541855
• Product Dimensions: 9.9 x 7.9 x 1 inches
• Shipping Weight: 2 pounds (View shipping rates and policies)
• Average Customer Review: 4.1 out of 5 stars See all reviews (7 customer reviews)
• Amazon.com Sales Rank: #80,197 in Books (See Bestsellers in Books)

  Popular in this category: (What's this?)

  #14 in

  Books > Computers & Internet > Computer Science > Artificial Intelligence > Neural Networks

Customer Reviews

Most Helpful Customer Reviews

38 of 43 people found the following review helpful:

4.0 out of 5 stars Good overview, May 24, 2003

By	Dr. Lee D. Carlson (Baltimore, Maryland USA) - See all my reviews (TOP 100 REVIEWER)    (REAL NAME)

This review is from: Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems (Hardcover)

This book is a detailed overview of the computational modeling of nervous systems from the molecular and cellular level and from the standpoint of human psychophysics and psychology. They divide their conception of modeling into descriptive, mechanistic, and interpretive models. My sole interest was in Part 3, which covers the mathematical modeling of adaptation and learning, so my review will be confined to these chapters. The virtue of this book, and others like it, is the insistence on empirical validation of the models, and not their justification by "thought experiments" and arm-chair reasoning, as is typically done in philosophy.

Part 3 begins with a discussion of synaptic plasticity and to what degree it explains learning and memory. The goal here is to develop mathematical models to understand how experience and training modify the neuronal synapses and how these changes effect the neuronal patterns and the eventual behavior. The Hebb model of neuronal firing is ubiquitous in this area of research, and the authors discuss it as a rule that synapses change in proportion to the correlation of the activities of pre- and postsynaptic neurons. Experimental data is immediately given that illustrates long-term potentiation (LTP) and long-term depression (LTD). The authors concentrate mostly on models based on unsupervised learning in this chapter. The rules for synaptic modification are given as differential equations and describe the rate of change of the synaptic weights with respect to the pre- and postsynaptic activity. The covariance and BCM rules are discussed, the first separately requiring postsynaptic and presynaptic activity, the second requiring both simultaneously. The authors consider ocular dominance in the context of unsupervised learning and study the effect of plasticity on multiple neurons. The last section of the chapter covers supervised learning, in which a set of inputs and the desired outputs are imposed during training.

In the next chapter, the authors consider the area of reinforcement learning, beginning with a discussion of the mathematical models for classical conditioning, and introducing the temporal difference learning algorithm. The authors discuss the Rescorla-Wagner rule , which is a trial-by-trial learning rule for the weight adjustments, in terms of the reward, the prediction, and the learning rate. They then discuss more realistic policies such as static action choice, where the reward/punishment immediately follows the action taken, and sequential action choice, where rewards may be delayed. The authors discuss foraging behavior of bees as an example of static action choice, reducing it to a stochastic two-armed bandit problem. The maze task for rats is discussed as an example of sequential action choice, and the authors reduce it to the "actor-critic algorithm." A generalized reinforcement learning algorithm is then discussed, with the rat water maze problem given as an example.

Chapter 10 is an overview of what the authors call "representational learning", which, as they explain, is a study of neural representations from a computational point of view. The goal is to begin with sensory input and find out how representations are generated on the basis of these inputs. That such representations are necessary is based on for example the consideration of the visual system, since, argue the authors, what is presented at the retina is too crude for an accurate representation of the visual world. The main strategy in the chapter is to begin with a deterministic or probabilistic input and construct a recognition algorithm that gives an estimate of the input. The algorithms constructed are all based on unsupervised learning, and hence the existence and nature of the causes must be computed using heuristics and the statistics of the input data. These two requirements are met via the construction of first a generative model and then a recognition model in the chapter. The familiar 'expectation maximization' is discussed as a method of optimization between real and synthetic data in generative models. A detailed overview of expectation maximization is given in the context of 'density estimation'. The authors then move on to discuss causal models for density estimation, such as Gaussian mixtures, the K-means algorithm, factor analysis, and principal components analysis. They then discuss sparse coding, as a technique to deal with the fact that the cortical activity is not Gaussian. They illustrate an experimental sample, showing the activity follows an exponential distribution in a neuron in the inferotemporal area of the macaque brain. The reader will recognize 'sparse' probability distributions as being 'heavy-tailed', i.e. having values close to zero usually, but ones far from zero sometimes. The authors emphasize the difficulties in the computation of the recognition distribution explicitly. The Olshausen/Field model is used to give a deterministic approximate recognition model for this purpose. The authors then give a fairly detailed overview of a two-layer, nonlinear 'Helmholtz machine' with binary inputs. They illustrate how to obtain the expectation maximization in terms of the Kullback-Leibler divergence. The learning in this model takes place via stochastic sampling and occurs in two phases, the so-called "wake and sleep" algorithm. The last section of the chapter gives a general discussion of how recent interest in coding, transmitting, and decoding images has led to much more research into representational learning algorithms. They discuss multi-resolution decomposition and its relationship to the coding algorithms available.

16 of 19 people found the following review helpful:

5.0 out of 5 stars Great textbook and reference, August 15, 2003

By	Geoffrey Goodhill (Washington, DC United States) - See all my reviews

This review is from: Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems (Hardcover)

This book is certainly the most thorough textbook currently available
on many aspects of computational neuroscience. It works very carefully
through the fundamental assumptions and equations underlying large
tracts of contemporary quantitative analysis in neuroscience. It is
an ideal introductory book for those with a quantitative background,
and is destined to become a standard course book in the field.

15 of 21 people found the following review helpful:

4.0 out of 5 stars Theoretical Neurosciences from a Computational Perspective, June 10, 2004

By	Joseph J Grenier "jjg MD PhD" (Aurora, IL United States) - See all my reviews (REAL NAME)

This review is from: Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems (Hardcover)

This text will become a standard course book for Graduate Schools in Computational Neurosciences. You need to know advanced engineering mathematics & probability theory to be able to understand this book. Dayan & Abbott model primary visual cortical, MT, LIP, and Motor cortical neurons as single units, but also as populations (clusters) of firing cells. They discuss Bayes Theorem, probability theory as it applies to the brain, and parietal lobe function as well. They derive all the equations associated with these models for the student so that more advanced parts of the book are comprehensible. The book is not meant to be a general Neuroscience book, but rather a course book about neuronal modeling, computational neurobiology, and neural engineering. It serves these three purposes well. In my opinion, this is the best written account of neuron modeling out there for the graduate student and researcher. Methods in Neuronal Modeling by Christof Koch is the other great book on this subject. If you own these two books you should be able to advance in high level neural modelling. There are numerous equations and formulae of interest throughout each chapter in these two volumes. The price of 39.00 USD for the hardcover is really quite a bargain.