Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems (Computational Neuroscience) [Paperback]

Peter Dayan (Author), Laurence F. Abbott (Author)

Book Description

ISBN-10: 0262541858 | ISBN-13: 978-0262541855 | Publication Date: September 1, 2005 | Edition: 1

Theoretical neuroscience provides a quantitative basis for describing what nervous systems do, determining how they function, and uncovering the general principles by which they operate. This text introduces the basic mathematical and computational methods of theoretical neuroscience and presents applications in a variety of areas including vision, sensory-motor integration, development, learning, and memory.The book is divided into three parts. Part I discusses the relationship between sensory stimuli and neural responses, focusing on the representation of information by the spiking activity of neurons. Part II discusses the modeling of neurons and neural circuits on the basis of cellular and synaptic biophysics. Part III analyzes the role of plasticity in development and learning. An appendix covers the mathematical methods used, and exercises are available on the book's Web site.

Editorial Reviews

Review

"Eugene Izhikevich has written an excellent introduction to the application of nonlinear dynamics to the spiking patterns of neurons. There are dozens of clear illustrations and hundreds of exercises ranging from the very easy to Ph.D.-level questions. The book will be suitable for mathematicians and physicists who want to jump into this exciting field as well as for neuroscientists who desire a deeper understanding of the utility of nonlinear dynamics applied to biology."--Bard Ermentrout, Department of Mathematics, University of Pittsburgh

"Upon the ruins of Freud's failed attempt to construct a universal theory of mind, Hobson builds a catholic, brain-based edifice to account for the phenomenology of awake consciousness, sleep, and dreams in sickness and health. Its cornerstone--that dreaming, psychosis, and psychedelic experiences are closely related phenomena caused by specific alterations in the brain's neuromodulatory systems--allows him to explain a dizzying variety of altered states--from hypnosis to lucid dreaming, from out-of-body to religious experiences, mind-altering drugs and so on--within a single framework."--Christof Koch, Lois and Victor Troendle Professor of Cognitive and Behavioral Biology, California Institute of Technology

"It will not be surprising if this book becomes the standard text for students and researchers entering theoretical neuroscience for years to come." M. Brandon Westover Philosophical Psychology

"Not only does the book set a high standard for theoretical neuroscience, it defines the field." Dmitri Chklovskii Neuron

"Peter Dayan and L. F. Abbott have crafted an excellent introduction to the various methods of modeling nervous system function. The chapters dealing with neural coding and information theory are particularly welcome because these are new areas that are not well represented in existing texts."--Phillip S. Ulinski, Committee on Computational Neuroscience, University of Chicago

"Dayan and Abbott inspire us with a work of tremendous breadth, and each chapter is more exciting than the next. Everyone with an interest in neuroscience will want to read this book. A truly remarkable effort by two of the leaders in the field."--P. Read Montague, Professor, Division of Neuroscience, and Director, Center for Theoretical Neuroscience, Baylor College of Medicine

"An excellent book. There are a few volumes already available in theoretical neuroscience but none have the scope that this one does."--Bard Ermentrout, Department of Mathematics, University of Pittsburgh

"Theoretical Neuroscience provides a rigorous introduction to how neurons code, compute, and adapt. It is a remarkable synthesis of advances from many areas of neuroscience into a coherent computational framework. This book sets the standards for a new generation of modelers."--Terrence J. Sejnowski, Howard Hughes Medical Institute, Salk Institute for Biological Studies, and University of California, San Diego

"The first comprehensive textbook on computational neuroscience. The topics covered span the gamut from biophysical faithful single cell models to neural networks, from the way nervous systems encode information in spike trains to how this information might be decoded, and from synaptic plasticity to supervised and unsupervised learning. And all of this is presented in a sophisticated yet accessible manner. A must buy for anybody who cares about the way brains compute."--Christof Koch, Lois and Victor Troendle Professor of Cognitive and Behavioral Biology, California Institute of Technology

"Theoretical Neuroscience marks a milestone in the scientific maturation of integrative neuroscience. In the last decade, computational and mathematical modelling have developed into an integral part of the field, and now we finally have a textbook that reflects the changes in the way our science is being done. It will be a standard source of knowledge for the coming generation of students, both theoretical and experimental. I urge anyone who wants to be part of the development of this science in the next decades to get this book. Read it, and let your students read it."--John Hertz, Nordita (Nordic Institute for Theoretical Physics), Denmark

"The more we learn about the brain, the more we are coming to realize that understanding its development will be a key tounlocking its functions, especially its ability to adapt to new environments. The wide range of levels of development that can be studied, from the molecular to the cognitive, are described in this book by some of the leading researchers in this growing field of computational neural development."--Terrence J. Sejnowski, Howard Hughes Medical Institute, Salk Institute for Biological Studies, and University of California, San Diego

About the Author

L. F. Abbott is the Nancy Lurie Marks Professor of Neuroscience and Director of the Volen Center for Complex Systems at Brandeis University. He is the coeditor of Neural Codes and Distributed Representations (MIT Press, 1999).

Product Details

• Paperback: 480 pages
• Publisher: The MIT Press; 1 edition (September 1, 2005)
• Language: English
• ISBN-10: 0262541858
• ISBN-13: 978-0262541855
• Product Dimensions: 10 x 7.8 x 0.9 inches
• Shipping Weight: 2 pounds (View shipping rates and policies)
• Average Customer Review: 3.9 out of 5 stars  See all reviews (8 customer reviews)
• Amazon Best Sellers Rank: #63,685 in Books (See Top 100 in Books)
  • #6 in Books > Computers & Technology > Computer Science > Artificial Intelligence > Neural Networks
  • #21 in Books > Computers & Technology > Graphic Design > 3D Graphics

More About the Author

Discover books, learn about writers, read author blogs, and more.

Customer Reviews

Most Helpful Customer Reviews

47 of 54 people found the following review helpful:

4.0 out of 5 stars Good overview, May 24, 2003

By 

Dr. Lee D. Carlson (Baltimore, Maryland USA) - See all my reviews
(VINE VOICE)    (HALL OF FAME REVIEWER)    (REAL NAME)   

Amazon Verified Purchase

This review is from: Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems (Hardcover)

This book is a detailed overview of the computational modeling of nervous systems from the molecular and cellular level and from the standpoint of human psychophysics and psychology. They divide their conception of modeling into descriptive, mechanistic, and interpretive models. My sole interest was in Part 3, which covers the mathematical modeling of adaptation and learning, so my review will be confined to these chapters. The virtue of this book, and others like it, is the insistence on empirical validation of the models, and not their justification by "thought experiments" and arm-chair reasoning, as is typically done in philosophy.

Part 3 begins with a discussion of synaptic plasticity and to what degree it explains learning and memory. The goal here is to develop mathematical models to understand how experience and training modify the neuronal synapses and how these changes effect the neuronal patterns and the eventual behavior. The Hebb model of neuronal firing is ubiquitous in this area of research, and the authors discuss it as a rule that synapses change in proportion to the correlation of the activities of pre- and postsynaptic neurons. Experimental data is immediately given that illustrates long-term potentiation (LTP) and long-term depression (LTD). The authors concentrate mostly on models based on unsupervised learning in this chapter. The rules for synaptic modification are given as differential equations and describe the rate of change of the synaptic weights with respect to the pre- and postsynaptic activity. The covariance and BCM rules are discussed, the first separately requiring postsynaptic and presynaptic activity, the second requiring both simultaneously. The authors consider ocular dominance in the context of unsupervised learning and study the effect of plasticity on multiple neurons. The last section of the chapter covers supervised learning, in which a set of inputs and the desired outputs are imposed during training.

In the next chapter, the authors consider the area of reinforcement learning, beginning with a discussion of the mathematical models for classical conditioning, and introducing the temporal difference learning algorithm. The authors discuss the Rescorla-Wagner rule , which is a trial-by-trial learning rule for the weight adjustments, in terms of the reward, the prediction, and the learning rate. They then discuss more realistic policies such as static action choice, where the reward/punishment immediately follows the action taken, and sequential action choice, where rewards may be delayed. The authors discuss foraging behavior of bees as an example of static action choice, reducing it to a stochastic two-armed bandit problem. The maze task for rats is discussed as an example of sequential action choice, and the authors reduce it to the "actor-critic algorithm." A generalized reinforcement learning algorithm is then discussed, with the rat water maze problem given as an example.

Chapter 10 is an overview of what the authors call "representational learning", which, as they explain, is a study of neural representations from a computational point of view. The goal is to begin with sensory input and find out how representations are generated on the basis of these inputs. That such representations are necessary is based on for example the consideration of the visual system, since, argue the authors, what is presented at the retina is too crude for an accurate representation of the visual world. The main strategy in the chapter is to begin with a deterministic or probabilistic input and construct a recognition algorithm that gives an estimate of the input. The algorithms constructed are all based on unsupervised learning, and hence the existence and nature of the causes must be computed using heuristics and the statistics of the input data. These two requirements are met via the construction of first a generative model and then a recognition model in the chapter. The familiar 'expectation maximization' is discussed as a method of optimization between real and synthetic data in generative models. A detailed overview of expectation maximization is given in the context of 'density estimation'. The authors then move on to discuss causal models for density estimation, such as Gaussian mixtures, the K-means algorithm, factor analysis, and principal components analysis. They then discuss sparse coding, as a technique to deal with the fact that the cortical activity is not Gaussian. They illustrate an experimental sample, showing the activity follows an exponential distribution in a neuron in the inferotemporal area of the macaque brain. The reader will recognize 'sparse' probability distributions as being 'heavy-tailed', i.e. having values close to zero usually, but ones far from zero sometimes. The authors emphasize the difficulties in the computation of the recognition distribution explicitly. The Olshausen/Field model is used to give a deterministic approximate recognition model for this purpose. The authors then give a fairly detailed overview of a two-layer, nonlinear 'Helmholtz machine' with binary inputs. They illustrate how to obtain the expectation maximization in terms of the Kullback-Leibler divergence. The learning in this model takes place via stochastic sampling and occurs in two phases, the so-called "wake and sleep" algorithm. The last section of the chapter gives a general discussion of how recent interest in coding, transmitting, and decoding images has led to much more research into representational learning algorithms. They discuss multi-resolution decomposition and its relationship to the coding algorithms available.

17 of 20 people found the following review helpful:

5.0 out of 5 stars Great textbook and reference, August 15, 2003

By 

Geoffrey Goodhill (Washington, DC United States) - See all my reviews

This review is from: Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems (Hardcover)

This book is certainly the most thorough textbook currently available
on many aspects of computational neuroscience. It works very carefully
through the fundamental assumptions and equations underlying large
tracts of contemporary quantitative analysis in neuroscience. It is
an ideal introductory book for those with a quantitative background,
and is destined to become a standard course book in the field.

19 of 25 people found the following review helpful:

4.0 out of 5 stars Theoretical Neurosciences from a Computational Perspective, June 10, 2004

By 

Joseph J Grenier "jjg MD PhD" (Aurora, IL United States) - See all my reviews
(REAL NAME)   

This review is from: Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems (Hardcover)

This text will become a standard course book for Graduate Schools in Computational Neurosciences. You need to know advanced engineering mathematics & probability theory to be able to understand this book. Dayan & Abbott model primary visual cortical, MT, LIP, and Motor cortical neurons as single units, but also as populations (clusters) of firing cells. They discuss Bayes Theorem, probability theory as it applies to the brain, and parietal lobe function as well. They derive all the equations associated with these models for the student so that more advanced parts of the book are comprehensible. The book is not meant to be a general Neuroscience book, but rather a course book about neuronal modeling, computational neurobiology, and neural engineering. It serves these three purposes well. In my opinion, this is the best written account of neuron modeling out there for the graduate student and researcher. Methods in Neuronal Modeling by Christof Koch is the other great book on this subject. If you own these two books you should be able to advance in high level neural modelling. There are numerous equations and formulae of interest throughout each chapter in these two volumes. The price of 39.00 USD for the hardcover is really quite a bargain.