Enter your mobile number or email address below and we'll send you a link to download the free Kindle App. Then you can start reading Kindle books on your smartphone, tablet, or computer - no Kindle device required.

  • Apple
  • Android
  • Windows Phone
  • Android

To get the free app, enter your mobile phone number.

Dynamic Programming and Optimal Control (2 Vol Set) 4th Edition

4.7 out of 5 stars 3 customer reviews
ISBN-13: 978-1886529083
ISBN-10: 1886529086
Why is ISBN important?
ISBN
This bar-code number lets you verify that you're getting exactly the right version or edition of a book. The 13-digit and 10-digit formats both work.
Scan an ISBN with your phone
Use the Amazon App to scan ISBNs and compare prices.
Trade in your item
Get a $58.15
Gift Card.
Have one to sell? Sell on Amazon
Buy new
$127.78
In Stock.
Ships from and sold by Amazon.com. Gift-wrap available.
List Price: $134.50 Save: $6.72 (5%)
8 New from $127.78
Dynamic Programming and O... has been added to your Cart
More Buying Choices
8 New from $127.78 14 Used from $215.72
Free Two-Day Shipping for College Students with Prime Student Free%20Two-Day%20Shipping%20for%20College%20Students%20with%20Amazon%20Student


Windows10ForDummiesVideo
Windows 10 For Dummies Video Training
Get up to speed with Windows 10 with this video training course from For Dummies. Learn more.
$127.78 FREE Shipping. In Stock. Ships from and sold by Amazon.com. Gift-wrap available.
click to open popover

Frequently Bought Together

  • Dynamic Programming and Optimal Control (2 Vol Set)
  • +
  • Neuro-Dynamic Programming (Optimization and Neural Computation Series, 3)
  • +
  • Approximate Dynamic Programming: Solving the Curses of Dimensionality, 2nd Edition (Wiley Series in Probability and Statistics)
Total price: $317.13
Buy the selected items together

Editorial Reviews

Review

Review of Vol. I, 3rd Edition: In addition to being very well written and organized, the material has several special features that make the book unique in the class of introductory textbooks on dynamic programming. For instance, it presents both deterministic and stochastic control problems, in both discrete- and continuous-time, and it also presents the Pontryagin minimum principle for deterministic systems together with several extensions. It contains problems with perfect and imperfect information, as well as minimax control methods (also known as worst-case control problems or games against nature). I also has a full chapter on suboptimal control and many related techniques, such as open-loop feedback controls, limited lookahead policies, rollout algorithms, and model predictive control, to name a few. ... In conclusion the book is highly recommendable for an introductory course on dynamic programming and its applications. --Onesimo Hernandez Lerma, in Math Reviews<br \><br \>In this two-volume work Bertsekas caters equally effectively to theoreticians who care for proof of such concepts as the existence and the nature of optimal policies and to practitioners interested in the modeling and the quantitative and numerical solution aspects of stochastic dynamic programming. --Michael Caramanis, in Interfaces<br \><br \>In conclusion, this book is an excellent source of reference ... The main strengths of the book are the clarity of the exposition, the quality and variety of the examples, and its coverage of the most recent advances. --T. W. Archibald, in IMA Jnl. of Mathematics

In this two-volume work Bertsekas caters equally effectively to theoreticians who care for proof of such concepts as the existence and the nature of optimal policies and to practitioners interested in the modeling and the quantitative and numerical solution aspects of stochastic dynamic programming. --Michael Caramanis, in Interfaces

In conclusion, this book is an excellent source of reference ... The main strengths of the book are the clarity of the exposition, the quality and variety of the examples, and its coverage of the most recent advances. --T. W. Archibald, in IMA Jnl. of Mathematics

About the Author

Dimitri Bertsekas is Professor of Electrical Engineering and Computer Science at the Massachusetts Institute of Technology, and a member of the US National Academy of Engineering. He is the recipient of the 2001 A. R. Raggazini AACC education award, the 2009 INFORMS expository writing award, the 2014 Kachiyan Prize, the 2014 AACC Bellman Heritage Award, and the 2015 Dantzig Prize. He has researched a broad variety of subjects from optimization theory, control theory, parallel and distributed computation, systems analysis, and data communication networks. He has written numerous papers in each of these areas, and he has authored or coauthored sixteen textbooks.
NO_CONTENT_IN_FEATURE

The latest book club pick from Oprah
"The Underground Railroad" by Colson Whitehead is a magnificent novel chronicling a young slave's adventures as she makes a desperate bid for freedom in the antebellum South. See more

Product Details

  • Hardcover: 1270 pages
  • Publisher: Athena Scientific; 4th edition (June 18, 2012)
  • Language: English
  • ISBN-10: 1886529086
  • ISBN-13: 978-1886529083
  • Product Dimensions: 2 x 6.5 x 9.2 inches
  • Shipping Weight: 4.6 pounds (View shipping rates and policies)
  • Average Customer Review: 4.7 out of 5 stars  See all reviews (3 customer reviews)
  • Amazon Best Sellers Rank: #150,933 in Books (See Top 100 in Books)

Customer Reviews

5 star
67%
4 star
33%
3 star
0%
2 star
0%
1 star
0%
See all 3 customer reviews
Share your thoughts with other customers

Top Customer Reviews

Format: Hardcover
*This is easily the best book on dynamic programming. It certainly is the most up-to-date book on this topic. The first volume covers numerous topics such as deterministic control, HJB equation for the deterministic case, Pontryagin principle, finite horizon MDPs, partially observable MDPs, and rollout heuristics. The second volume treats the infinite horizon case for the regular MDP --- average reward, discounted reward, semi-Markov control, and even some reinforcement learning.
*I love the notation. The proofs in this book are much easier than those you will find elsewhere. (This opinion is based on my study of proofs in other texts.) The treatment is very sophisticated and yet very accessible! Furthermore, what is really a bonus here --- something you won't find in the other books --- is a discussion on the stochastic shortest path (SSP). The SSP makes it so easy to analyze the average reward problem and the finite horizon problem with a stationary transition probability structure.
*I strongly recommend this book to all readers interested in understanding the basics of DP and the convergence proofs underlying the DP machinery. It is a must on your book shelf if you are working on research in DP or topics related to DP such as reinforcement learning or adaptive (approximate) DP.
Comment 18 people found this helpful. Was this review helpful to you? Yes No Sending feedback...
Thank you for your feedback.
Sorry, we failed to record your vote. Please try again
Report abuse
By Y. Zheng on January 5, 2007
Format: Hardcover
It's a good book for dynamic programming, though it requires substantial knowledge of mathematics.
Comment 8 people found this helpful. Was this review helpful to you? Yes No Sending feedback...
Thank you for your feedback.
Sorry, we failed to record your vote. Please try again
Report abuse
By R. Pal on November 3, 2006
Format: Hardcover
really nice book on dynamic programming... easy to understand and contains all requisite details.
Comment 2 people found this helpful. Was this review helpful to you? Yes No Sending feedback...
Thank you for your feedback.
Sorry, we failed to record your vote. Please try again
Report abuse

Set up an Amazon Giveaway

Dynamic Programming and Optimal Control (2 Vol Set)
Amazon Giveaway allows you to run promotional giveaways in order to create buzz, reward your audience, and attract new followers and customers. Learn more about Amazon Giveaway
This item: Dynamic Programming and Optimal Control (2 Vol Set)