{"product_id":"9783032404015","title":"Reinforcement Learning for Engineering","description":"\u003ch3\u003eCommunications and Control Engineering\u003c\/h3\u003e\u003ch1\u003eReinforcement Learning for Engineering\u003c\/h1\u003e\u003ch3\u003eZoran Gajić | Lingyi Xu\u003c\/h3\u003e\u003cdiv\u003e\u003cb\u003eTechnology \u0026amp; Engineering \/ Electrical\u003c\/b\u003e\u003c\/div\u003e\u003cbr\u003e\u003cdiv\u003e\n\u003cp\u003eThe book is written from the perspective of the optimal feedback control of dynamic systems that evolve in either continuous- or discrete-time domains with emphasis on deterministic problem formulations over the corresponding stochastic problem formulations. Bellman's dynamic programming—optimal feedback control—in continuous- and discrete-time domains forms the mathematical foundations of this book. In a simple and clear manner, this book relates the relation of one of the main techniques of the reinforcement learning approach in computer science, so-called Q-learning, to the Bellman dynamic programming functional difference equation.\u003c\/p\u003e\n\u003cp\u003e\u003cem\u003eReinforcement Learning for Engineering\u003c\/em\u003e contains several exercises, homework problems, and design projects (most using MATLAB® and its Reinforcement Learning toolbox Simulink®; and some using Python) for real physical engineering systems. The book is a valuable reference for all researchers and practitioners interested in an engineering approach to reinforcement learning because it covers many essential results in a systematic manner. The book also presents and defines several future interesting and challenging research problems by providing a deeper physical and mathematical understanding of the optimal control Hamiltonians from the reinforcement learning point of view.\u003c\/p\u003e\n\u003c\/div\u003e\u003cdiv\u003e\n\u003cp\u003eProfessor \u003cstrong\u003eZoran Gajić\u003c\/strong\u003e received the Dipl.-Ing. (five year program) and Mgr.Sci. (two year program) degrees in electrical engineering from the University of Belgrade, the M.S. degree in applied mathematics, and the Ph.D. degree in systems science engineering under direction of Prof. Hassan Khalil from Michigan State University Department of Electrical Engineering and System Science in 1984. He was a Visiting Professor with Princeton University in 2003, and the American University of Sharjah in 2011, and Ajman University during 2022-23 school year. He is a Professor of Electrical and Computer Engineering with Rutgers University, where he has been involved in teaching linear systems and signals, controls, communication networks, optical networks, reinforcement learning, and electrical circuit courses since 1984. He has authored\/co-authored  over 100 journal papers, primarily published in IEEE\u003cem\u003e Transactions on Automatic Control \u003c\/em\u003eand \u003cem\u003eAutomatica\u003c\/em\u003e, and eight books on linear systems and linear and bilinear control systems published by Academic Press, Prentice Hall, Marcel Dekker, Taylor and Francis, and Springer. The Chinese Simplified translation of his book \u003cem\u003eLinear Dynamic Systems and Signal\u003c\/em\u003es was published by Jiaotong University Press in 2004. His 1995 book \u003cem\u003eLyapunov Matrix Equation in Systems Stability and Control\u003c\/em\u003e was republished in 2008 by Dover Publications.\u003c\/p\u003e\n\u003cp\u003eDr. Gajić has supervised 19 doctoral dissertations and 26 master theses. Fourteen of his former doctoral students hold faculty positions with respected universities across the world. He has delivered four plenary lectures at international conferences and presented close to 150 conference papers. Dr. Gajić has served on editorial boards for nine journals and as a guest editor for six journal special issues. From 2003 to 2020 he was the Electrical and Computer Engineering Graduate Program Director at Rutgers. He served on the American Association of University Professors National Council for several years.\u003c\/p\u003e\n\u003cp\u003eDr. \u003cstrong\u003eLingyi Xu\u003c\/strong\u003e received her Ph.D. in Electrical and Computer Engineering from Rutgers University in 2024 with Prof. Zoran Gajić as her advisor. Prior to her doctoral studies, she received a Master's in control theory and control engineering from the Institute of Automation, Chinese Academy of Sciences in 2017 and a Master's in electrical and computer engineering from Rutgers University in 2018.\u003c\/p\u003e\n\u003cp\u003eDr. Xu has served as a reviewer for several journals such as \u003cem\u003eIEEE Transactions on Automatic Control\u003c\/em\u003e, \u003cem\u003eOptics and Lasers in Engineering\u003c\/em\u003e, and \u003cem\u003eEngineering Optimization \u003c\/em\u003eand conferences. Her research lies at the intersection and boundary of data-driven machine learning, reinforcement learning, computer vision, game theory, and optimal control, especially on machine learning and optimal control in trustworthy and responsible AI. Her work aims to train AI models to understand images and so to make reliable and trustworthy decisions. Dr. Xu's work on security-oriented cyber-physical systems improves the generalizability and reliability of data-driven machine learning on low-quality object detection and recognition in non-cooperative circumstances. Her work on multi-agent systems intends to enhance the efficacy and robustness of autonomous driving on tracked vehicles. Focussing on simultaneous on-line tracking and planning in leader-follower formation navigation for searching and rescue tasks. Her long-term research goal is on trustworthy and reliable general AI, teaching AI models to understand visual data in order to make interpretable, reliable, and trustworthy decisions in adversarial environments.\u003c\/p\u003e\n\u003c\/div\u003e\u003cbr\u003e\u003ctable\u003e\n\u003ctr\u003e\n\u003ctd\u003ePublication Date: \u003c\/td\u003e\n\u003ctd\u003e25 November 2026\u003c\/td\u003e\n\u003c\/tr\u003e\n\u003ctr\u003e\n\u003ctd\u003ePublisher: \u003c\/td\u003e\n\u003ctd\u003eSpringer Nature Switzerland\u003c\/td\u003e\n\u003c\/tr\u003e\n\u003ctr\u003e\n\u003ctd\u003eImprint: \u003c\/td\u003e\n\u003ctd\u003eSpringer\u003c\/td\u003e\n\u003c\/tr\u003e\n\u003ctr\u003e\n\u003ctd\u003eISBN-13: \u003c\/td\u003e\n\u003ctd\u003e9783032404015\u003c\/td\u003e\n\u003c\/tr\u003e\n\u003ctr\u003e\n\u003ctd\u003eFormat: \u003c\/td\u003e\n\u003ctd\u003eHardback\u003c\/td\u003e\n\u003c\/tr\u003e\n\u003ctr\u003e\n\u003ctd\u003ePage Count: \u003c\/td\u003e\n\u003ctd\u003e330\u003c\/td\u003e\n\u003c\/tr\u003e\n\u003c\/table\u003e","brand":"Springer Nature Switzerland","offers":[{"title":"Default Title","offer_id":53976963743884,"sku":"9783032404015","price":161.99,"currency_code":"USD","in_stock":true}],"url":"https:\/\/lateknightbooks.com\/products\/9783032404015","provider":"Late Knight Books and Services, LLC","version":"1.0","type":"link"}