{"product_id":"ahmed-amodu-oluwatosin-markov-decision-processes-and-reinforcement-learning-for-timely-uav-iot-data-collection-applications-9783031970108","title":"Markov Decision Processes and Reinforcement Learning for Timely UAV-IoT Data Collection Applications","description":"This book offers a structured exploration of how Markov Decision Processes (MDPs) and Deep Reinforcement Learning (DRL) can be used to model and optimize UAV-assisted Internet of Things (IoT) networks, with a focus on minimizing the Age of Information (AoI) during data collection. Adopting a tutorial-style approach, it bridges theoretical models and practical algorithms for real-time decision-making in tasks like UAV trajectory planning, sensor transmission scheduling, and energy-efficient data gathering. Applications span precision agriculture, environmental monitoring, smart cities, and emergency response, showcasing the adaptability of DRL in UAV-based IoT systems. Designed as a foundational reference, it is ideal for researchers and engineers aiming to deepen their understanding of adaptive UAV planning across diverse IoT applications.","brand":"Springer","offers":[{"title":"Default Title","offer_id":53767424311638,"sku":null,"price":0.0,"currency_code":"EUR","in_stock":false}],"thumbnail_url":"\/\/cdn.shopify.com\/s\/files\/1\/0925\/5829\/5382\/files\/product_image_9783031970108_1.jpg?v=1781803577","url":"https:\/\/www.momoxbooks.com\/products\/ahmed-amodu-oluwatosin-markov-decision-processes-and-reinforcement-learning-for-timely-uav-iot-data-collection-applications-9783031970108","provider":"momoxbooks","version":"1.0","type":"link"}