On Predicting Sensor Readings With Sequence Modeling and Reinforcement Learning for Energy-Efficient IoT Applications
提出一种结合LSTM和强化学习的方法，在事件驱动的物联网应用中动态决定是否关闭传感器以节省能耗，同时保持预测精度。实验表明，系统在32%激活时间下达到50%精度，60%激活时间下达到75%精度。
Prediction of sensor readings in event-based Internet-of-Things (IoT) applications is considered. A new approach is proposed, which allows turning off sensors in periods when their readings can be predicted, thus preserving energy that would be consumed for sensing and communications. The proposed approach uses a long short-term memory (LSTM) model that learns spatiotemporal patterns in sequences of sensorial data for future predictions. The LSTM model and the sensors collaboratively monitor the environment. They are controlled by a reinforcement learning (RL) agent that dynamically decides about using the LSTM prediction versus physical sensing in a way that maximizes energy saving while maintaining prediction accuracy. Two approaches are used for the RL: 1) the Markov decision process (MDP) model-based for low scale applications and 2) deep <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">${Q}$ </tex-math></inline-formula> -Network-based for larger scales. Compared to the current literature, the proposed solution is unique in predicting all sensor readings for real-time event detection and providing a model capable of learning long-term spatiotemporal correlations, enabling power conservation and detection accuracy balance. We compare the proposed solutions to the most relevant state-of-the-art approaches using a large real dataset collected in a dynamic space by measuring the accuracy, consumed energy, network lifetime, latency, and missed events’ ratio. To investigate the scalability of the solutions, these parameters are calculated for different network sizes. The results show that the system achieves 50% accuracy with 32% of activation time and 75% accuracy with 60% activation time.