基于马尔可夫过程的持续变化数据库系统更新策略

A Markov-Based Update Policy for Constantly Changing Database Systems

IEEE Transactions on Engineering Management · 2017
被引 11
ABS 3

中文导读

针对企业数据库数据频繁变化导致过时的问题,提出基于马尔可夫决策过程的更新策略,通过动态规划求解最优更新时机,平衡数据陈旧成本与更新成本,实验证明优于固定间隔更新策略。

Abstract

In order to maximize the value of an organization's data assets, it is important to keep data in its databases up-to-date. In the era of big data, however, constantly changing data sources make it a challenging task to assure data timeliness in enterprise systems. For instance, due to the high frequency of purchase transactions, purchase data stored in an enterprise resource planning system can easily become outdated, affecting the accuracy of inventory data and the quality of inventory replenishment decisions. Despite the importance of data timeliness, updating a database as soon as new data arrives is typically not optimal because of high update cost. Therefore, a critical problem in this context is to determine the optimal update policy for database systems. In this study, we develop a Markov decision process model, solved via dynamic programming, to derive the optimal update policy that minimizes the sum of data staleness cost and update cost. Based on real-world enterprise data, we conduct experiments to evaluate the performance of the proposed update policy in relation to benchmark policies analyzed in the prior literature. The experimental results show that the proposed update policy outperforms fixed interval update policies and can lead to significant cost savings.

数据库数据质量马尔可夫决策过程企业数据管理运筹学