挖掘数据整理工作流以发现和规范设计模式

Mining Data Wrangling Workflows for Design Patterns Discovery and Specification

Information Systems Frontiers · 2024
被引 1
ABS 3

中文导读

研究了不同经验水平的数据分析师设计的数据整理工作流,通过工作流挖掘技术发现常见操作和模式,并编撰成设计模式手册,经专业人士调查确认其对构建数据整理方案和辅助分析师有实用价值。

Abstract

Abstract In this paper, we investigate Data Wrangling (DW) pipelines in the form of workflows devised by data analysts with varying levels of experience to find commonalities or patterns. We propose an approach for pattern discovery based on workflow mining techniques, addressing key challenges associated with finding patterns in data preparation solutions. The findings provide insights into the most commonly used DW operations, solution patterns, redundancies, and reuse opportunities in data preparation. The findings were used to create design pattern specifications curated into a catalog in the form of a DW Design Patterns Handbook. The evaluation of the proposed handbook is performed by surveying professionals with results confirming the usefulness of discovered patterns to the construction of DW solutions and assisting data analysts/scientists via the reuse of patterns and best practices in DW.

数据科学数据整理工作流挖掘设计模式数据准备