ACO-DPDGW: an ant colony optimization algorithm for data placement of data-intensive geospatial workflow

• Published in: Earth science informatics Vol. 12; no. 4; pp. 641 - 658
• Main Authors: Wu, Xiaozhu, Liu, Ying, Chen, Chongcheng
• Format: Journal Article
• Language: English
• Published: Berlin/Heidelberg Springer Berlin Heidelberg 01.12.2019; Springer Nature B.V
• Subjects: Algorithms; Ant colony optimization; Computer centers; Data centers; Data transfer (computers); Data transmission; Datasets; Earth and Environmental Science; Earth Sciences; Earth System Sciences; Information Systems Applications (incl.Internet); Methodology Article; Ontology; Placement; Simulation and Modeling; Space Exploration and Astronautics; Space Sciences (including Extraterrestrial Physics; Workflow; Ant colony optimization; Geospatial workflow; J0101; Data placement
• ISSN: 1865-0473; 1865-0481
• DOI: 10.1007/s12145-019-00401-3

Massive data transmission between distributed data centers is the major efficiency bottleneck of geospatial workflow. Although many data placement methods have been proposed to overcome this problem, few researches have considered the impact of the structure of the workflow. In this paper, we define the problem of data placement for data-intensive geospatial workflow aiming to minimize the data transfer time. An algorithm called ant colony optimization based data placement of data-intensive geospatial workflow (ACO-DPDGW) is proposed to handle this problem. By taking advantage of the node vector to represent the traditional workflow model, the ants could place datasets and tasks in appropriate data centers according to the combination of pheromone information and heuristic information, when they visit the nodes randomly. To prevent premature convergence, a variable neighborhood search operation is embedded into ACO-DPDGW. The experiments show that our algorithm can reduce data transfer volume and data transfer time even as the numbers of datasets, tasks, and data centers increase.