File Assignment Control for a Web System of Contents Categorization

• Published in: Transactions on Computational Collective Intelligence XXXIII Vol. 11610; pp. 89 - 102
• Main Authors: Kohana, Masaki, Sakaji, Hiroki, Kobayashi, Akio, Okamoto, Shusuke
• Format: Book Chapter
• Language: English
• Published: Germany Springer Berlin / Heidelberg 2019; Springer Berlin Heidelberg
• Series: Lecture Notes in Computer Science
• Subjects: Content categorization; Distributed computing; Parallel computing; Web application; Web browser computing
• ISBN: 9783662595398; 3662595397
• ISSN: 0302-9743; 1611-3349
• DOI: 10.1007/978-3-662-59540-4_5

This paper shows the effect of the controlling file assignment on the file transfer time for a Web-based content categorization system. Our proposed algorithm estimates categories of contents based on the terms and the content categories already added. However, our algorithm uses a large table that consists of the scores that represent the relationship between a term and a category. To address the large table size and longer calculation time, we proposed a distributed Web system that uses multiple calculation machines. This Web system runs preprocessors on a Web browser and calculation machines. In this Web system, the file transfer time becomes a problem when a user sends larger files. In this paper, we propose a way to resolve the issue of longer file transfer time by controlling the file assignment. We assign the large files to the Web browser process, and we assign the smaller files to the calculation machines over the network.