XWM: a high-speed matching algorithm for large-scale URL rules in wireless surveillance applications

• Published in: Multimedia tools and applications Vol. 79; no. 23-24; pp. 16245 - 16263
• Main Authors: Zhang, Shuzhuang, Sun, Yanbin, Meng, Fanzhi, Fu, Yunsheng, Jia, Bowei, Wu, Zhigang
• Format: Journal Article
• Language: English
• Published: New York Springer US 01.06.2020; Springer Nature B.V
• Subjects: Algorithms; Computer Communication Networks; Computer Science; Containers; Data Structures and Information Theory; High speed; Multimedia Information Systems; Security systems; Special Purpose and Application-Based Systems; String matching; Surveillance; Wireless networks; Wireless sensor networks; Multi-string matching; URL matching; Wu-Manber algorithm
• ISSN: 1380-7501; 1573-7721; 1573-7721
• DOI: 10.1007/s11042-019-07822-8

Large-scale high-speed URL matching is a key operation in many network security systems and surveillance applications in Wireless Sensor Networks. Classic string matching algorithms are unsuitable for large-scale URL filtering due to speed or memory consumption. This paper proposes an extend Wu-Manber algorithm (XWM) which takes advantage of the encoding characteristics of the URL greatly to improve the matching performance of the algorithm. It first adopts the pattern string window selection method to optimize Wu-Manber’s hash process, and then combines hash tables and associative containers to optimize the string comparison process. The experimental results on actual 10 million patterns show that XWM can achieve speeds that are twice as fast as traditional algorithms, especially when the shortest pattern string length is longer, it is more advantageous.