Augmented Scene Text Recognition Using Crosswise Feature Extraction

• Published in: Wireless personal communications Vol. 123; no. 1; pp. 421 - 436
• Main Authors: Kiliroor, Cinu C, Shrija, S., Ajay, R.
• Format: Journal Article
• Language: English
• Published: New York Springer US 01.03.2022; Springer Nature B.V
• Subjects: Algorithms; Artificial neural networks; Coders; Communications Engineering; Computer Communication Networks; Encoders-Decoders; Engineering; Feature extraction; Feature recognition; Machine translation; Networks; Object recognition; Signal,Image and Speech Processing; CNN; Crosswise feature extraction; Text recognition; Feedforward Neural Network (NN)
• ISSN: 0929-6212; 1572-834X
• DOI: 10.1007/s11277-021-09138-z

In today’s highly computerized society, detection and recognition of text present in natural scene images is complex and difficult to be properly recognized by human vision. Most of the existing algorithms and models mainly focus on detection and recognition of text from still images. Many of the recent machine translation systems are built using the Encoder-Decoder framework which works on the format of encoding the sequence of input and then based on the encoded input, the output is decoded. Both the encoder and the decoder use an attention mechanism as an interface, making the model complex. Aiming at this situation, an alternative method for recognition of texts from videos is proposed. The proposed approach is based on a single Two-Dimensional Convolutional Neural Network (2D CNN). An algorithm for extracting features from an image called the crosswise feature extraction is also proposed. The proposed model is tested and shows that crosswise feature extraction gives better recognition accuracy by requiring a lesser period of time for training than the conventional feature extraction technique used by CNN.