Evaluation of Class Distribution and Class Combinations on Semantic Segmentation of 3D Point Clouds with PointNet

• Published in: IEEE access Vol. 11; p. 1
• Main Authors: Barnefske, Eike, Sternberg, Harald
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 01.01.2023; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: 3D point clouds; Computer architecture; Data hyperparameter; Deep learning; Hierarchical class combination; Hyperparameter; Image segmentation; Machine learning; PointNet; Recall; Semantic classes; Semantic Segmentation; Semantics; Three dimensional models; Unbalanced data
• ISSN: 2169-3536; 2169-3536
• DOI: 10.1109/ACCESS.2022.3233411

Point clouds are generated by light imaging, detection and ranging (LIDAR) scanners or depth imaging cameras, which capture the geometry from the scanned objects with high accuracy. Unfortunately these systems are unable to identify the semantics of the objects. Semantic 3D point clouds are an important basis for modeling the real world in digital applications. Manual semantic segmentation is a labor and cost intensive task. Automation of semantic segmentation using machine learning and deep learning (DL) approaches is therefore an interesting subject of research. In particular, point-based network architectures, such as PointNet, lead to a beneficial semantic segmentation in individual applications. For the application of DL methods, a large number of hyperparameters (HP) have to be determined and these HPs influence the training success. In our work, the investigated HP are the class distribution and the class combination. By means of seven combinations of classes following a hierarchical scheme and four methods to adapt the class sizes, these HPs are investigated in a detailed and structured manner. The investigated settings show an increased semantic segmentation performance, by an increase of 31% in recall for the class Erroneous points or that all classes have a recall of higher than 50%. However, based on our results the correct setting of only these HP does not lead to a simple, universal and practical semantic segmentation procedure.