The union combining the stitching of normal images and unsupervised semantic segmentation of the stitched image is an important region, which is crucial for autonomous driving, intelligent robots, and vehicle detection. This paper designs an union method combining the stitching of normal images and unsupervised semantic segmentation of the stitched image. The normal images are stitched by using the image stitching method designed by Ribeiro D.. The semantic segmentation method for the stitched image uses the method opened in the github. The stitched image contains image distortion. The distortion of the stitched image will make the feature extraction unreasonable. The distortion form of the stitched image is different from the distortion form of the panoramic image combined by line images. Therefore, the DCM proposed by Xing Hu is useless to extract features of the stitched image reasonable. This paper improves the DCM as the improved distortion convolution module (IDCM) by using the deformable convolution, the clamp module, the type transformation module, and the gather module. The IDCM is added before the unsupervised semantic segmentation method opened in the github to extract features reasonable. The IDCM-NUSSM method and the ISM-IDCM-NUSSM method are proposed. The experimental results show the better performance of the designed methods.
| Published in | Machine Learning Research (Volume 9, Issue 2) |
| DOI | 10.11648/j.mlr.20240902.16 |
| Page(s) | 75-79 |
| Creative Commons |
This is an Open Access article, distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution and reproduction in any medium or format, provided the original work is properly cited. |
| Copyright |
Copyright © The Author(s), 2024. Published by Science Publishing Group |
Panoramic Image, Image Stitching, Unsupervised Semantic Segmentation
| [1] | Oztekin F., Katar O., Sadak F., Aydogan M., Yildirim T. T., Plawiak P., Yildirim O., Talo M., and Karabatak M., "Automatic Semantic Segmentation for Dental Restorations in Panoramic Radiography Images Using U-Net Model", Int. J. Imaging Syst. Technol., 2022, 32(6): 1990-2001, |
| [2] | Yang K., Hu X., Bergasa L. M., Romera E., Huang X., Sun D., and Wang K., "Can we PASS beyond the Field of View? Panoramic Annular Semantic Segmentation for Real-World Surrounding Perception", in Proc. IEEE Intell. Veh. Symp. Proc., Paris, France, 2019: 446-453, |
| [3] | Yang K., Hu X., Fang Y., Wang K., and Stiefelhagen R., "Omnisupervised Omnidirectional Semantic Segmentation", IEEE Trans. Intell. Transp. Syst., 2020, 23(2): 1184-1199, |
| [4] | Zhang J., Yang K., Shi H., Reiβ S., Peng K., Ma C., Fu H., Torr P. H. S., Wang K., and Stiefelhagen R., "Behind Every Domain There is a Shift: Adapting Distortion-aware Vision Transformers for Panoramic Semantic Segmentation", IEEE Trans. Pattern Anal. Mach. Intell., 2024, |
| [5] | Xu Y., Wang K., Yang K., Sun D., and Fu J., "Semantic Segmentation of Panoramic Images Using a Synthetic Dataset", in Proc. SPIE Int. Soc. Opt. Eng., Strasbourg, France, 2019, Art. No. 111690B, |
| [6] | Orhan S. and Bastanlar Y., "Semantic Segmentation of Outdoor Panoramic Images", Signal Image Video P., 2022, 16(3): 643-650, |
| [7] | Yang K., Hu X., and Stiefelhagen R., "Is Context-aware CNN Ready for the Surroundings? Panoramic Semantic Segmentation in the Wild", IEEE Trans. Image Process., 2021, 30: 1866-1881, |
| [8] | Zhu D., Zhou Q., Han T., and Chen Y., "360 Degree Panorama Synthesis from Sequential Views Based on Improved FC-densenets", IEEE Access, 2019, 7: 180503-180511, |
| [9] | Sumantri J. S. and Park I. K., "360 Panorama Synthesis from a Sparse Set of Images on a Low-Power Device", IEEE Trans. Comput. Imag., 2020, 6: 1179-1193, |
| [10] | Wu S., Tang H., Jing Xiao-Y., Zhao H., Qian J., Sebe N., and Yan Y., "Cross-View Panorama Image Synthesis", IEEE Trans. Multimedia, 2023, 25: 3546-3559, |
| [11] | Liu Y. and Long Y., "Image Stitching Method of Non-Ferrous Smelting Scene Based on SIFT Algorithm and Color Constancy", Open Journal of Applied Sciences, 2023, 13(11): 2055-2067, |
| [12] | Zhang W., Wang Y., and Liu Y., "Generating High-quality Panorama by View Synthesis Based on Optical Flow Estimation", Sensors, 2022, 22(2), Art. No. 470, |
| [13] | Lin J. and Yang Chuan-K., "Collaborative Panoramic Image Generation from Multiple Mobile Phones", in Proc. IEEE Int. Conf. Multimed. and Expo Workshops, Hong Kong, Hong Kong, 2017: 339-344, |
| [14] | Kim S., Uh Y. J., and Byun H., "Generating Panorama Image by Synthesizing Multiple Homography", in Proc. Int. Conf. Image Process., 2012: 2981-2984, |
| [15] | Xiong J., Li F., Long F., Xu Y., Wang S., Xu J., Ling Q., "Spatially-varying Warping for Panoramic Image Stitching", in Proc. Chin. Control Decis. Conf., 2022: 575-580, |
| [16] | Ribeiro D., CustÓdio P., and Balasubramaniam L., "Image Stitching and 3D Point Cloud Registration", Image Processing and Vision MEEC, 2021. |
| [17] |
Kanezaki A., "Unsupervised Image Segmentation by Backpropagation", in Proc. IEEE Int. Conf. Acoust. Speech Signal Process Proc., 2018: 1543-1547,
https://doi.org/10.1109/ICASSP.2018.8462533 [Accessed 19 June 2019] |
| [18] | Hu X., An Y., Shao C., and Hu H., "Distortion Convolution Module for Semantic Segmentation of Panoramic Images Based on the Image-forming Principle", IEEE Trans. Instrum. Meas., 2022, 71: 1-12, |
APA Style
Hu, X., Li, X., Wang, Z., Ren, J., An, Y., et al. (2024). An Union Method Combining the Stitching of Normal Images and the Unsupervised Semantic Segmentation of Stitched Image. Machine Learning Research, 9(2), 75-79. https://doi.org/10.11648/j.mlr.20240902.16
ACS Style
Hu, X.; Li, X.; Wang, Z.; Ren, J.; An, Y., et al. An Union Method Combining the Stitching of Normal Images and the Unsupervised Semantic Segmentation of Stitched Image. Mach. Learn. Res. 2024, 9(2), 75-79. doi: 10.11648/j.mlr.20240902.16
AMA Style
Hu X, Li X, Wang Z, Ren J, An Y, et al. An Union Method Combining the Stitching of Normal Images and the Unsupervised Semantic Segmentation of Stitched Image. Mach Learn Res. 2024;9(2):75-79. doi: 10.11648/j.mlr.20240902.16
Share This Article
Twitter
Linked In
Facebook
Copy
Download@article{10.11648/j.mlr.20240902.16,
author = {Xing Hu and Xinjian Li and Zhengguang Wang and Jie Ren and Yi An and Cheng Shao and Hongsheng Tian and Qingru Guo},
title = {An Union Method Combining the Stitching of Normal Images and the Unsupervised Semantic Segmentation of Stitched Image
},
journal = {Machine Learning Research},
volume = {9},
number = {2},
pages = {75-79},
doi = {10.11648/j.mlr.20240902.16},
url = {https://doi.org/10.11648/j.mlr.20240902.16},
eprint = {https://article.sciencepublishinggroup.com/pdf/10.11648.j.mlr.20240902.16},
abstract = {The union combining the stitching of normal images and unsupervised semantic segmentation of the stitched image is an important region, which is crucial for autonomous driving, intelligent robots, and vehicle detection. This paper designs an union method combining the stitching of normal images and unsupervised semantic segmentation of the stitched image. The normal images are stitched by using the image stitching method designed by Ribeiro D.. The semantic segmentation method for the stitched image uses the method opened in the github. The stitched image contains image distortion. The distortion of the stitched image will make the feature extraction unreasonable. The distortion form of the stitched image is different from the distortion form of the panoramic image combined by line images. Therefore, the DCM proposed by Xing Hu is useless to extract features of the stitched image reasonable. This paper improves the DCM as the improved distortion convolution module (IDCM) by using the deformable convolution, the clamp module, the type transformation module, and the gather module. The IDCM is added before the unsupervised semantic segmentation method opened in the github to extract features reasonable. The IDCM-NUSSM method and the ISM-IDCM-NUSSM method are proposed. The experimental results show the better performance of the designed methods.
},
year = {2024}
}
TY - JOUR T1 - An Union Method Combining the Stitching of Normal Images and the Unsupervised Semantic Segmentation of Stitched Image AU - Xing Hu AU - Xinjian Li AU - Zhengguang Wang AU - Jie Ren AU - Yi An AU - Cheng Shao AU - Hongsheng Tian AU - Qingru Guo Y1 - 2024/11/29 PY - 2024 N1 - https://doi.org/10.11648/j.mlr.20240902.16 DO - 10.11648/j.mlr.20240902.16 T2 - Machine Learning Research JF - Machine Learning Research JO - Machine Learning Research SP - 75 EP - 79 PB - Science Publishing Group SN - 2637-5680 UR - https://doi.org/10.11648/j.mlr.20240902.16 AB - The union combining the stitching of normal images and unsupervised semantic segmentation of the stitched image is an important region, which is crucial for autonomous driving, intelligent robots, and vehicle detection. This paper designs an union method combining the stitching of normal images and unsupervised semantic segmentation of the stitched image. The normal images are stitched by using the image stitching method designed by Ribeiro D.. The semantic segmentation method for the stitched image uses the method opened in the github. The stitched image contains image distortion. The distortion of the stitched image will make the feature extraction unreasonable. The distortion form of the stitched image is different from the distortion form of the panoramic image combined by line images. Therefore, the DCM proposed by Xing Hu is useless to extract features of the stitched image reasonable. This paper improves the DCM as the improved distortion convolution module (IDCM) by using the deformable convolution, the clamp module, the type transformation module, and the gather module. The IDCM is added before the unsupervised semantic segmentation method opened in the github to extract features reasonable. The IDCM-NUSSM method and the ISM-IDCM-NUSSM method are proposed. The experimental results show the better performance of the designed methods. VL - 9 IS - 2 ER -
School of Control Science and Engineering, Dalian University of Technology, Dalian, China;College of Information Technology, Nanchang Vocational University, Nanchang, China
College of Information Technology, Nanchang Vocational University, Nanchang, China
College of Information Technology, Nanchang Vocational University, Nanchang, China
College of Information Technology, Nanchang Vocational University, Nanchang, China
School of Control Science and Engineering, Dalian University of Technology, Dalian, China;School of Electrical Engineering, Xinjiang University, Urumqi, China
School of Control Science and Engineering, Dalian University of Technology, Dalian, China
State Grid Tieling Electric Power Supply Company, Liaoning, China
Product Development Department, Googosoft, Jinan, China
Information