ABSTRACTS OF ARTICLES OF THE JOURNAL "INFORMATION TECHNOLOGIES".
No. 12. Vol. 29. 2023

DOI: 10.17587/it.29.639-649

V. A. Bobkov, Chief Researcher, M. A. Morozov, Lead Engineer, A. A. Shupikova, Lead Engineer,
Institute of Automation and Control Processes of the Far East Branch of the Russian Academy of Sciences, Vladivostok, 690041, Russian Federation

Algorithm for Recognizing an Underwater Pipeline from Stereo Images

The problem of recognition of an underwater pipeline (UP) from stereo images using an autonomous underwater robot (AUV) is considered in relation to the initial position of tracking the UP, or to situations where the previous section of the UP is hidden by interference (submerged in the ground, hidden by algae, etc.). The final result of the identification of the UP section, visible by the stereo camera, is the calculation of its center line and the detection of the relative position of the AUV and UP in the camera coordinate system. The article proposes a recognition method based on the selection of visible UP boundaries (contours) on vectorized images of a stereopair. At the stage of vectorization, noise is eliminated, illumination is equalized, and the image is processed using the Canny method to obtain a binary image. The construction of UP contours is performed using the algorithm proposed by the authors, which is a modification of the Hough method. The main feature of the proposed algorithm is a relatively high performance due to a multiple reduction in the amount of information being processed. Reducing the volume of processed data is done by pre-sorting the line segments in the vectorized image, and by optimizing the computational scheme in the algorithm. The experiments also showed that the algorithm can detect the visible boundaries of the UP on blurry, non-contrasting images. The algorithmic basis of the method is described in detail, including:

— search and construction of the most reliable UP boundaries using the method of the integral contribution of the line segments to the line formation;

• generation and selection of point features belonging to the surface of the UP (due to the constructed contours);
• calculation of the 3D direction of the center line;
• calculation of the center line of the visible section of UP;

—calculation of the AUV position parameters relative to the UP required for the AUV control system. The centerline calculation is performed using the least squares method using point features belonging to the surface of the

UP. The performed computational experiments on virtual scenes using the real texture of the seabed confirm the operability of the implemented approach and the possibility of its application for the inspection of underwater infrastructure.

Keywords: underwater pipeline inspection, autonomous underwater robot, recognition, stereo image, vectorization, point features

P. 639-649

References

1. Inzartsev A., Pavin A. AUV Application for Inspection of un­derwater communications, Underwater Vehicles, ed. by Inzartsev A. V., Vienna, In-Tech Publishers, January 2009, pp. 215—234.
2. Bagnitskiy A. V., Inzartsev A. V., Pavin A. M., Melman S. V., Morozov M. A. A Model Solution of an Automatic Underwater Pipelines Inspection Problem Using Side Scan Sonar, Underwater Investigation and Robotics, 2011, no. 1(11), pp. 17—23 (in Russian).
3. Inzartsev A., Pavin A., Rylov N. Development of the AUV Automatic Docking Methods Dased on Echosounder and Video Data, Proceedings of 24th Saint Petersburg International Conference on Integrated Navigation Systems, 29—31 May 2017, Saint Peters­burg, Russia, pp. 178—184.
4. Inzartsev A. V., Pavin A. M., Lebedko O. A., Panin M. A. Small Objects Detection and Survey Using Autonomous Underwater Vehicles, Underwater Investigations and Robotics, 2016, no. 2(22), pp. 36—43 (in Russian).
5. Bao J., Li D., Qiao X., Rauschenbach T. Integrated navigation for autonomous underwater vehicles in aquaculture: A Review, Information Processing in Agriculture, March 2020, vol. 7, iss. 1, pp. 139—151.
6. Jacobi M., Karimanzira D. Multi sensor underwater pipe­line tracking with AUVs, Oceans — St. John's 2014, 2014, pp. 1—6.
7. Jacobi M., Karimanzira D. Guidance of AUVs for au­tonomous underwater inspection, Automatisierungstechnik, 2015, no. 63(5), pp. 380—388.
8. Tipsuwan Y., Hoonsuwan P. Design and Implementation of an AUV for Petroleum Pipeline Inspection, 2015 7th International Conference on Information Technology and Electrical Engineering (ICITEE), 2015.
9. Fatan M., Daliri M. R., Shahri M. A. Underwater Cable Detection in the Images Using Edge Classification Based on TextureIinformation, Measurement, 2016, no. 91, pp. 309—317.
10. Ulu C., Canbak O., Altunkaya M., Taskin H. Development of the MarmaROV Remotely Operated Underwater Vehicle System, 2017 International Artificial Intelligence and Data Processing Symposium (IDAP), 6—17 Sept. 2017.
11. Zou H., Pan S., Dai C. A Novel Underwater Simultane­ous localization and Mapping Online Algorithm Based on Neural Network, International Journal of Geo-Information, 2019, no. 9 (1).
12. Rekika F., Ayedia W., Jalloulia M. A Trainable System for Underwater Pipe Detection, Pattern Recognition and Image Analysis, 2018, vol. 28, no. 3, pp. 525—536.
13. Petraglia F. R., Campos R., Gomes J. G., Petraglia M. R. Pipeline Tracking and Event Classification for an Automatic Inspection Vision System, Circuits and Systems (ISCAS) 2017 IEEE International Symposium, 2017, pp. 1—4.
14. Breivik G. M., Fjerdingen S. A., Skotheim O. Robust Pipeline localization for an Autonomous Underwater Vehicle Using Stereo Vision and Echo Sounder Data, Proceedings of SPIE — The International Society for Optical Engineering 7539, January 2010.
15. Allibert G., Hua M. D., Krupnski S., Hamel T. Pipe­line Following by Visual Servoing for Autonomous Underwater Vehicles, Control Eng. Pract., 2019, no. 82, pp. 151—160.
16. Ho M., El-Borgi S., Patil D., Song G. Inspection and Monitoring Systems Subsea Pipelines: A review paper, Review. Structural health monitoring, 2020, vol. 19(2), pp. 606—645.
17. Canny J. F. A Computational Approach to Edge Detection, IEEE Transactions on Pattern Analysis and Machine Intelligence, 1986, vol. 8, pp. 679—698.
18. Duda R. O., Hart P. E. Use of the Hough Transforma­tion to Detect lines and Curves in Pictures, Communications of the ACM, 1972, no. 15(1), pp. 11—15.
19. Melman S., Bobkov V., Inzartsev A., Pavin A. Distributed Simulation Framework for Investigation of Autonomous Underwa­ter Vehicles' Real-Time Behavior, Proceedings of the OCEANS15 MTS/IEEE Washington DC, October 19—22, 2015.
20. Bobkov V. A., Melman S. V., Morozov M. A., Tarasov G. V. Simulation Complex for Autonomous Underwater Ve­hicles on a Distributed Architecture Using a Cluster, Informatika i sistemy upravleniya, 2017, no. 4(54), pp. 32—42 (in Russian).

To the contents