Fuzzy Free Path Detection based on Dense Disparity Maps obtained from Stereo Cameras

Abstract

In this paper we propose a fuzzy method to detect free paths in real-time using digital stereo images. It is based on looking for linear variations of depth in disparity maps, which are obtained by processing a pair of rectified images from two stereo cameras. By applying least-squares fitting over groups of disparity maps columns to a linear model, free paths are detected by giving a certainty using a fuzzy rule. Experimental results on real outdoor images are also presented.Nuria Ortigosa acknowledges the support of Universidad Polit'ecnica de Valencia under grant FPI-UPV 2008. Samuel Morillas acknowledges the support of Spanish Ministry of Education and Science under grant MTM 2009-12872-C02-01.Ortigosa Araque, N.; Morillas Gómez, S.; Peris Fajarnes, G.; Dunai Dunai, L. (2012). Fuzzy Free Path Detection based on Dense Disparity Maps obtained from Stereo Cameras. International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems. 20(2):245-259. https://doi.org/10.1142/S0218488512500122245259202Grosso, E., & Tistarelli, M. (1995). Active/dynamic stereo vision. IEEE Transactions on Pattern Analysis and Machine Intelligence, 17(9), 868-879. doi:10.1109/34.406652Wedel, A., Badino, H., Rabe, C., Loose, H., Franke, U., & Cremers, D. (2009). B-Spline Modeling of Road Surfaces With an Application to Free-Space Estimation. IEEE Transactions on Intelligent Transportation Systems, 10(4), 572-583. doi:10.1109/tits.2009.2027223Bloch, I. (2005). Fuzzy spatial relationships for image processing and interpretation: a review. Image and Vision Computing, 23(2), 89-110. doi:10.1016/j.imavis.2004.06.013Keller, J. M., & Wang, X. (2000). A Fuzzy Rule-Based Approach to Scene Description Involving Spatial Relationships. Computer Vision and Image Understanding, 80(1), 21-41. doi:10.1006/cviu.2000.0872Moreno-Garcia, J., Rodriguez-Benitez, L., Fernández-Caballero, A., & López, M. T. (2010). Video sequence motion tracking by fuzzification techniques. Applied Soft Computing, 10(1), 318-331. doi:10.1016/j.asoc.2009.08.002Morillas, S., Gregori, V., & Hervas, A. (2009). Fuzzy Peer Groups for Reducing Mixed Gaussian-Impulse Noise From Color Images. IEEE Transactions on Image Processing, 18(7), 1452-1466. doi:10.1109/tip.2009.2019305Poloni, M., Ulivi, G., & Vendittelli, M. (1995). Fuzzy logic and autonomous vehicles: Experiments in ultrasonic vision. Fuzzy Sets and Systems, 69(1), 15-27. doi:10.1016/0165-0114(94)00237-2Alonso, J. M., Magdalena, L., Guillaume, S., Sotelo, M. A., Bergasa, L. M., Ocaña, M., & Flores, R. (2007). Knowledge-based Intelligent Diagnosis of Ground Robot Collision with Non Detectable Obstacles. Journal of Intelligent and Robotic Systems, 48(4), 539-566. doi:10.1007/s10846-006-9125-6McFetridge, L., & Ibrahim, M. Y. (2009). A new methodology of mobile robot navigation: The agoraphilic algorithm. Robotics and Computer-Integrated Manufacturing, 25(3), 545-551. doi:10.1016/j.rcim.2008.01.008Sun, H., & Yang, J. (2001). Obstacle detection for mobile vehicle using neural network and fuzzy logic. Neural Network and Distributed Processing. doi:10.1117/12.441696Ortigosa, N., Morillas, S., & Peris-Fajarnés, G. (2010). Obstacle-Free Pathway Detection by Means of Depth Maps. Journal of Intelligent & Robotic Systems, 63(1), 115-129. doi:10.1007/s10846-010-9498-4Picton, P. D., & Capp, M. D. (2008). Relaying scene information to the blind via sound using cartoon depth maps. Image and Vision Computing, 26(4), 570-577. doi:10.1016/j.imavis.2007.07.005Zhang, Z. (2000). A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(11), 1330-1334. doi:10.1109/34.888718Scharstein, D., & Szeliski, R. (2002). International Journal of Computer Vision, 47(1/3), 7-42. doi:10.1023/a:1014573219977Felzenszwalb, P. F., & Huttenlocher, D. P. (2006). Efficient Belief Propagation for Early Vision. International Journal of Computer Vision, 70(1), 41-54. doi:10.1007/s11263-006-7899-4Qingxiong Yang, Liang Wang, Ruigang Yang, Stewenius, H., & Nister, D. (2009). Stereo Matching with Color-Weighted Correlation, Hierarchical Belief Propagation, and Occlusion Handling. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(3), 492-504. doi:10.1109/tpami.2008.99Zitnick, C. L., & Kang, S. B. (2007). Stereo for Image-Based Rendering using Image Over-Segmentation. International Journal of Computer Vision, 75(1), 49-65. doi:10.1007/s11263-006-0018-8Hartley, R., & Zisserman, A. (2004). Multiple View Geometry in Computer Vision. doi:10.1017/cbo9780511811685Lee, C. C. (1990). Fuzzy logic in control systems: fuzzy logic controller. I. IEEE Transactions on Systems, Man, and Cybernetics, 20(2), 404-418. doi:10.1109/21.52551C. Fodor, J. (1993). A new look at fuzzy connectives. Fuzzy Sets and Systems, 57(2), 141-148. doi:10.1016/0165-0114(93)90153-9Nalpantidis, L., & Gasteratos, A. (2010). Stereo vision for robotic applications in the presence of non-ideal lighting conditions. Image and Vision Computing, 28(6), 940-951. doi:10.1016/j.imavis.2009.11.011BOHANNON, R. W. (1997). Comfortable and maximum walking speed of adults aged 20—79 years: reference values and determinants. Age and Ageing, 26(1), 15-19. doi:10.1093/ageing/26.1.1