Combining Image Processing Techniques and Mobile Sensor Information for Marker-less Augmented Reality Based Reconstruction

Abstract

Marker-less Augmented Reality(AR) based recon- struction using mobile devices, is a near impossible task. When considering vision based tracking approaches, it is due to the lack of processing power in mobile devices and when considering mobile sensor based tracking approaches, it is due to the lack of accuracy in mobile Global Positioning System(GPS).

In order to address this problem this research presents a novel approach which combines image processing techniques and mobile sensor information which can be used to perform precise position localization in order to perform augmented reality based reconstruction using mobile devices. The core of this proposed methodology is tightly bound with the image processing technique which is used to identify the object scale in a given image, which is taken from the user’s mobile device. Use of mobile sensor information was to classify the most optimal locations for a given particular user location.

This proposed methodology has been evaluated against the results obtained using 10cm accurate Real-Time Kinematic(RTK) device and against the results obtained using only the Assisted Global  Positioning  System(A-GPS)  chips  in  mobile  devices. Though  this  proposed  methodology  require  more  processing time than A-GPS chips, the accuracy level of this proposed methodology outperforms that of A-GPS chips and the results of the experiments carried out further convince that this proposed methodology facilitates improving the accuracy of position local- ization for augmented reality based reconstruction using mobile devices under certain limitations.