Enhancing Object Detection In An Augmented Reality Learning System

The goal of the ANLGE Lab's AR assembly project is to create/save assemblies as well as to replicate assemblies later with real-time AR feedback. In this iteration of the project, the SURF algorithm was used to provide object detection for 5 featureful objects (a Lego girl piece, a Lego guy piece, a blue Lego car piece, a window piece, and a fence piece). Functionality was added to determine the location of these 5 featureful objects within a frame as well by using the SURF keypoints associated with detection. Finally, the feedback mechanism by which the system detects connections between objects was improved to consider the size of the blocks in determining connections rather than using static values. Additional user features such as adding a new object and using voice commands were also implemented to make the system more user friendly.