Realtime 3D mapping using smartphone cameras and gamification, the winning submission from Hack The Visual in 2015 working with Dario Villanueva, Anthony Thomas, Bryan Yap and Evan Gillogley.
The idea for this hack was to build a piece of software that would help people with their phones capture 3D images and terrain of the streets, roads and landscape around them for use in videogames, architecture, modelling and history.
When playing Splatmap, the game would split connected players in a given area into two teams using geolocation and asked them to take as many photos of their surroundings as possible using an app within a minute. Whichever team’s photos generated the most valid 3D point clouds at the end of the minute would be the winners.Watch Imaging Mind's video
To create the 3D point clouds from the photos taken certain data needed to be sent to a piece of software Anthony worked on during the hack. This included the roll, pitch and azimuth of the smartphone when the photo was taken and an accurate GPS position.
Without creating a native Android or iOS app I found it almost impossible to obtain the roll, pitch and azimuth from the device being used due to differing device sensors and browser APIs. We made a decision early on at the hack to plot the generated point cloud at the location on the map from the GPS sent from the phone and ignore the orientation of the point cloud.
The judges urged us to continue the project as they thought this could easily take off. With the judges comments in mind the team have decided to continue this project in our free time.