The idea was to create an immersive viewing experience using a huge dome. This dome (6 feet dia) covers the whole view angle of the user, hence the user sees nothing but the projected image or video.
A sphere was generated programmatically using processing and Panoramic Photographs were wrapped on the sphere. These panaromic photos look perfectly stitched from all the sides – which gives a continuos perception of the photograph.
Instead of viewing this sphere from outside, the view point was placed at the center of the virtual sphere (the camera’s co ordinates were adjusted so that it was placed exactly in the center of the virtual sphere)
The inner wall of this virtual sphere was projection mapped on the concave part of the dome to enhance the onscreen movements. By using ultra short-throw projectors, occlusion was minimized to give the user an immersive experience.
A web cam was placed on the dome which tracks the fiducial marker held by the user (this marker could also be printed on the user’s T shirt ). As the user moves the marker, the virtual sphere gets rotated and the panaromic photos move. The user is able to view the photo in 360 degrees by just moving the marker.
This enables the user to view any part of the photo or video by gestures (or moving around,)
This way the movie can be made interactive as theuser can choose his own frame instead of viewing the frame that the director chooses to show.