Omnidirectional Stereo Imaging





An Omnistereo panorama consists of a pair of panoramic images, where one panorama is for the left eye and another panorama is for the right eye. The panoramic stereo pair provides a stereo sensation up to a full 360 degrees. Omnistereo panoramas cannot be photographed by two omnidirectional cameras from two viewpoints, but can be constructed by mosaicing together images from a rotating stereo pair. A more convenient approach to generate omnistereo panoramas is by mosaicing images from a single rotating camera. This approach also enables the control of stereo disparity, giving larger baselines for faraway scenes, and a smaller baseline for closer scenes. Capturing panoramic omnistereo images with a rotating camera makes it impossible to capture dynamic scenes at video rates and limits omnistereo imaging to stationary scenes. We, therefore, present two possibilities for capturing omnistereo panoramas using optics without any moving parts. A special mirror is introduced such that viewing the scene through this mirror creates the same rays as those used with the rotating cameras. A lens for omnistereo panorama is also introduced. The designs of the mirror and of the lens are based on curves whose caustic is a circle. Omnistereo panoramas can also be rendered by computer graphics methods to represent virtual environments.

Patents

"System and method for facilitating the adjustment of disparity in a stereoscopic panoramic image pair,"
S.Peleg, M. Ben-Ezra, and Y. Pritch
US Papent No. 6,831,677, December 2004 [PDF]

"Stereo panoramic camera arrangements for recording panoramic images useful in a stereo panoramic image pair,"
S.Peleg, M. Ben-Ezra, and Y. Pritch
US Papent No. 6,795,109, September 2004 [PDF]

"System and method for generating and displaying panoramic images and movies,"
S.Peleg, M. Ben-Ezra, and R.S. Rosenschein
US Papent No. 6,665,003, December 2003 [PDF]

Publications

"Optics for OmniStereo Imaging,"
Y. Pritch, M. Ben-Ezra, and S. Peleg,
in L.S. Davis (Editor), Foundations of Image Understanding, Kluwer Academic, pp. 447-467, 2001. [PDF]

"Panoramic Imaging with Horizontal Stereo,"
S. Peleg, M. Ben-Ezra, and Y. Pritch,
in Panoramic Vision: Sensors, Theory, Applications, Springer New York, pp. 143-160, 2001.

"Omnistereo: Panoramic Stereo Imaging,"
S. Peleg, M. Ben-Ezra, Y. Pritch,
IEEE Transactions on Pattern Analysis and Machine Intelligence,
Vol.23, No.3, pp.279-290, March, 2001. [PDF]

"Cameras for Stereo Panoramic Imaging,"
S. Peleg, Y. Pritch, and M. Ben-Ezra,
In Proc. IEEE Computer Vision and Pattern Recognition (CVPR), Hilton Head Island, South Carolina, I:208-214, June 2000. [PDF]

"Stereo Panorama with a Single Camera,"
Shmuel Peleg and Moshe Ben-Ezra,
In Proc. IEEE Computer Vision and Pattern Recognition (CVPR), Ft. Collins, Colorado, I:395-401, June 1999. [PDF]

"Automatic Disparity Control in Stereo Panoramas (OmniStereo),"
Y. Pritch, M. Ben-Ezra, and S. Peleg,
In Workshop on Omnidirectional Vision, Hilton Head Island, South Carolina, p.54, June 2000. [PDF]



Pictures

The Problem: No arrangement of two single-viewpoint images can give stereo in all viewing directions. For upward viewing, the two cameras should be separated horizontally and for sideways viewing, the two cameras should be separated vertically.

OmniStereo: Stereo Panoramas can be created using images captured with a regular camera rotating about an axis behind it. Pasting together strips taken from each image approximates the panoramic image cylinder. When the strips are taken from the center of the images an ordinary panorama is obtained. When the strips are taken from the left side of each image, the viewing direction is tilted counterclockwise from the image surface, obtaining the right-eye panorama. When the strips are taken from the right side of each image, the left-eye panorama is obtained.

Tower of David (Jerusalem, Israel). [Read about the Tower of David]
360 Degrees Stereo-Panoramic image (5294x480 pixels)

Anaglyph Stereo Image. View using red/green glasses.
© HumanEyes Technologies Ltd.

Tower of David (Jerusalem, Israel).
360 Degrees Stereo-Panoramic image (5163x480 pixels)

Anaglyph Stereo Image. View using red/green glasses.
© HumanEyes Technologies Ltd.

Ceramics Shop (Ravello, Italy). [Read about Ravello]
360 Degrees Stereo-Panoramic image (5163x480 pixels)

Anaglyph Stereo Image. View using red/green glasses.
© HumanEyes Technologies Ltd.

Palladio's Il Redentore in Venice
360 Degrees Stereo-Panoramic rendered image from 3D model (by Nathan G B O'Brien) (1110x175 pixels)


Anaglyph Stereo Image. View using red/green glasses.


Videos

Garden and house (Bethlehem of Galilee, Israel). [Read about Bethlehem]
The input sequence was taken by an off-axis rotating video camera. The video was processed by the omnistereo algorithm to produce multiple views shown by the output sequence video.
Input Sequence: [QT] [AVI]
Output Sequence:
[QT] [AVI]
©
HumanEyes Technologies Ltd.

Roman Ruins (Caesarea, Israel). [Read about Caesarea]
The input sequence was taken by an off-axis rotating video camera. The video was processed by the omnistereo algorithm to produce multiple views shown by the output sequence video.
Input Sequence: [QT] [AVI]
Output Sequence:
[QT] [AVI]
©
HumanEyes Technologies Ltd.


Related Sites

HumanEyes Technologies Ltd.