you will implement the epipolar geometry and normalized cross correlation (NCC) to find correspondences across two calibrated camera images

INSTRUCTIONS TO CANDIDATES

ANSWER ALL QUESTIONS

Two-view Geometry and Correspondence Matching

For this project, you will implement the epipolar geometry and normalized cross correlation (NCC) to find correspondences across two calibrated camera images. You are provided with the extrinsics between two cameras and their individual intrinsics. The goal is: given two captured images by the two cameras, your program is able to automatically find the correspondence between them using fundamental matrix transformation and NCC matching.

 

Input Data

• You are provided two image files:

Example 1

Example 2

The two examples above demonstrate two images captured by the left and right cameras at the same time. By selecting one pixel on the right image (example 1) , an epipoloar line is automatically found from the left image and the correspondence is identified by NCC (indicated by the green circle). Example 2 shows a similar example

 

but selecting a pixel from the left the image and found the correspondence from the right one.

• The calibration result file (processed by Matlab Toolbox):

This sample shows the two cameras’ intrinsics and extrinsics:

fc_left - the left camera’s focal length (fx and fy) cc_left - the left camera’s center offset (cx and cy)

Rotation vector - the relative rotation between the left and right cameras. Translation vector - the relative position between the left and right cameras.

The data after the “±” symbol are the error deviation, you can simply ignore them. Also the “skew” and “distortion” are parameters about the lens, which are not necessary for the project.

What you should achieve?

• Successfully load and display two (left and right) color images at the same time. (10%)

• Successfully load the intrinsics and extrinsics file (.txt) into OpenCV matrix. (10%)

• Successfully use camera intrinsics and extrinsics to assemble a fundamental matrix. (25%)

• User selects a pixel on the left image by left mouse clicking. Your code should successfully render a corresponding epipolar line on the right image. This epipolar line should pass through the correspondence on the right image. (25%)

• Successfully implement NCC to find correspondence from the right image. (25%)

• Write up a “.pdf” document with several pairs of sample images showing the rendered epipolar line and correspondence results. (5%)

 

Related Questions

. The fundamental operations of create, read, update, and delete (CRUD) in either Python or Java

CS 340 Milestone One Guidelines and Rubric  Overview: For this assignment, you will implement the fundamental operations of create, read, update,

. Develop a program to emulate a purchase transaction at a retail store. This  program will have two classes, a LineItem class and a Transaction class

Retail Transaction Programming Project  Project Requirements:  Develop a program to emulate a purchase transaction at a retail store. This

. The following program contains five errors. Identify the errors and fix them

7COM1028   Secure Systems Programming   Referral Coursework: Secure

. Accepts the following from a user: Item Name Item Quantity Item Price Allows the user to create a file to store the sales receipt contents

Create a GUI program that:Accepts the following from a user:Item NameItem QuantityItem PriceAllows the user to create a file to store the sales receip

. The final project will encompass developing a web service using a software stack and implementing an industry-standard interface. Regardless of whether you choose to pursue application development goals as a pure developer or as a software engineer

CS 340 Final Project Guidelines and Rubric  Overview The final project will encompass developing a web service using a software stack and impleme