Point feature matching


In image processing, point feature matching is an effective method to detect a specified target in a cluttered scene. This method detects single objects rather than multiple objects. For instance, by using this method, one can recognize one specific person in a cluttered scene, but not any other person.
The algorithm is based on comparing and analyzing point correspondences between the reference image and the target image. If any part of the cluttered scene shares correspondences greater than the threshold, that part of the cluttered scene image is targeted and considered to include the reference object there.

MATLAB implementation


% if original image is a color image, we need to grayscale it
originalPadsImage = ;
padsImage = rgb2gray;
figure;
imshow;
title;
originalDeskImage = ;
deskImage = rgb2gray;
figure;
imshow;
title;
padBoxPoints = detectSURFFeatures;
deskPoints = detectSURFFeatures;
figure;
imshow;
title;
hold on;
plot;
figure;
imshow;
title;
hold on;
plot;
= extractFeatures;
= extractFeatures;
boxPairs = matchFeatures;
% Display putatively matched features.
matchedPadBoxPoints = padboxPoints;
matchedDeskPoints = deskPoints;
figure;
showMatchedFeatures;
title;
= estimateGeometricTransform;
% display the inliers only
figure;
showMatchedFeatures;
title;
% drawing out the box
boxPolygon = ;
newBoxPolygon = transformPointsForward;
figure;
imshow;
hold on;
line, newBoxPolygon;
title;

Video stabilization

In addition to object detection, point feature also helps in improving video stabilization. To achieve this, it usually follows these steps: reading frames, identifying salient points, corresponding points, accurate correspondence, and frame correction.

Identify salient points

The purpose of identifying the corresponding salient points that exist between two frames is to reduce distortion. Corner detection is used to identify salient points. To find corner values, Harris Corner Detector can be used.

Corresponding points

In this step, by extracting a matrix of 9 x 9 blocks for each point, cost to include them in the solution can be computed. The lowest cost reveals the object.

Accurate correspondence

Using the random sample consensus algorithm, incorrect point correspondences with strong estimation of changing in location in the image can be determined.