Image derivatives


Image derivatives can be computed by using small convolution filters of size 2 x 2 or 3 x 3, such as the Laplacian, Sobel, Roberts and Prewitt operators. However, a larger mask will generally give a better approximation of the derivative and examples of such filters are Gaussian derivatives and Gabor filters. Sometimes high frequency noise needs to be removed and this can be incorporated in the filter so that the Gaussian kernel will act as a band pass filter. The use of Gabor filters in image processing has been motivated by some of its similarities to the perception in the human visual system.
The pixel value is computed as a convolution
where is the derivative kernel and is the pixel values in a region of the image and is the operator that performs the convolution.

Sobel derivatives

The derivative kernels, known as the Sobel operator are defined as follows, for the and directions respectively:
where here denotes the 2-dimensional convolution operation.
This operator is separable and can be decomposed as the products of an interpolation and a differentiation
kernel, so that,, for an example can be written as

Farid and Simoncelli derivatives

Farid and Simoncelli. propose to use a pair of kernels, one for interpolation and another for differentiation. These kernels, of fixed sizes 5 x 5 and 7 x 7, are optimized so that the Fourier transform approximates their correct derivative relationship.
In Matlab code the so called 5-tap filter is

k = ;
d = ;
d2 = ;

And the 7-tap filter is

k = ;
d = ;
d2 = ;

As an example the first order derivatives can be computed in the following using Matlab in order to perform the convolution

Iu = conv2; % derivative vertically
Iv = conv2; % derivative horizontally

It is noted that Farid and Simoncelli have derived first derivative coefficients which are more accurate compared to the ones provided above. However, the latter are consistent with the second derivative interpolator and, therefore, are better to use if both the first and second derivatives are sought. In the opposite case, when only the first derivative is desired, the optimal first derivative coefficients should be employed; more details can be found in their paper.

Hast derivatives

Derivative filters based on arbitrary cubic splines was presented by Hast. He showed how both first and second order derivatives can be computed more correctly using cubic or trigonometric splines. Efficient derivative filters need to be of odd length so that the derivative is computed for the central pixel. However, any cubic filter is fitted over 4 sample points, giving a centre that falls between pixels. This is solved by a double filtering approach giving filters of size 7 x 7. The idea is to first filter by interpolation so that the interpolated value between pixels are obtained, whereafter the procedure is repeated using a derivative filters, where the centre value now falls on pixel centres. This can easily be proved by the associative law for convolution
Therefore the convolution kernel for computing the derivative using an interpolating kernel and a derivative kernel becomes
Also keep in mind that convolution is commutative, so that the order of the two kernels does not matter and it is also possible to insert a second order derivative as well as a first order derivative kernel. These kernels are derived from the fact that any spline surface can be fitted over a square pixel region, compare to Bezier surfaces. Hast proves that such a surface can be performed as a separable convolution
where is the spline basis matrix, and are vectors containing the variables and, such as
The convolution kernels can now be set to
The first order derivatives at the central pixel are hence computed as
and
Likewise, with the second order derivative kernels are
and
The cubic spline filter is evaluated in its centre and therefore
Likewise the first order derivatives becomes
And in a similar manner the second order derivatives are
Any cubic filter can be applied and used for computing the image derivates using the above equations, such as Bézier, Hermite or B-splines.
The example in below in Matlab use the Catmull-Rom spline to compute the derivatives

M = * 0.5;
u = ;
up = ;
d = up'*M;
k = u'*M;
Iu = conv2, conv; % vertical derivative
Iv = conv2, conv; % horizontal derivative

Other approaches

Steerable filters can be used for computing derivatives Moreover, Savitzky and Golay propose a least-squares polynomial smoothing approach, which could be used for computing derivatives and Luo et al discuss this approach in further detail. Scharr shows how to create derivative filters by minimizing the error in the Fourier domain and Jähne et al discuss in more detail the principles of filter design, including derivative filters.