Gibbs phenomenon
Encyclopedia : G : GI : GIB : Gibbs phenomenon
In mathematics, the Gibbs phenomenon (also known as ringing artifacts), named after the American physicist J. Willard Gibbs is the peculiar manner in which the Fourier series of a piecewise continuously differentiable periodic function f behaves at a jump discontinuity: the nth partial sum of the Fourier series has large oscillations near the jump, which might increase the maximum of the partial sum above that of the function itself. The overshoot does not die out as the frequency increases, but approaches a finite limit.
Description
The three pictures on the right demonstrate the phenomenon for a square wave whose Fourier expansion is
- [ \sin(x)+\frac\sin(3x)+\frac\sin(5x)+\dotsb]
As can be seen, as the number of terms rises, the error of the approximation is reduced in width and energy, but converges to a fixed height. A calculation for the square wave (see Zygmund, chap. 8.5., or the computations at the end of this article) gives an explicit formula for the limit of the height of the error. It turns out that the Fourier series exceeds the height [\pi/4] of the square wave by
- [\frac\int_0^\pi \frac\, dt - \frac = \frac\cdot (0.089490\dots)]
- [\int_0^\pi \frac\ dt = (1.851937052\dots) = \frac + \pi \cdot (0.089490\dots)]
The Gibbs phenomenon was first noticed and analyzed by the obscure Henry Wilbraham. He published a paper on it in 1848 that was unnoticed by the mathematical world. It was not until Albert Michelson observed the phenomenon via a mechanical graphing machine that interest arose. Michelson developed a device in 1898 that could compute and re-synthesize the Fourier series. When the Fourier coefficients for a square wave were input to the machine, the graph would oscillate at the discontinuities. This would continue to occur even as the number of Fourier coefficients increased.
Michelson was convinced that the overshoots were caused by errors in the machine, due to the fact that it was a physical device subject to manufacturing flaws. J. Willard Gibbs pointed out in 1899 that the oscillations were a mathematical phenomenon, and would always occur when synthesizing a discontinuous function with a Fourier series. Maxime Bôcher gave a detailed mathematical analysis of the phenomenon in 1906 and named it the Gibbs phenomenon.
Informally, it reflects the difficulty inherent in approximating a discontinuous function by a series of continuous sine and cosine waves. This phenomenon is also closely related to the principle that the decay of the Fourier coefficients of a function at infinity is controlled by the smoothness of that function; very smooth functions will have very rapidly decaying Fourier coefficients (and thus very rapidly convergent Fourier series), whereas discontinuous functions will have very slowly decaying Fourier coefficients (and thus very badly convergent Fourier series). Note for instance that the Fourier coefficients [1, 1/3, 1/5, \dots] of the discontinuous square wave described above decay only as fast as the harmonic series, which is not absolutely convergent; indeed, the above Fourier series turns out to be only conditionally convergent for almost every value of x. This provides a partial explanation of the Gibbs phenomenon, since Fourier series with absolutely convergent Fourier coefficients would be uniformly convergent by the Weierstrass M-test and would thus be unable to exhibit the above oscillatory behavior. By the same token, it is impossible for a discontinuous function to have absolutely convergent Fourier coefficients, since the function would thus be the uniform limit of continuous functions and therefore be continuous, a contradiction. See more about absolute convergence of Fourier series.
In practice, the difficulties associated with the Gibbs phenomenon can be ameliorated by using a smoother method of Fourier series summation, such as Fejér summation or Riesz summation, or by using sigma-approximation. Using a wavelet transform with Haar basis functions, the Gibbs phenomenon does not occur.
Formal mathematical description of the phenomenon
Let [f: \to ] be a piecewise continuously differentiable function which is periodic with some period [L > 0]. Suppose that at some point [x_0], the left limit [f(x_0^-)] and right limit [f(x_0^+)] of the function [f] differ by a non-zero gap [a]:
- [ f(x_0^+) - f(x_0^-) = a \neq 0.]
- [ S_N f(x) := \sum_ \hat f(n) e^= \frac a_0 + \sum_^N a_n \cos\left(\frac\right) + b_n \sin\left(\frac\right)]
- [ \hat f(n) := \frac \int_0^L f(x) e^\ dx]
- [ a_n := \frac \int_0^L f(x) \cos\left(\frac\right)\ dx]
- [ b_n := \frac \int_0^L f(x) \sin\left(\frac\right)\ dx.]
- [ \lim_ S_N f\left(x_0 + \frac\right) = f(x_0^+) + a\cdot (0.089490\dots)]
- [ \lim_ S_N f\left(x_0 - \frac\right) = f(x_0^-) - a\cdot (0.089490\dots)]
- [ \lim_ S_N f(x_0) = \frac.]
- [ \limsup_ S_N f(x_N) \leq f(x_0^+) + a\cdot (0.089490\dots)]
- [ \liminf_ S_N f(x_N) \geq f(x_0^-) - a\cdot (0.089490\dots)]
The square wave example
We now illustrate the above Gibbs phenomenon in the case of the square wave described earlier. In this case the period L is [2\pi], the discontinuity [x_0] is at zero, and the jump a is equal to [\pi/2]. For simplicity let us just deal with the case when N is even (the case of odd N is very similar). Then we have
- [S_N f(x) = \sin(x) + \frac \sin(3x) + \cdots + \frac \sin((N-1)x).]
- [S_N f(0) = 0 = \frac + \frac} = \frac]
- [S_N f(\frac) = \sin\left(\frac\right) + \frac \sin\left(\frac\right)+ \cdots + \frac \sin\left( \frac \right).]
- [S_N f\left(\frac\right) = \frac \left[ frac operatornameleft(fracright) + frac operatornameleft(fracright)+ cdots + frac operatornameleft( frac right) right].]
[\lim_ S_N f\left(\frac\right) ] [= \frac \int_0^1 \operatorname(x)\ dx ] [= \frac \int_^1 \frac\ d(\pi x)] [= \frac \int_0^\pi \frac\ dt \quad = \quad \frac + \frac \cdot (0.089490\dots)] which was what was claimed in the previous section. A similar computation shows
- [\lim_ S_N f\left(-\frac\right) = -\frac \int_0^1 \operatorname(x)\ dx = -\frac -\frac \cdot (0.089490\dots).]
See also
- Compare with Runge's phenomenon for polynomial approximations
- Sigma approximation
- Square wave
- Henry Wilbraham
Publications
- Gibbs, J. W., "Fourier Series". Nature 59, 200 and 606, 1899.
- Antoni Zygmund, Trigonometrical series, Dover publications, 1955.
- Wilbraham, H. On a certain periodic function, Cambridge and Dublin Math. J., 3 (1848), pp. 198-201.
- Paul J. Nahin, Dr. Euler's Fabulous Formula, Princeton University Press, 2006. Ch. 4, Sect. 4.
External links and references
- Braennlund, Johan, "[Why are sine waves fundamental]".
- Weisstein, Eric W., "[Gibbs Phenomenon]". From MathWorld--A Wolfram Web Resource.
- Prandoni, Paolo, "[Gibbs Phenomenon]".
- Radaelli-Sanchez, Ricardo, and Richard Baraniuk, "[Gibbs Phenomenon]". The Connexions Project. (Creative Commons Attribution License)
- Pavel, "[Gibbs phenomenon]". math.mit.edu. (Java applet)
From Wikipedia, the Free Encyclopedia. Original article here. Support Wikipedia by contributing or donating.
All text is available under the terms of the GNU Free Documentation License See Wikipedia Copyrights for details.
