You might be able to minimize the chip’s “read noise” (but not the photon shot noise) by purchasing better electronics. Nonetheless, if you take more exposures and make more measurements, you can minimize the net noise level, be it natural or instrumental.

Although contributions from cosmic rays, satellites, asteroids, and other transient effects are not sources of noise, they are certainly unwanted signals. They are identifiable because their values may be significantly different from the fluctuations of values you expect to see each time you take an exposure. Image #1 plots the frequency of 27 values from a single pixel in one of my recent data sets.

Most programs have a “sigma rejection” algorithm, which simply calculates the mean value and the standard deviation from your measurements. “Sigma” and “standard deviation” are inscrutable terms to people who aren’t mathematicians. If you remember nothing else, remember this: The standard deviation of a set of measurements, often denoted by the Greek letter sigma (σ), is nothing more than the average distance to the mean. That’s it! Just ask each value, “How far are you from the mean?” and average all of the answers. If a value is many times the average distance to the mean, then we can safely reject it.

For my data in Image #1, the mean is 1,861, and the average distance to the mean, i.e. one standard deviation, is 376. The difference between 3,729 and 1,861 is around five times what you would expect for a typical fluctuation. Programs will ask you to enter the threshold, in standard deviations, and any reading above it excludes a value. Typically if a value is more than two or three standard deviations, it is likely an outlier caused by an unwanted source. The calculation of a standard deviation is meaningful when you have taken more than seven images.

This is not the same kind of rejection and is not as robust as the method I described above. Some programs identify out-lying values statistically, and instead of simply taking the average of the remaining values, they use a substitution method based on neighboring pixels. This processing error yields poorer results for your hard-won images, and it is one that I see often during my workshops. In other words, please do not do this!

In my next column, I will demonstrate the minimum filter, and I’ll offer a powerful variation for this common processing trick.