Super-resolution microscopy
Super-resolution microscopy is a series of techniques in optical microscopy that allow such images to have resolutions higher than those imposed by the diffraction limit, which is due to the diffraction of light. Super-resolution imaging techniques rely on the near-field or on the far-field. Among techniques that rely on the latter are those that improve the resolution only modestly beyond the diffraction-limit, such as confocal microscopy with closed pinhole or aided by computational methods such as deconvolution or detector-based pixel reassignment, the 4Pi microscope, and structured-illumination microscopy technologies such as SIM and [|SMI].
There are two major groups of methods for super-resolution microscopy in the far-field that can improve the resolution by a much larger factor:
- Deterministic super-resolution: the most commonly used emitters in biological microscopy, fluorophores, show a nonlinear response to excitation, which can be exploited to enhance resolution. Such methods include STED, GSD, RESOLFT and SSIM.
- Stochastic super-resolution: the chemical complexity of many molecular light sources gives them a complex temporal behavior, which can be used to make several nearby fluorophores emit light at separate times and thereby become resolvable in time. These methods include Super-resolution optical fluctuation imaging and all single-molecule localization methods, such as [|SPDM], SPDMphymod, PALM, FPALM, STORM, and dSTORM.
History
By 1978, the first theoretical ideas had been developed to break the Abbe limit, which called for using a 4Pi microscope as a confocal laser-scanning fluorescence microscope where the light is focused from all sides to a common focus that is used to scan the object by 'point-by-point' excitation combined with 'point-by-point' detection.Some of the following information was gathered from a chemistry blog's review of sub-diffraction microscopy techniques.
In 1986, a super-resolution optical microscope based on stimulated emission was patented by Okhonin.
Super-resolution techniques
Photon tunneling microscopy (PTM)
Local enhancement / ANSOM / optical nano-antennas
Near-field optical random mapping (NORM) microscopy
Near-field optical random mapping microscopy is a method of optical near-field acquisition by a far-field microscope through the observation of nanoparticles' Brownian motion in an immersion liquid.NORM utilizes object surface scanning by stochastically moving nanoparticles. Through the microscope, nanoparticles look like symmetric round spots. The spot width is equivalent to the point spread function and is defined by the microscope resolution. Lateral coordinates of the given particle can be evaluated with a precision much higher than the resolution of the microscope. By collecting the information from many frames one can map out the near field intensity distribution across the whole field of view of the microscope. In comparison with NSOM and ANSOM this method does not require any special equipment for tip positioning and has a large field of view and a depth of focus. Due to the large number of scanning "sensors" one can achieve image acquisition in a shorter time.
4Pi
A 4Pi microscope is a laser-scanning fluorescence microscope with an improved axial resolution. The typical value of 500–700 nm can be improved to 100–150 nm, which corresponds to an almost spherical focal spot with 5–7 times less volume than that of standard confocal microscopy.The improvement in resolution is achieved by using two opposing objective lenses, both of which are focused to the same geometric location. Also, the difference in optical path length through each of the two objective lenses is carefully minimized. By this, molecules residing in the common focal area of both objectives can be illuminated coherently from both sides, and the reflected or emitted light can be collected coherently, i.e. coherent superposition of emitted light on the detector is possible. The solid angle that is used for illumination and detection is increased and approaches the ideal case, where the sample is illuminated and detected from all sides simultaneously.
Up to now, the best quality in a 4Pi microscope has been reached in conjunction with STED microscopy in fixed cells and RESOLFT microscopy with switchable proteins in living cells.
Structured illumination microscopy (SIM)
Structured illumination microscopy enhances spatial resolution by collecting information from frequency space outside the observable region. This process is done in reciprocal space: the Fourier transform of an SI image contains superimposed additional information from different areas of reciprocal space; with several frames where the illumination is shifted by some phase, it is possible to computationally separate and reconstruct the FT image, which has much more resolution information. The reverse FT returns the reconstructed image to a super-resolution image.SIM microscopy could potentially replace electron microscopy as a tool for some medical diagnoses. These include diagnosis of kidney disorders, kidney cancer, and blood diseases.
Although the term "structured illumination microscopy" was coined by others in later years, Guerra first published results in which light patterned by a 50 nm pitch grating illuminated a second grating of pitch 50 nm, with the gratings rotated with respect to each other by the angular amount needed to achieve magnification. Although the illuminating wavelength was 650 nm, the 50 nm grating was easily resolved. This showed a nearly 5-fold improvement over the Abbe resolution limit of 232 nm that should have been the smallest obtained for the numerical aperture and wavelength used. In further development of this work, Guerra showed that super-resolved lateral topography is attained by phase-shifting the evanescent field. Several U.S. patents were issued to Guerra individually, or with colleagues, and assigned to the Polaroid Corporation. Licenses to this technology were procured by Dyer Energy Systems, Calimetrics Inc., and Nanoptek Corp. for use of this super-resolution technique in optical data storage and microscopy.
Spatially modulated illumination (SMI)
One implementation of structured illumination is known as spatially modulated illumination. Like standard structured illumination, the SMI technique modifies the point spread function of a microscope in a suitable manner. In this case however, "the optical resolution itself is not enhanced"; instead structured illumination is used to maximize the precision of distance measurements of fluorescent objects, to "enable size measurements at molecular dimensions of a few tens of nanometers".The Vertico SMI microscope achieves structured illumination by using one or two opposing interfering laser beams along the axis. The object being imaged is then moved in high-precision steps through the wave field, or the wave field itself is moved relative to the object by phase shifts. This results in an improved axial size and distance resolution.
SMI can be combined with other super resolution technologies, for instance with 3D LIMON or LSI-TIRF as a total internal reflection interferometer with laterally structured illumination. This SMI technique allows one to acquire light-optical images of autofluorophore distributions in sections from human eye tissue with previously unmatched optical resolution. Use of three different excitation wavelengths, enables one to gather spectral information about the autofluorescence signal. This has been used to examine human eye tissue affected by macular degeneration.
Deterministic functional techniques
microscopy is an optical microscopy with very high resolution that can image details in samples that cannot be imaged with conventional or confocal microscopy. Within RESOLFT the principles of STED microscopy and GSD microscopy are generalized. Also, there are techniques with other concepts than RESOLFT or SSIM. For example, fluorescence microscopy using the optical AND gate property of nitrogen-vacancy center, or super-resolution by Stimulated Emission of Thermal Radiation, which uses the intrinsic super-linerarities of the Black-Body radiation and expands the concept of super-resolution beyond microscopy.Stimulated emission depletion (STED)
uses two laser pulses, the excitation pulse for excitation of the fluorophores to their fluorescent state and the STED pulse for the de-excitation of fluorophores by means of stimulated emission. In practice, the excitation laser pulse is first applied whereupon a STED pulse soon follows. Furthermore, the STED pulse is modified in such a way so that it features a zero-intensity spot that coincides with the excitation focal spot. Due to the non-linear dependence of the stimulated emission rate on the intensity of the STED beam, all the fluorophores around the focal excitation spot will be in their off state. By scanning this focal spot, one retrieves the image. The full width at half maximum of the point spread function of the excitation focal spot can theoretically be compressed to an arbitrary width by raising the intensity of the STED pulse, according to equation.The main disadvantage of STED, which has prevented its widespread use, is that the machinery is complicated. On the one hand, the image acquisition speed is relatively slow for large fields of view because of the need to scan the sample in order to retrieve an image. On the other hand, it can be very fast for smaller fields of view: recordings of up to 80 frames per second have been shown. Due to a large Is value associated with STED, there is the need for a high-intensity excitation pulse, which may cause damage to the sample.
Ground state depletion (GSD)
uses the triplet state of a fluorophore as the off-state and the singlet state as the on-state, whereby an excitation laser is used to drive the fluorophores at the periphery of the singlet state molecule to the triplet state. This is much like STED, where the off-state is the ground state of fluorophores, which is why equation also applies in this case. The value is smaller than in STED, making super-resolution imaging possible at a much smaller laser intensity. Compared to STED, though, the fluorophores used in GSD are generally less photostable; and the saturation of the triplet state may be harder to realize.Saturated structured illumination microscopy (SSIM)
Saturated structured-illumination microscopy exploits the nonlinear dependence of the emission rate of fluorophores on the intensity of the excitation laser. By applying a sinusoidal illumination pattern with a peak intensity close to that needed in order to saturate the fluorophores in their fluorescent state, one retrieves Moiré fringes. The fringes contain high order spatial information that may be extracted by computational techniques. Once the information is extracted, a super-resolution image is retrieved.SSIM requires shifting the illumination pattern multiple times, effectively limiting the temporal resolution of the technique. In addition there is the need for very photostable fluorophores, due to the saturating conditions, which inflict radiation damage on the sample and restrict the possible applications for which SSIM may be used.
Examples of this microscopy are shown under section Structured illumination microscopy : images of cell nuclei and mitotic stages recorded with 3D-SIM Microscopy.
Stochastic functional techniques
Localization microscopy
Single-molecule localization microscopy summarizes all microscopical techniques that achieve super-resolution by isolating emitters and fitting their images with the point spread function. Normally, the width of the point spread function limits resolution. However, given an isolated emitter, one is able to determine its location with a precision only limited by its intensity according to equation.This fitting process can only be performed reliably for isolated emitters, and interesting biological samples are so densely labeled with emitters that fitting is impossible when all emitters are active at the same time. SMLM techniques solve this dilemma by activating only a sparse subset of emitters at the same time, localizing these few emitters very precisely, deactivating them and activating another subset.
Considering background and camera pixelation, and using Gaussian approximation for the point spread function of a typical microscope, the theoretical resolution is proposed by Thompson et al. and fine-tuned by Mortensen et al.:
Generally, localization microscopy is performed with fluorophores. Suitable fluorophores reside in a non-fluorescent dark state for most of the time and are activated stochastically, typically with an excitation laser of low intensity. A readout laser stimulates fluorescence and bleaches or photoswitches the fluorophores back to a dark state, typically within 10–100 ms. In points accumulation for imaging in nanoscale topography, the fluorophores are nonfluorescent before binding and fluorescent after. The photons emitted during the fluorescent phase are collected with a camera and the resulting image of the fluorophore can be fitted with very high precision, even on the order of a few Angstroms. Repeating the process several thousand times ensures that all fluorophores can go through the bright state and are recorded. A computer then reconstructs a super-resolved image.
The desirable traits of fluorophores used for these methods, in order to maximize the resolution, are that they should be bright. That is, they should have a high extinction coefficient and a high quantum yield. They should also possess a high contrast ratio. Also, a densely labeled sample is desirable, according to the Nyquist criteria.
The multitude of localization microscopy methods differ mostly in the type of fluorophores used.
Spectral precision distance microscopy (SPDM)
A single, tiny source of light can be located much better than the resolution of a microscope usually allows for: although the light will produce a blurry spot, computer algorithms can be used to accurately calculate the center of the blurry spot, taking into account the point spread function of the microscope, the noise properties of the detector, etc. However, this approach does not work when there are too many sources close to each other: the sources then all blur together.Spectral precision distance microscopy is a family of localizing techniques in fluorescence microscopy which gets around the problem of there being many sources by measuring just a few sources at a time, so that each source is "optically isolated" from the others, if the particles under examination have different spectral signatures, so that it is possible to look at light from just a few molecules at a time by using the appropriate light sources and filters. This achieves an effective optical resolution several times better than the conventional optical resolution that is represented by the half-width of the main maximum of the effective point image function.
The structural resolution achievable using SPDM can be expressed in terms of the smallest measurable distance between two punctiform particles of different spectral characteristics. Modeling has shown that under suitable conditions regarding the precision of localization, particle density, etc., the "topological resolution" corresponds to a "space frequency" that, in terms of the classical definition, is equivalent to a much improved optical resolution. Molecules can also be distinguished in even more subtle ways based on fluorescent lifetime and other techniques.
An important application is in genome research. Another important area of use is research into the structure of membranes.
SPDMphymod
Localization microscopy for many standard fluorescent dyes like GFP, Alexa dyes, and fluorescein molecules is possible if certain photo-physical conditions are present. With this so-called physically modifiable fluorophores technology, a single laser wavelength of suitable intensity is sufficient for nanoimaging in contrast to other localization microscopy technologies that need two laser wavelengths when special photo-switchable/photo-activatable fluorescence molecules are used. A further example of the use of SPDMphymod is an analysis of Tobacco mosaic virus particles or the study of virus–cell interaction.Based on singlet–triplet state transitions it is crucial for SPDMphymod that this process is ongoing and leading to the effect that a single molecule comes first into a very long-living reversible dark state from which it returns to a fluorescent state emitting many photons for several milliseconds before it returns into a very long-living, so-called irreversible dark state. SPDMphymod microscopy uses fluorescent molecules that emit the same spectral light frequency but with different spectral signatures based on the flashing characteristics. By combining two thousands images of the same cell, it is possible, using laser optical precision measurements, to record localization images with significantly improved optical resolution.
Standard fluorescent dyes already successfully used with the SPDMphymod technology are GFP, RFP, YFP, Alexa 488, Alexa 568, Alexa 647, Cy2, Cy3, Atto 488 and fluorescein.
Cryogenic Optical Localization in 3D (COLD)
Cryogenic Optical Localization in 3D is a method that allows localizing multiple fluorescent sites within a single small- to medium-sized biomolecule with Angstrom-scale resolution. The localization precision in this approach is enhanced because the slower photochemistry at low temperatures leads to a higher number of photons that can be emitted from each fluorophore before photobleaching. As a result, cryogenic stochastic localization microscopy achieves the sub-molecular resolution required to resolve the 3D positions of several fluorophores attached to a small protein. By employing algorithms known from electron microscopy, the 2D projections of fluorophores are reconstructed into a 3D configuration. COLD brings fluorescence microscopy to its fundamental limit, depending on the size of the label. The method can also be combined with other structural biology techniques—such as X-ray crystallography, magnetic resonance spectroscopy, and electron microscopy—to provide valuable complementary information and specificity.Binding-activated localization microscopy (BALM)
Binding-activated localization microscopy is a general concept for single-molecule localization microscopy : super-resolved imaging of DNA-binding dyes based on modifying the properties of DNA and a dye. By careful adjustment of the chemical environment—leading to local, reversible DNA melting and hybridization control over the fluorescence signal—DNA-binding dye molecules can be introduced. Intercalating and minor-groove binding DNA dyes can be used to register and optically isolate only a few DNA-binding dye signals at a time. DNA structure fluctuation-assisted BALM has been used to nanoscale differences in nuclear architecture, with an anticipated structural resolution of approximately 50 nm. Imaging chromatin nanostructure with binding-activated localization microscopy based on DNA structure fluctuations. Recently, the significant enhancement of fluorescence quantum yield of NIAD-4 upon binding to an amyloid was exploited for BALM imaging of amyloid fibrils and oligomers.STORM, PALM, and FPALM
Stochastic optical reconstruction microscopy, photo activated localization microscopy, and fluorescence photo-activation localization microscopy are super-resolution imaging techniques that utilize sequential activation and time-resolved localization of photoswitchable fluorophores to create high resolution images. During imaging, only an optically resolvable subset of fluorophores is activated to a fluorescent state at any given moment, such that the position of each fluorophore can be determined with high precision by finding the centroid positions of the single-molecule images of a particular fluorophore. One subset of fluorophores is subsequently deactivated, and another subset is activated and imaged. Iteration of this process allows numerous fluorophores to be localized and a super-resolution image to be constructed from the image data.These three methods were published independently over a short period of time, and their principles are identical. STORM was originally described using Cy5 and Cy3 dyes attached to nucleic acids or proteins, while PALM and FPALM were described using photoswitchable fluorescent proteins. In principle any photoswitchable fluorophore can be used, and STORM has been demonstrated with a variety of different probes and labeling strategies. Using stochastic photoswitching of single fluorophores, such as Cy5, STORM can be performed with a single red laser excitation source. The red laser both switches the Cy5 fluorophore to a dark state by formation of an adduct and subsequently returns the molecule to the fluorescent state. Many other dyes have been also used with STORM.
In addition to single fluorophores, dye-pairs consisting of an activator fluorophore and a photoswitchable reporter dye can be used with STORM. In this scheme, the activator fluorophore, when excited near its absorption maximum, serves to reactivate the photoswitchable dye to the fluorescent state. Multicolor imaging has been performed by using different activation wavelengths to distinguish dye-pairs, depending on the activator fluorophore used, or using spectrally distinct photoswitchable fluorophores, either with or without activator fluorophores. Photoswitchable fluorescent proteins can be used as well. Highly specific labeling of biological structures with photoswitchable probes has been achieved with antibody staining, direct conjugation of proteins, and genetic encoding.
STORM has also been extended to three-dimensional imaging using optical astigmatism, in which the elliptical shape of the point spread function encodes the x, y, and z positions for samples up to several micrometers thick, and has been demonstrated in living cells. To date, the spatial resolution achieved by this technique is ~20 nm in the lateral dimensions and ~50 nm in the axial dimension; and the temporal resolution is as fast as 0.1–0.33s.
Points accumulation for imaging in nanoscale topography (PAINT)
Points accumulation for imaging in nanoscale topography is a single-molecule localization method that achieves stochastic single-molecule fluorescence by molecular adsorption/absorption and photobleaching/desorption. The first dye used was Nile red which is nonfluorescent in aqueous solution but fluorescent when inserted into a hydrophobic environment, such as micelles or living cell walls. Thus, the concentration of the dye is kept small, at the nanomolar level, so that the molecule's sorption rate to the diffraction-limited area is in the millisecond region. The stochastic binding of single-dye molecules to an immobilized target can be spatially and temporally resolved under a typical widefield fluorescence microscope. Each dye is photobleached to return the field to a dark state, so the next dye can bind and be observed. The advantage of this method, compared to other stochastic methods, is that in addition to obtaining the super-resolved image of the fixed target, it can measure the dynamic binding kinetics of the diffusing probe molecules, in solution, to the target.Combining 3D super-resolution technique, photo-activated dyes, power-dependent active intermittency, and points accumulation for imaging in nanoscale topography, SPRAIPAINT can super-resolve live-cell walls. PAINT works by maintaining a balance between the dye adsorption/absorption and photobleaching/desorption rates. This balance can be estimated with statistical principles. The adsorption or absorption rate of a dilute solute to a surface or interface in a gas or liquid solution can be calculated using Fick's laws of diffusion. The photobleaching/desorption rate can be measured for a given solution condition and illumination power density.
DNA-PAINT has been further extended to use regular dyes, where the dynamic binding and unbinding of a dye-labeled DNA probe to a fixed DNA origami is used to achieve stochastic single-molecule imaging. DNA-PAINT is no longer limited to environment-sensitive dyes and can measure both the adsorption and the desorption kinetics of the probes to the target. The method utilizes the camera blurring effect of moving dyes. When a regular dye is diffusing in the solution, its image on a typical CCD camera is blurred because of its relatively fast speed and the relatively long camera exposure time, contributing to the fluorescence background. However, when it binds to a fixed target, the dye stops moving; and clear input into the point spread function can be achieved.
The term for this method is mbPAINT. When a total internal reflection fluorescence microscope is used for imaging, the excitation depth is limited to ~100 nm from the substrate, which further reduces the fluorescence background from the blurred dyes near the substrate and the background in the bulk solution. Very bright dyes can be used for mbPAINT which gives typical single-frame spatial resolutions of ~20 nm and single-molecule kinetic temporal resolutions of ~20 ms under relatively mild photoexcitation intensities, which is useful in studying molecular separation of single proteins.
The temporal resolution has been further improved using a rotational phase mask placed in the Fourier plane during data acquisition and resolving the distorted point spread function that contains temporal information. The method was named Super Temporal-Resolved Microscopy.
Label-free localization microscopy
Optical resolution of cellular structures in the range of about 50 nm can be achieved, even in label-free cells, using localization microscopy SPDM.By using two different laser wavelengths, SPDM reveals cellular objects which are not detectable under conventional fluorescence wide-field imaging conditions, beside making for a substantial resolution improvement of autofluorescent structures.
As a control, the positions of the detected objects in the localization image match those in the bright-field image.
Label-free superresolution microscopy has also been demonstrated using the fluctuations of a surface-enhanced Raman scattering signal on a highly uniform plasmonic metasurface.
Direct stochastical optical reconstruction microscopy (dSTORM)
dSTORM utilizes the photoswitching of a single fluorophore. In dSTORM, fluorophores are embedded in a reducing and oxidizing buffering system and fluorescence is excited. Sometimes, stochastically, the fluorophore will enter a triplet or some other dark state that is sensitive to the oxidation state of the buffer, from which they can be made to fluoresce, so that single molecule positions can be recorded. Development of the dSTORM method occurred at 3 independent laboratories at about the same time and was also called "reversible photobleaching microscopy", "ground state depletion microscopy followed by individual molecule return", as well as the now generally accepted moniker dSTORM.Software for localization microscopy
Localization microscopy depends heavily on software that can precisely fit the point spread function to millions of images of active fluorophores within a few minutes. Since the classical analysis methods and software suites used in the natural sciences are too slow to computationally solve these problems, often taking hours of computation for processing data measured in minutes, specialised software programs have been developed. Many of these localization software packages are open-source; they are listed at SMLM Software Benchmark. Once molecule positions have been determined, the locations need to be displayed and several algorithms for display have been developed.Super-resolution optical fluctuation imaging (SOFI)
It is possible to circumvent the need for PSF fitting inherent in single molecule localization microscopy by directly computing the temporal autocorrelation of pixels. This technique is called super-resolution optical fluctuation imaging and has been shown to be more precise than SMLM when the density of concurrently active fluorophores is very high.Omnipresent Localization Microscopy (OLM)
Omnipresent Localisation Microscopy is an extension of Single Molecule Microscopy techniques that allow high-density single molecule imaging with an incoherent light source and a conventional epifluorescence microscope setup. A short burst of deep-blue excitation enables a prolonged reactivation of molecules, for a resolution of 90 nm on test specimens. Finally, correlative STED and SMLM imaging can be performed on the same biological sample using a simple imaging medium, which can provide a basis for a further enhanced resolution. These findings can democratize superresolution imaging and help any scientist to generate high-density single-molecule images even with a limited budget.Combination of techniques
3D light microscopical nanosizing (LIMON) microscopy
Light MicrOscopical Nanosizing microscopy images, using the Vertico SMI microscope, are made possible by the combination of SMI and SPDM, whereby first the SMI, and then the SPDM, process is applied.The SMI process determines the center of particles and their spread in the direction of the microscope axis. While the center of particles/molecules can be determined with a precision of 1–2 nm, the spread around this point can be determined down to an axial diameter of approximately 30–40 nm.
Subsequently, the position of the individual particle/molecule is determined using SPDM, achieving a precision of a few nanometers.
As a biological application in the 3D dual color mode, the spatial arrangements of Her2/neu and Her3 clusters was achieved. The positions in all three directions of the protein clusters could be determined with an accuracy of about 25 nm.