9.5: In Situ Hybridization

Search Fundamentals of Biochemistry

Learning Goals

(Learning goals written by Claude, Sonnet 4.6, Anthropic)

Principles and Formats of In Situ Hybridization

• Explain the molecular basis of in situ hybridization (ISH) — describing how a labeled complementary probe (DNA, RNA/riboprobe, or modified nucleic acid) is applied to fixed cells, tissue sections, or whole mounts and hybridizes to its target sequence (mRNA, lncRNA, miRNA, or chromosomal DNA) through Watson-Crick base pairing, how hybridization stringency conditions (temperature, salt concentration, detergent) are optimized so that only perfect-match probe-target duplexes are retained after washing (while mismatched or non-specifically bound probes are removed), and how this differs from immunohistochemistry, which localizes proteins through antibody-antigen interactions rather than nucleic acid hybridization.
• Compare the major ISH formats and their applications — distinguishing section-based ISH (for localizing transcripts or chromosomal sequences in thin tissue slices), whole-mount ISH (for visualizing gene expression patterns throughout entire small organisms such as Drosophila embryos or plant seeds), RNA ISH for measuring and spatially localizing mRNAs, lncRNAs, and miRNAs within cells and tissues, fluorescence ISH (FISH) using fluorescently labeled DNA probes to detect chromosomal sequences for medical cytogenetic diagnostics (assessing chromosomal integrity, detecting translocations, amplifications, and deletions), and circulating tumor cell (CTC) ISH — explaining what biological or medical question each format is best suited to answer.
• Describe the labeling strategies and detection methods used in ISH — comparing radioactive labels (detected by autoradiography on X-ray film, sensitive but slow and requiring special handling), fluorescent labels (detected by fluorescence microscopy, enabling multicolor multiplex detection), and antigen-based labels such as digoxigenin (detected immunohistochemically by anti-digoxigenin antibodies coupled to alkaline phosphatase or peroxidase, enabling bright-field microscopy without specialized fluorescence equipment) — and explain how the choice of label and detection method is dictated by the required sensitivity, spatial resolution, throughput, and whether simultaneous detection of multiple targets is needed.

Branched DNA Signal Amplification and Advanced Applications

• Explain the branched DNA (bDNA) assay mechanism for single-molecule RNA detection — describing how target-specific probe sets (typically 40 oligonucleotides forming 20 adjacent pairs for mRNA/lncRNA, or 2 oligonucleotides for miRNA) hybridize side-by-side on the target RNA, how this adjacency requirement provides specificity (only paired probes serve as docking sites for pre-amplifier molecules), how sequential hybridization of pre-amplifiers → multiple amplifiers per pre-amplifier → multiple label probes (conjugated to alkaline phosphatase or fluorophores) per amplifier builds a branched "tree" structure with ~400 label-binding sites per mRNA molecule, achieving ~8,000-fold signal amplification per transcript — explaining why this amplification strategy enables single-molecule sensitivity without radioactivity and distinguishing it from PCR-based amplification of the target sequence itself.
• Connect ISH and bDNA assay applications to biological and clinical questions — explaining how RNA ISH reveals the spatial and temporal pattern of gene expression in developing organisms (e.g., hunchback mRNA localization in Drosophila embryos defining the anterior-posterior body axis), how FISH diagnoses chromosomal abnormalities in cancer and prenatal testing, how multiplex ISH (simultaneously detecting up to four RNA targets using spectrally distinct label systems) allows co-localization of transcripts within the same cell, and how CTC ISH enables molecular characterization of rare tumor cells in patient blood — illustrating the principle that the spatial context of gene expression, not just overall expression level, is essential for understanding gene regulation, cell identity, and disease.

In situ hybridization (ISH) is a type of hybridization that uses a labeled complementary DNA, RNA, or modified nucleic acids strand (i.e., probe) to localize a specific DNA or RNA sequence in a portion or section of tissue (in situ) or if the tissue is small enough (e.g., plant seeds, Drosophila embryos), in the entire tissue (whole mount ISH), in cells, and in circulating tumor cells (CTCs). This is distinct from immunohistochemistry, which usually localizes proteins in tissue sections.

In situ hybridization is used to reveal the location of specific nucleic acid sequences on chromosomes or in tissues, a crucial step for understanding genes' organization, regulation, and function. The key techniques currently in use include in situ hybridization to mRNA with oligonucleotide and RNA probes (both radio-labeled and hapten-labeled), analysis with light and electron microscopes, whole mount in situ hybridization, double detection of RNAs and RNA plus protein, and fluorescent in situ hybridization to detect chromosomal sequences. DNA ISH can be used to determine the structure of chromosomes. For example, fluorescent DNA ISH (FISH) can be used in medical diagnostics to assess chromosomal integrity. RNA ISH (RNA in situ hybridization) is used to measure and localize RNAs (mRNAs, lncRNAs, and miRNAs) within tissue sections, cells, whole mounts, and circulating tumor cells (CTCs). In situ hybridization was invented by Mary-Lou Pardue and Joseph G. Gall.

Figure 5.28 In Situ Hybridization of wild-type Drosophila embryos at different developmental stages for the RNA from a gene called hunchback. Image by Nina

For hybridization histochemistry, sample cells and tissues are usually treated to fix the target transcripts and increase access to the probe. As noted above, the probe is either a labeled complementary DNA or, more commonly now, a complementary RNA (riboprobe). The probe hybridizes to the target sequence at elevated temperature. Then, the excess probe is washed away (after RNase hydrolysis, if the probe is unhybridized). Solution parameters, such as temperature, salt, and/or detergent concentration, can be adjusted to remove non-identical interactions (i.e., only exact sequence matches will remain bound). Then, the probe labeled with either radio-, fluorescent-, or antigen-labeled bases (e.g., digoxigenin) is localized and quantified in the tissue, using either autoradiography, fluorescence microscopy, or immunohistochemistry, respectively. ISH can also use two or more probes labeled with radioactivity or other non-radioactive labels to detect two or more transcripts simultaneously.

An alternative technology, the branched DNA assay, can be used for RNA (mRNA, lncRNA, and miRNA) in situ hybridization assays with single-molecule sensitivity without radioactivity. This approach (e.g., ViewRNA assays) can visualize up to 4 targets in a single assay and uses patented probe design and bDNA signal amplification to generate sensitive, specific signals. Samples (cells, tissues, and CTCs) are fixed and treated to allow RNA target accessibility (RNA unmasking). Target-specific probes hybridize to each target RNA. Subsequent signal amplification is predicated by specific hybridization of adjacent probes (individual oligonucleotides [oligos] that bind side by side on RNA targets). A typical target-specific probe will contain 40 oligonucleotides, resulting in 20 oligo pairs that bind side-by-side on the target to detect mRNA and lncRNA, and 2 oligos or a single pair for miRNA detection. Signal amplification is achieved via a series of sequential hybridization steps. A pre-amplifier molecule hybridizes to each oligo pair on the target-specific RNA, and then multiple amplifier molecules hybridize to each pre-amplifier. Next, multiple-label probe oligonucleotides (conjugated to alkaline phosphatase or directly to fluorophores) hybridize to each amplifier molecule. A fully assembled signal amplification structure, “Tree,” has 400 binding sites for the label probes. When all target-specific probes bind to the target mRNA transcript, an 8,000-fold signal amplification occurs for that one transcript. Separate but compatible signal amplification systems enable multiplex assays. The signal can be visualized using a fluorescence or brightfield microscope.

Summary

(Summary written by Claude, Sonnet 4.6, Anthropic)

This chapter introduces in situ hybridization (ISH), a family of techniques that localizes specific nucleic acid sequences directly within their biological context — in fixed cells, tissue sections, whole embryos, or circulating tumor cells — providing spatial and temporal information about gene expression and chromosomal organization that cannot be obtained from population-level methods such as microarrays or RNA sequencing.

The foundational principle of ISH is Watson-Crick hybridization between a labeled probe and its complementary target sequence. Tissue samples or cells are chemically fixed (typically with formaldehyde/paraformaldehyde) to crosslink and immobilize RNA or DNA molecules in place and to preserve tissue morphology. Permeabilization treatments (detergents, proteinase K digestion) increase probe accessibility. The probe — a single-stranded complementary DNA oligonucleotide, PCR product, or RNA riboprobe — is applied to the sample and allowed to hybridize under carefully controlled high-stringency conditions: elevated temperature (typically 37–55°C depending on probe GC content and length), defined salt concentration, and detergent (SDS, SSC buffer), which collectively determine the stability of probe-target duplexes. After hybridization, the sample is washed under the same or higher stringency to dissociate non-specifically bound or partially mismatched probes, leaving only perfectly complementary probe-target hybrids. For RNA probes (riboprobes), RNase treatment after hybridization degrades any unhybridized single-stranded probe while leaving the double-stranded probe-target hybrid intact, dramatically reducing background. The remaining hybridized probe is then detected through its label.

ISH exists in several formats suited to different experimental needs. Traditional section-based ISH localizes transcripts or chromosomal sequences in thin (5–20 μm) cryosections or paraffin-embedded tissue sections, enabling precise cellular and subcellular localization of gene expression. Whole-mount ISH (WISH) extends this approach to intact small organisms or embryos — such as Drosophila embryos, zebrafish, or plant seeds — in which the probe penetrates throughout the sample, allowing visualization of spatially restricted gene expression patterns in three dimensions. The classic example is the localization of hunchback mRNA to the anterior half of the Drosophila embryo, revealing how maternal-to-zygotic RNA gradients establish the anterior-posterior body axis. RNA ISH measures and localizes mRNAs, long noncoding RNAs (lncRNAs), and microRNAs (miRNAs) within cells and tissues, providing spatial resolution that complements expression profiling by microarray or RNA-seq. Fluorescence ISH (FISH) uses fluorescently labeled DNA probes to detect specific chromosomal sequences; it is widely used in medical cytogenetics to assess chromosomal integrity, detect translocations (e.g., the Philadelphia chromosome in chronic myeloid leukemia), identify gene amplifications (e.g., HER2 in breast cancer), and perform prenatal diagnosis of chromosomal aneuploidies. FISH is also applied to circulating tumor cells (CTCs) isolated from patient blood, enabling molecular characterization of rare tumor cells without invasive tissue biopsy.

Labeling and detection strategies span radioactive, fluorescent, and antigen-based systems, each with distinct trade-offs. Radioactive labels (³H, ³⁵S, ³²P incorporated into the probe) provide high sensitivity and are detected by autoradiography on X-ray film or nuclear emulsion, but require special handling, produce diffuse signals at the cellular scale, and require long exposure times. Fluorescent labels (Cy3, Cy5, FITC, Texas Red) provide high spatial resolution and enable multicolor simultaneous detection of multiple targets in the same section using spectrally distinct fluorophores, but require fluorescence microscopy and can be subject to photobleaching. Antigen-based labels — most commonly digoxigenin (DIG), a plant steroid hapten incorporated into probe nucleotides — are detected immunohistochemically using anti-DIG antibodies coupled to alkaline phosphatase or horseradish peroxidase, which then generate a colored precipitate detectable by conventional bright-field microscopy. DIG labeling combines good sensitivity with the accessibility of standard light microscopy, making it widely used in developmental biology laboratories.

Branched DNA (bDNA) assays represent a major advance in ISH sensitivity and specificity, enabling single-molecule RNA detection without radioactivity and without amplifying the target sequence (which could introduce bias). The bDNA approach (commercialized as ViewRNA) uses a hierarchical signal amplification strategy. First, 40 target-specific oligonucleotide probes are hybridized to each target mRNA or lncRNA (or 2 probes for miRNA); these probes are designed to bind side-by-side as 20 adjacent pairs. Only when two adjacent probes are both bound to the target does the pair form a docking site for a pre-amplifier molecule — a specificity mechanism that dramatically reduces false-positive signals from non-specific probe binding. Multiple amplifier molecules then hybridize to each pre-amplifier, and multiple label probe oligonucleotides (conjugated to alkaline phosphatase for colorimetric detection or directly to fluorophores) hybridize to each amplifier. The fully assembled branched "tree" structure provides approximately 400 binding sites for label probes per target mRNA, generating ~8,000-fold signal amplification per transcript — sufficient to detect single RNA molecules as discrete fluorescent dots in individual cells. Compatible but spectrally distinct amplification systems enable simultaneous multiplex detection of up to four RNA targets in a single assay, using fluorescence or bright-field microscopy.

The power of ISH across all its formats lies in preserving the spatial context of gene expression. Where RNA-seq and microarrays provide global transcriptome profiles from homogenized cell populations, ISH reveals which specific cells within a heterogeneous tissue express a gene, at what subcellular location the transcript resides, and how expression patterns change during development, disease, or drug treatment. This spatial resolution is essential for understanding gene regulation in complex tissues, defining cell type identity in developing organisms, characterizing tumor heterogeneity, and identifying biomarkers in clinical pathology specimens.