Generative Modeling for Protein Design¶

11/2/2026¶

Adapted from orginal slides by Emma Flynn

print view

In [17]:
%%html
<script src="https://bits.csb.pitt.edu/preamble.js"></script>
<style>:root {--jp-cell-prompt-width: 0px}
    .citation { font-size: small }
.reveal blockquote {
  box-sizing: border-box;
  width: 100%;
  margin: 1em 0;
  padding: 0.65em 1em;

  font-size: 0.95em;
  font-style: normal;
  line-height: 1.4;
  text-align: left;

  color: #24344d;
  background: #f0f4fa;
  border-left: 5px solid #003594;
  border-radius: 0 6px 6px 0;
  box-shadow: none;
}

.reveal blockquote > :first-child {
  margin-top: 0;
}

.reveal blockquote > :last-child {
  margin-bottom: 0;
}
    
.pd-boltz p {
    margin: 0;
}
.pd-pair {
    display: grid;
    grid-template-columns: 1fr 1fr;
    gap: 22px;
    align-items: center;
    text-align: center;
}

.pd-pair img {
    max-height: 405px;
    width: auto;
}

.pd-figure {
    text-align: center;
}

.pd-figure img {
    max-height: 470px;
    width: auto;
}

.pd-side .pd-visual {
    min-width: 0;
    text-align: center;
}

.pd-visual p {
    margin: 0;
}

.pd-visual img {
    margin: 0;
}

.pd-side .pd-visual img {
    max-height: 480px;
    width: auto;
}

.pd-side .pd-visual p {
    margin: 8px 0;
}

.pd-side .pd-visual.pd-multiple img {
    max-height: 220px;
}
</style>

Protein design: from an objective to a sequence¶

  • Why design? Applications and useful properties.
  • ProteinMPNN: choose a sequence for a backbone.
  • RFdiffusion: generate a backbone with structural constraints.

Protein design animated introduction

Dauparas et al. · ProteinMPNN · Science 2022 · Watson et al. · RFdiffusion · Nature 2023

Proteins are already medicines¶

Antibodies, enzymes and signaling proteins can themselves be therapeutics.

Annual FDA CDER approvals from 1994 through 2025, with red bars for biologics license applications and dark bars for new molecular entities; the complete chart from Lecture 1.

Annual CDER approvals. BLAs: biologics license applications; NMEs: new molecular entities.
Excludes products approved by CBER, including vaccines and gene/cell therapies.

How can we design their sequences and structures for the function we want?

Lecture 1 · FDA approvals · Mullard · 2025 FDA approvals · Nat. Rev. Drug Discov. 2026 · FDA · Therapeutic biologics

Biocatalysis: a new scaffold around an active site¶

Designed hydrolase win: its experimental crystal structure in rainbow colors overlaid with the gray computational design model, with C-alpha RMSD 0.83 angstrom.

Crystal structure and design: win (rainbow/gray), PDB 9DEF. Fig. 3D.

Product accumulation by designed win and catalytic-residue variants. The dashed enzyme-concentration line is exceeded by the parent design, demonstrating repeated turnover.

Turnover: WT = parent win; dashed line = enzyme concentration. Shading: SD. Fig. 2E.

Design: RFdiffusion generates backbones; LigandMPNN designs sequences; Rosetta FastRelax refines models; PLACER assesses catalytic geometry.

Product exceeds enzyme concentration, demonstrating repeated turnover.

Lauko et al. · Science 2025 · Figs. 3D, 2E (win)

Vaccines: controlling antigen presentation¶

Full-valency structural model of the designed DS-Cav1-I53-50 vaccine nanoparticle, with blue RSV F antigen trimers displayed around the gray and orange two-component scaffold.

Structural model: blue RSV antigen on the gray/orange I53-50 scaffold at full valency. Fig. 1B.

Original Figure 4B: mouse serum neutralization titers are higher with increasing antigen valency on the designed I53-50 nanoparticle than with soluble DS-Cav1 antigen.

Mouse serum neutralization: symbols = animals; bars = geometric means. Percentages = antigen valency. Fig. 4B.

Design: Rosetta-designed interfaces assemble I53-50; stabilized RSV F antigen (DS-Cav1) is displayed on its exterior.

Greater antigen display density gives higher neutralization titers in mice.

Marcandalli et al. · Cell 2019 · Figs. 1B, 4B · I53-50 design: Bale et al. · Science 2016

Antivirals: designed miniprotein inhibitors¶

LCB1 miniprotein bound to the SARS-CoV-2 receptor-binding domain. Experimental cryo-EM LCB1 is magenta, its design model gray, and the receptor-binding domain cyan.

Cryo-EM and design: LCB1 (magenta/gray) bound to RBD (cyan). Fig. 4B.

Original Figure 5B: relative infection falls with increasing concentrations of the designed LCB1 and LCB3 miniproteins; other designs and an influenza-binder control are also shown.

Neutralization: LCB1 and LCB3 reduce cultured-cell infection. Fig. 5B (2020 study).

Design: Rosetta docks miniprotein scaffolds and optimizes the RBD interface, followed by experimental screening and affinity optimization.

The small designed binder blocks a viral interaction needed for infection.

Cao et al. · Science 2020 · Figs. 4B, 5B

Antibodies: proteins that recognize specific targets¶

IgG antibody showing heavy and light chains, Fab and Fc regions, and antigen-binding sites

Immunoglobulin G (IgG) is a Y-shaped antibody composed of two heavy chains and two light chains.

  • Fab (fragment antigen-binding): the two arms that recognize antigens.
  • Fc (fragment crystallizable): the stem that interacts with immune receptors.
  • Variable regions: determine which antigen the antibody recognizes.
  • CDRs (complementarity-determining regions): six loops per binding site that largely determine binding specificity.
RCSB PDB-101 · Antibodies

Antibody structure¶

● Light chains (A, C)
● Heavy chains (B, D)
● Light-chain CDRs
● Heavy-chain CDRs
PDB 1IGT · Harris et al. · Biochemistry (1997)

Antibody–antigen recognition¶

Antigen recognition: The heavy- and light-chain variable domains form a binding interface through their CDR loops.

● Light chain (A)
● Light-chain CDRs
● Heavy chain (B)
● Heavy-chain CDRs
● Antigen: lysozyme (C)
PDB 1VFB · Bhat et al. · 1994 · X-ray structure (1.8 Å)

Nanobodies: single-domain antigen binders¶

● Nanobody VHH (A)
● CDR loops (1–3)
● Antigen: lysozyme (L)

Camelids produce heavy-chain-only antibodies. Their isolated variable domain (VHH, or nanobody) can recognize antigens without a light chain.

  • Small (~15 kDa), typically stable and soluble.
  • Three CDR loops form the antigen-binding surface.
  • An elongated CDR3 can reach into pockets inaccessible to conventional antibodies.
PDB 1ZVH · De Genst et al. · PNAS 2006 · Crystal structure (1.5 Å)

Camelids¶

No description has been provided for this image

What do we design in an antibody?¶

  • Epitope: the surface on the target (antigen) that we want to recognize.
  • Paratope: the antibody surface that contacts it, usually involving the CDR loops.
  • Design variables: CDR geometry and sequence, supported by a suitable framework.
  • Molecular format: a VHH, a linked VH–VL fragment (scFv), or a full antibody

A useful binder also needs specificity, suitable expression and stability, and the biological effect required by its application.

Bennett et al. · Antibody design · Nature 2026 · Tijink et al. · Nanobody formats · 2008

Nanobodies: choosing the binding epitope¶

Experimental cryo-EM structure of VHH_flu_01 overlaid with its design model on influenza haemagglutinin. Navy is experimental VHH, gray the design, yellow HA and teal glycans.

Cryo-EM VHH: navy; design: gray. VHH_flu_01 bound to HA (yellow), with glycans in teal. Fig. 3f.

Original Figure 2b: surface plasmon resonance sensorgram for a designed VHH binding influenza haemagglutinin. Blue measured response and dashed black fit are displayed.

SPR binding: blue = measured response; dashed black = global 1:1 fit. Fig. 2b.

Design: antibody-specialized RFdiffusion generates CDR backbones; ProteinMPNN designs their sequences; tuned RoseTTAFold2 filters complexes.

After experimental screening, VHH_flu_01 binds influenza HA with Kd = 78 nM.

Bennett et al. · Nature 2026 (online 2025) · Figs. 3f, 2b

Protein design beyond biomedical applications¶

Application example: enzyme design and plastics

Lauko et al. · Computational design of serine hydrolases · Science 2025

Protein design task diagram with inverse-folding highlight and structure-prediction label

Protein design¶

  • Create proteins with specified properties.
  • Redesign existing proteins to improve activity, stability, or specificity.
  • Design can operate on sequence, structure, or both.

Inverse-folding backbone and sequence illustration

A structure needs a sequence¶

  • A desired function suggests structural constraints.
  • A backbone specifies a candidate geometry.
  • We need a sequence that can be encoded in DNA and expressed.

What amino acid sequence will fold to the desired structure?¶

Protein sequence design with Rosetta¶

  • Given a backbone, choose amino acids and side-chain conformations.
  • Rosetta searches using a score function with physical and statistical terms.
  • Packing, sequence search, and backbone relaxation can be combined.

zbc9991916450001.jpg

Kuhlman · Designing protein structures and complexes with Rosetta · JBC (2019)

ProteinMPNN¶

  • MPNN: message-passing neural network.
  • Learns sequence preferences from protein structures.
  • Supports fixed residues, multiple chains, and tied sequence positions.
  • Generates sequences rapidly for downstream screening (faster than classical Rosetta).

Protein design example

Dauparas et al. · ProteinMPNN · Science 2022

The graph-based predecessor¶

Ingraham et al. paper heading

  • Ingraham et al. represent the backbone as a graph of spatial neighbors.
  • An autoregressive decoder ("structured transformer") predicts residues from N to C in this earlier model.
  • Graph attention/message passing makes nearby 3D context available during prediction.

$$p(\mathbf{s}\mid\mathbf{X})=\prod_i p(s_i\mid s_{<i},\mathbf{X})$$

Ingraham et al. · Generative Models for Graph-Based Protein Design · NeurIPS 2019

Message passing¶

Each node combines local information with messages from its neighbors.

Message passing on a chain

PGM slides

Message passing¶

Repeated updates propagate information beyond a node’s immediate neighbors.

Message passing on a graph

Neighbors in space, not just sequence¶

  • Residues far apart in sequence can be close in the folded structure.
  • The structure encoder communicates over a spatial-neighbor graph.

Structure encoder and autoregressive decoder

Ingraham et al. · Generative Models for Graph-Based Protein Design · NeurIPS 2019

ProteinMPNN: encode, then decode¶

ProteinMPNN architecture

  1. Backbone encoder: update residue and pair features.
  2. Sequence decoder: sample residues conditioned on the backbone and already assigned identities.

Autoregressive¶

For a decoding order $\pi$:

$$p(\mathbf{s}\mid\mathbf{X})=\prod_t p(s_{\pi_t}\mid\mathbf{s}_{\pi_{<t}},\mathbf{X}).$$

Dauparas et al. · ProteinMPNN · Science 2022

ProteinMPNN architecture¶

ProteinMPNN architecture

Dauparas et al. · ProteinMPNN · Science 2022

What changed in ProteinMPNN?¶

(Compared to previous MPNN approach)

  • Use distances between N, Cα, C, O, and a virtual Cβ to describe local geometry.
  • Update edge features as well as node features in the encoder.
  • Use random decoding orders rather than always N to C.
  • Evaluate the individual changes and their combination in ablations.
Dauparas et al. · ProteinMPNN · Science 2022

Decoding order and backbone noise¶

Random decoding order¶

  • Allows known sequence positions to provide context for unknown positions.
  • Supports multichain design and tied positions without a privileged N-to-C order.

Backbone noise during training¶

  • Perturb coordinates to improve robustness to structural uncertainty.
Dauparas et al. · ProteinMPNN · Science 2022

Ablations¶

Accuracy: fraction of native amino acids predicted correctly.
Perplexity: $\exp(\text{mean per-residue cross-entropy})$; lower is better.

Bold score indicates training with Gaussian noise added to backbone coordinates

ProteinMPNN ablation table with highlighted row and arrow callouts

Dauparas et al. · ProteinMPNN · Science 2022

(Seeming) Aside: Single sequence structure prediction¶

Question: Why did AlphaFold2 and the original RoseTTAFold lose accuracy when predicting natural proteins from a single sequence?

Structure prediction comparison with CASP14 caption

Redesigned sequences are often easier to predict¶

  • ProteinMPNN designed new sequences for 396 native backbones.

Native versus ProteinMPNN sequence prediction confidence

Dauparas et al. · ProteinMPNN · Science 2022

Rescuing hallucinated designs experimentally¶

  • Structure-prediction-guided hallucination can produce sequences that express poorly.
  • Redesigning the sequences for those backbones improved soluble expression in this test.
  • Circular dichroism and temperature measurements test folding and thermal behavior.

Soluble yield and thermal stability, with slide labels

Dauparas et al. · ProteinMPNN · Science 2022

Does the experimental structure match?¶

An X-ray structure of a redesigned protein closely matches its target backbone (2.35Å RMSD).

Designed structure, crystal structure and electron density

Dauparas et al. · ProteinMPNN · Science 2022

Designing sequences for nanoparticle assemblies¶

  • Preserve the intended backbone and assembly geometry.
  • ProteinMPNN generated 76 sequence designs for 27 tetrahedral backbones.
  • 13 formed assemblies with the expected size in the reported experiments.

Nanoparticle reconstruction and local structural agreement

Dauparas et al. · ProteinMPNN · Science 2022

Rescuing Rosetta¶

  • Scaffold a polyproline motif recognized by a Grb2 SH3 domain.
  • ProteinMPNN rescued binding for designs that had failed with the original sequences.
  • Disruptive mutations test whether the intended motif contributes to binding.

Functional rescue with ProteinMPNN-designed sequences

Dauparas et al. · ProteinMPNN · Science 2022

ProteinMPNN: what it contributes¶

  • Rapid sequence proposals for monomers, assemblies, and motif-containing proteins.
  • Learns sequence compatibility with a backbone from structural data.
  • Reported example: 1.2s vs 258.8s for a 100-residue design on one CPU, compared with classic Rosetta protocol.
Dauparas et al. · ProteinMPNN · Science 2022

Protein design task diagram with structure-generation highlight

RFdiffusion overview¶

  • Generate new protein backbone structures by denoising.
  • Condition generation on motifs, target surfaces, or symmetry.
  • Use ProteinMPNN to design sequences for those backbones.
Watson et al. · RFdiffusion · Nature 2023

RoseTTAFold Science cover

Starting from RoseTTAFold¶

  • RoseTTAFold couples three representations:
    • 1D: sequence/MSA features.
    • 2D: residue-pair features.
    • 3D: residue coordinates.
  • RFdiffusion adapts the structure-prediction network to denoise protein structures.
No description has been provided for this image
Baek et al. · RoseTTAFold · Science 2021 · Watson et al. · RFdiffusion · Nature 2023

Diffusion on protein structures¶

Training: corrupt known structures and learn to recover their clean geometry.
Generation: repeatedly denoise an initially random structure.

Protein diffusion forward and reverse processes

Watson et al. · RFdiffusion · Nature 2023

How the frames are noised and denoised¶

  • Residues are represented by a frame:
    • A translation $\mathbf{x}_i$: the Cα position.
    • A rotation $R_i$: orientation of the N–Cα–C frame.
  • Positions: Gaussian diffusion in 3D.
  • Orientations: rotational diffusion on SO(3).
  • The network predicts the clean structure from a noisy structure and its noise level.
  • Train with unaligned mean-squared error on the reconstructed backbone coordinates.

Protein diffusion schematic

Sampling a new protein backbone¶

  1. Initialize random residue positions and orientations.
  2. Predict a cleaner structure and take a reverse-diffusion step.
  3. Repeat while maintaining any specified constraints.

RFdiffusion denoising trajectory

Watson et al. · RFdiffusion · Nature 2023

RFdiffusion in action¶

Open the video
Watson et al. · RFdiffusion · Nature 2023

RFdiffusion design capabilities

One generator, several design tasks¶

  • Unconditional: create a plausible monomer.
  • Symmetry: build a defined oligomeric assembly.
  • Motif scaffolding: preserve a functional geometry.
  • Binder design: complement a target surface.

ProteinMPNN then supplies sequences.

Watson et al. · RFdiffusion · Nature 2023

Self-consistency of generated monomers¶

Unconditional protein generation

Generate a backbone, design its sequence, then predict its structure with AlphaFold2.

Small design–prediction RMSD supports self-consistency.

Designed versus AF2-predicted structures with RMSD labels and shared legend

Watson et al. · RFdiffusion · Nature 2023

Are the structures different from known ones?¶

  • TM-score measures structural similarity; larger values indicate closer matches.
  • Compare each design with its closest match in the PDB.

Similarity to structures in the PDB

Watson et al. · RFdiffusion · Nature 2023

Symmetry as a generation constraint¶

  • Specify a point-group symmetry and number of subunits.
  • Jointly construct compatible subunits and interfaces.
  • Applications include antigen-display particles and other designed assemblies.

Symmetry-conditioned generation and oligomer example

Symmetry-conditioned generation and oligomer example

Watson et al. · RFdiffusion · Nature 2023

Do the designed oligomers assemble?¶

Compare the design and predicted structure with negative-stain EM class averages and 3D reconstructions.

Oligomer models, class averages and 3D reconstructions

Watson et al. · RFdiffusion · Nature 2023

Motif scaffolding preserves functional geometry¶

  • A motif is a set of residues with a desired spatial arrangement.
  • Hold the motif fixed and generate a protein around it.
  • Examples include catalytic residues or a binding epitope.

Functional motif scaffolding examples

Watson et al. · RFdiffusion · Nature 2023

Testing motif-scaffolding methods¶

Success depends on preserving the motif and generating a compatible overall fold.

Motif scaffolding benchmark with original white masks preserved

Four motif-scaffolding example structures

Watson et al. · RFdiffusion · Nature 2023

Designing a binder to a target surface¶

Binder design conditioning and target complexes

  • Condition on the target structure and selected interface hotspots.
  • Generate a complementary backbone, then its sequence.

Binder design conditioning and target complexes

Watson et al. · RFdiffusion · Nature 2023

Experimental validation¶

Binder structures and binding curves with y-axis label and masking overlays

Watson et al. · RFdiffusion · Nature 2023

A designed interface tested by cryo-EM¶

The HA_20–influenza hemagglutinin complex closely matches the intended binding geometry.

Structural agreement complements the binding assay.

Binder assay, class averages and cryo-EM validation including connector

Watson et al. · RFdiffusion · Nature 2023

RFdiffusion Summary¶

Generates candidate backbones for structural design tasks: unconditional, symmetry, motifs, binders.

Example: generating a binder for the insulin receptor.

Open the video

RFdiffusion3: design in an atomic context¶

  • Adds ligands, nucleic acids, and functional groups.

RFdiffusion3 architecture and conditioning capabilities

RFdiffusion3 architecture and conditioning capabilities

RFdiffusion3 · Atomic functional site scaffolding in biopolymers · Science 2026

LigandMPNN: protein design with atomic context¶

ProteinMPNN designs sequences from a protein backbone, but ignores nonprotein atoms.

LigandMPNN conditions sequence design on the protein backbone and surrounding atomic environment.

No description has been provided for this image
Dauparas et al. · Atomic context-conditioned protein sequence design using LigandMPNN · Nature Methods (2025)

BoltzGen: a broader binder-design workflow¶

Jointly proposes sequence and all-atom structure, then refines and filters candidates.

BoltzGen overview

Stark et al. · BoltzGen: Toward Universal Binder Design · bioRxiv 2025

Chroma: programmable generative protein design¶

  • Integrated design: backbone diffusion + sequence and side-chain generation

chroma_alphabet.jpeg

Ingraham et al. · Illuminating protein space with a programmable generative model · Nature (2023)

Connecting sequence, structure, and function¶

  • Sequence design: choose identities for a structure.
  • Structure generation: choose geometry for a task.
  • Co-design: propose sequence and structure together.

Summary diagram of protein design tasks

Key points¶

  • Protein design starts with a desired function and definable constraints.
  • Antibodies and nanobodies are binding scaffolds with different formats and engineering tradeoffs.
  • ProteinMPNN proposes sequences conditioned on a backbone.
  • RFdiffusion proposes backbones, including designs conditioned on motifs, targets, or symmetry.
  • Structural confidence and self-consistency guide selection.

Journal Club¶

  • Select paper to present today
  • Groups of one or two

Assignment 7¶

  • Due Wednesday, November 30
    • Extra time provided to enable flexiblity, not procrastination

Project¶

  • Proposals due Wednesday, November 11
  • Groups of one to three (but higher expectations for groups of three)
  • Poster presentation Wednesday, December 9

Exam 2¶

  • Wednesday, December 2