brycewang-stanford/domain-adaptation-papers-guide

Domain Adaptation Papers Guide

Overview

Domain adaptation addresses the problem of training models on one data distribution (source domain) and deploying them on a different distribution (target domain). This curated collection covers the full spectrum — from unsupervised domain adaptation (UDA) and domain generalization to partial, open-set, and source-free adaptation. Organized by methodology and application area with regularly updated paper lists.

Taxonomy of Methods

Domain Adaptation
├── Unsupervised DA (UDA)
│   ├── Discrepancy-based (MMD, CORAL, CDD)
│   ├── Adversarial-based (DANN, ADDA, CDAN)
│   ├── Reconstruction-based (DRCN, DSN)
│   └── Self-training (SHOT, CBST)
├── Semi-supervised DA
├── Source-free DA (no source data at adaptation time)
├── Partial DA (target has subset of source classes)
├── Open-set DA (target has unknown classes)
├── Universal DA (no prior on label set relationship)
├── Multi-source DA
├── Domain Generalization (no target data at all)
└── Test-time Adaptation (adapt at inference)

Key Methods by Era

Classical Methods

| Method | Year | Approach | Key Idea | |--------|------|----------|----------| | TCA | 2011 | Kernel | Transfer Component Analysis | | GFK | 2012 | Subspace | Geodesic Flow Kernel | | SA | 2013 | Subspace | Subspace Alignment | | DAN | 2015 | MMD | Deep Adaptation Networks | | DANN | 2016 | Adversarial | Domain-Adversarial Neural Networks | | ADDA | 2017 | Adversarial | Adversarial Discriminative DA | | CORAL | 2016 | Statistics | Correlation Alignment |

Modern Methods

| Method | Year | Approach | Key Idea | |--------|------|----------|----------| | CDAN | 2018 | Adversarial | Conditional adversarial + entropy | | MCD | 2018 | Discrepancy | Maximum Classifier Discrepancy | | SHOT | 2020 | Source-free | Self-supervised pseudo-labeling | | TENT | 2021 | Test-time | Entropy minimization at test time | | DAFormer | 2022 | Transformer | DA for semantic segmentation | | PADCLIP | 2023 | Vision-language | CLIP-based domain adaptation |

Paper Tracking

import arxiv

def find_da_papers(subtopic="unsupervised", days=30):
    """Find recent domain adaptation papers on arXiv."""
    queries = {
        "unsupervised": "abs:unsupervised domain adaptation",
        "source_free": "abs:source-free domain adaptation",
        "generalization": "abs:domain generalization",
        "test_time": "abs:test-time adaptation OR test-time training",
    }

    search = arxiv.Search(
        query=queries.get(subtopic, queries["unsupervised"]),
        max_results=30,
        sort_by=arxiv.SortCriterion.SubmittedDate,
    )

    for result in search.results():
        print(f"[{result.published.strftime('%Y-%m-%d')}] "
              f"{result.title}")
        print(f"  {result.entry_id}")

find_da_papers("source_free")

Benchmark Datasets

# Standard DA benchmarks
benchmarks = {
    "Office-31": {
        "domains": ["Amazon", "DSLR", "Webcam"],
        "classes": 31,
        "task": "Object recognition",
    },
    "Office-Home": {
        "domains": ["Art", "Clipart", "Product", "Real World"],
        "classes": 65,
        "task": "Object recognition",
    },
    "VisDA-2017": {
        "domains": ["Synthetic", "Real"],
        "classes": 12,
        "task": "Large-scale sim-to-real",
    },
    "DomainNet": {
        "domains": ["Clipart", "Infograph", "Painting",
                     "Quickdraw", "Real", "Sketch"],
        "classes": 345,
        "task": "Large-scale multi-domain",
    },
    "PACS": {
        "domains": ["Photo", "Art", "Cartoon", "Sketch"],
        "classes": 7,
        "task": "Domain generalization",
    },
}

for name, info in benchmarks.items():
    print(f"\n{name}: {info['classes']} classes, "
          f"{len(info['domains'])} domains")
    print(f"  Domains: {', '.join(info['domains'])}")

Application Areas

| Application | Source → Target Example | |-------------|----------------------| | Medical imaging | Hospital A → Hospital B scanners | | Autonomous driving | Simulation → Real world | | Remote sensing | Region A → Region B satellite | | NLP | News text → Social media | | Speech | Studio → Noisy environments | | Robotics | Sim → Real manipulation |

Reading Roadmap

### Beginner Path
1. "A Survey on Transfer Learning" (Pan & Yang, 2010)
2. "Domain Adaptation for Object Recognition" (Saenko et al., 2010)
3. "Deep Domain Confusion" (Tzeng et al., 2014)
4. DANN paper (Ganin et al., 2016)

### Intermediate Path
5. CDAN (Long et al., 2018)
6. MCD (Saito et al., 2018)
7. "Moment Matching for Multi-Source DA" (Peng et al., 2019)

### Advanced Path
8. SHOT (Liang et al., 2020) — source-free
9. TENT (Wang et al., 2021) — test-time
10. "Benchmarking DA on Language" (Ramponi & Plank, 2020)

Use Cases

1. Literature survey: Map the DA research landscape
2. Method selection: Choose appropriate DA technique for your task
3. Benchmark comparison: Compare methods on standard datasets
4. Research gaps: Identify under-explored DA settings
5. Course material: Teach transfer learning and DA

References

• awesome-domain-adaptation
• Transfer Learning Library
• DomainBed