Pretraining Comparison

Comparing pretraining strategies and their downstream impact on VLM robustness and clinical utility.

  • Token/compute tradeoffs (Chinchilla)
  • Contrastive vs generative pretraining
  • Domain-adaptive pretraining for radiology