OpenDelta’s documentation!

OpenDelta is a Plug-and-play Library of the parameter-efficient fine-tuning (delta-tuning) technology for pre-trained models.

Essential Advantages:

  • Clean: No need to edit the backbone PTM’s codes.

  • Simple: Migrating from full-model tuning to delta-tuning needs as little as 3 lines of codes.

  • Sustainable: Most evolution in external library doesn’t require a new OpenDelta.

  • Extendable: Various PTMs can share the same delta-tuning codes.

  • Flexible: Able to apply delta-tuning to (almost) any position of the PTMs.

Indices and tables