OpenDelta
latest

Getting Started

  • What is Delta-tuning and Why OpenDelta?
  • Installation
  • Quick Start
  • Custom Usage

Advanced Usage

  • AutoDelta Mechanism
  • DeltaCenter
  • Composition of delta models
  • Multitask Modeling using OpenDelta
  • OpenDelta + BMTrain
  • OpenDelta + Huggingface Accelerate
  • Examples

Utilities

  • Visualize the Parameters
  • Inspect the optimizer

Mechanisms

  • Philosophy and Key Features
  • Name-based Addressing
  • Common Structure Mapping

Information

  • Citation
  • Update Logs and Known Issues
  • FAQs

Documentation

  • Base Classes
  • Delta Models
  • Auto Classes
  • Utils
OpenDelta
  • Overview: module code

All modules for which code is available

  • bigmodelvis.visualization
  • opendelta.auto_delta
  • opendelta.basemodel
  • opendelta.delta_configs
  • opendelta.delta_models.adapter
  • opendelta.delta_models.bitfit
  • opendelta.delta_models.compacter
  • opendelta.delta_models.lora
  • opendelta.delta_models.low_rank_adapter
  • opendelta.delta_models.prefix
  • opendelta.delta_models.soft_prompt
  • opendelta.utils.model_md5
  • opendelta.utils.name_based_addressing
  • opendelta.utils.saving_loading_utils
  • opendelta.utils.signature
  • opendelta.utils.structure_mapping

© Copyright 2022, THUNLP OpenDelta Team, Licenced under the Apache License, Version 2.0. Revision a25fb1b2.

Built with Sphinx using a theme provided by Read the Docs.