Examples

examples_prompt

Lora

Bias
Tuning

Adapter
Houstbly

Adapter
Preffier

Adapter
Drop

Adapater
Low-Rank

Compactor

Prefix
Tuning

Prompt
Tuning

T5

✅

✅

✅

✅

✅

✅

✅

✅

✅

GPT-2

✅

✅

✅

✅

✅

✅

✅

✅

BART

✅

✅

✅

✅

✅

✅

✅

✅

DistilBERT

✅

✅

✅

✅

✅

✅

✅

✅

RoBERTa

✅

✅

✅

✅

✅

✅

✅

✅

BERT

✅

✅

✅

✅

✅

✅

✅

✅

✅

T5-3b(parallel)

✅

✅

✅

✅

✅

✅

✅

✅

✅

Deberta-v2

✅

✅

✅

✅

✅

✅

✅

CTRL

✅

✅

✅

✅

✅

✅

✅

tutorials