Favored Configuration

Generally, the default configurations are already good enough. If you want squeeze the size of delta models further, you can refer to the following papers.

• AdapterDrop: On the Efficiency of Adapters in Transformers

• Sparse Structure Search for Parameter-Efficient Tuning(Delta Tuning)