Add the PVeRA (Probabilistic Vector-based Random Matrix Adaptation) adapter to the PEFT library, exposed as…
Add the PVeRA (Probabilistic Vector-based Random Matrix Adaptation) adapter to the PEFT library, exposed as…: a task in HF ML Tasksmith (Harbor dataset). Algorithm summary. PVeRA extends VeRA by learning a distribution over low-rank adaptations instead of a single deterministic one. - Two global…
The task
**Algorithm summary.** PVeRA extends VeRA by learning a distribution over low-rank adaptations instead of a single deterministic one. - Two global shared random projection matrices are created per adapter name: `pvera_A` of shape `(r*2, max_in_features)` and `pvera_B` of shape `(max_out_features, r)`. "Max" is the…
Part of FineEnvs/HF_ML_Tasksmith.