chatglm 6b finetuning and alpaca finetuning
-
Updated
Mar 9, 2025 - Python
#
adalora
Here are 10 public repositories matching this topic...
deep learning
-
Updated
May 6, 2025 - Python
Elixir port of HuggingFace's PEFT (Parameter-Efficient Fine-Tuning) library. Implements LoRA, AdaLoRA, IA3, prefix tuning, prompt tuning, and 30+ state-of-the-art PEFT methods for efficient neural network adaptation. Built for the BEAM ecosystem with native Nx/Axon integration.
machine-learning elixir deep-learning beam transformers neural-networks adapters lora axon nx fine-tuning peft huggingface prompt-tuning llm prefix-tuning adalora parameter-efficient-fine-tuning ia3 nshkr-ai-infra
-
Updated
Jan 1, 2026 - Jupyter Notebook
Optimizing the Differentiable Search Index (DSI) with data augmentation (Num2Word, Stopwords Removal, POS-MLM) and parameter-efficient fine-tuning (LoRA, QLoRA, AdaLoRA, ConvoLoRA), improving retrieval accuracy and efficiency while reducing memory and computational overhead. Evaluated on the MS MARCO dataset for scalable performance.
-
Updated
Apr 3, 2025 - Jupyter Notebook
LoRA/QLoRA/AdaLoRA/DoRA/VeRA fine-tuning for RAG faithfulness Arabic (XQuAD) & Malay (Belebele) QA with mT5, self-critical sequence training, and independent NLI verification.
lora dora vera arabic-nlp mt5 nli peft malay-nlp self-critical-sequence-training huggingface-transformers low-resource-nlp adalora faithfulness qlora retrieval-augmented-generation parameter-efficient-fine-tuning
-
Updated
Sep 8, 2026 - Python
Add this topic to your repo
To associate your repository with the adalora topic, visit your repo's landing page and select "manage topics."