LLM (Large Language Model) FineTuning

Official Repo for ICML 2024 paper "Executable Code Actions Elicit Better LLM Agents" by Xingyao Wang, Yangyi Chen, Lifan Yuan, Yizhe Zhang, Yunzhu Li, Hao Peng, Heng Ji.

We jailbreak GPT-3.5 Turbo’s safety guardrails by fine-tuning it on only 10 adversarially designed examples, at a cost of less than $0.20 via OpenAI’s APIs.

npm like package ecosystem for Prompts 🤖

Enhancing Large Vision Language Models with Self-Training on Image Comprehension.

[ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference

The official repo of paper "Self-Control of LLM Behaviors by Compressing Suffix Gradient into Prefix Controller"

Collecting data for Building Lucknow's first LLM

Finetune an LLM to generate SQL from text on Intel GPUs (XPUs) using QLoRA

Finetuning Some Wizard Models With QLoRA

Collection of resources for finetuning Large Language Models (LLMs).

This is a package for generating questions and answers from unstructured data to be used for NLP tasks.

Streamlit application for Reddit posts powered by OpenAI, Pinecone and Langchain

high-efficiency text & file scraper with smart tracking, client/server networking for building language model datasets fast

LLM Finetuning with Axolotl with decent defaults + Optional TrueFoundry Experiment Tracking Extension

中文llama3大模型快速上手,通用中文语言大模型finetune教程,基于Meta-llama3实现。

The project was undertaken as part of the Intel Unnati Industrial Training program for the year 2024. The primary objective of this project aligns with Problem Statement PS-04: Introduction to GenAI LLM Inference on CPUs and subsequent LLM Model Finetuning for the development of a Custom Chatbot.

Comparison of different adaptation methods on PEFT for fine-tuning downstream tasks or benchmarks.

A payload compression toolkit that makes it easy to create ideal data structures for LLMs; from training data to chain payloads.

Our research project for NLP class in University of Ljubljana that I'm one of the contributors.