Popular repositories Loading

1. jan jan Public

   Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)

   TypeScript 20.9k 1.2k

2. cortex cortex Public

   Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM, ONNX). Powers 👋 Jan

   C++ 1.8k 98

3. awesome-local-ai awesome-local-ai Public

   An awesome repository of local AI tools

   1.1k 87

4. cortex.tensorrt-llm cortex.tensorrt-llm Public

   Forked from NVIDIA/TensorRT-LLM

   Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU accelerated inference on NVIDIA's GPUs.

   C++ 32 2

5. model-converter model-converter Public archive

   Python 19 5

6. docs docs Public

   Jan.ai Website & Documentation

   MDX 16 6