🤘 TT-NN operator library, and TT-Metalium low level kernel programming model.
-
Updated
Jul 17, 2024 - C++
🤘 TT-NN operator library, and TT-Metalium low level kernel programming model.
Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.
The simplest way to serve AI/ML models in production
A friendly library for parsing HTTP request arguments, with built-in support for popular web frameworks, including Flask, Django, Bottle, Tornado, Pyramid, webapp2, Falcon, and aiohttp.
Large Language Model Text Generation Inference
This is the official PyTorch implementation of "LLM-QBench: A Benchmark Towards the Best Practice for Post-training Quantization of Large Language Models"
A simple, easy-to-use framework for HuggingFace and OpenAI text-generation models.
中文nlp解决方案(大模型、数据、模型、训练、推理)
A simple Falcon module for Cross-Origin Resource Sharing (CORS)
High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
A high-performance web server for Ruby, supporting HTTP/1, HTTP/2 and TLS.
Bouncy Castle adoption to wan24-Crypto
TQ42 Cryptography is a comprehensive suite of quantum-resistant and asymmetric post-quantum encryption algorithms and key management functions offered under the open source AGPLv3 license and available under a Commercial license from Terra Quantum.
🦙 Integrating LLMs into structured NLP pipelines
CryptGuard CLI is a command-line tool for cryptographic operations, including key generation, signing, verification, encryption, and decryption using various algorithms.
Add a description, image, and links to the falcon topic page so that developers can more easily learn about it.
To associate your repository with the falcon topic, visit your repo's landing page and select "manage topics."