Skip to content

Issues: bentoml/OpenLLM

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

24 Open 233 Closed
24 Open 233 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

feat: add gemma2
#1042 opened Jul 15, 2024 by bojiang
How to deploy a model using a single machine multi card approach?
#1026 opened Jun 25, 2024 by ttaop
feat: Include starcoder2
#1025 opened Jun 24, 2024 by kobiche
feat: support enforce_eager option from cli
#1003 opened May 28, 2024 by ADcorpo
feat: Multimodal LLMs?
#972 opened Apr 30, 2024 by Trickster85
1
feat: support LMDeploy backend
#966 opened Apr 25, 2024 by zhyncs
7
feat: any plan to support NPU
#951 opened Apr 13, 2024 by zhangxinyang97
1
FileNotFoundError: [Errno 2] No such file or directory: b'/root/bentoml/models/pt-google--gemma-7b-it/latest'
#937 opened Mar 21, 2024 by PaoloBarba
Deploying LLM in On-Premises Server to Assist Users to Launch Locally in Work Laptop - Web Browser
#934 opened Mar 18, 2024 by sanket038
3
feat: support volta architecture GPUs for the vLLM backend
#930 opened Mar 12, 2024 by K-Mistele
I'm having trouble getting statted with openllm, but I don't want to use conda and I have WSL2
#929 opened Mar 11, 2024 by Lightwave234
1
Runtime error about concurrency
#905 opened Feb 16, 2024 by meanwo
feat: Document usage of request_id
#900 opened Feb 12, 2024 by AlexanderFillbrunn
How to run a docker image on multiple GPUs?
#872 opened Jan 30, 2024 by jeremyadamsfisher
Why change prompt_token_ids depending on encoder_decoder
#851 opened Jan 18, 2024 by meanwo
Add a gradio demo for the python sdk section
#850 opened Jan 16, 2024 by yvrjsharma
Docker image for version 0.4.41 not built
#827 opened Jan 4, 2024 by martinkozle
how to stop generation stream?
#801 opened Dec 19, 2023 by mkaskov
3
Inference Speed comparison
#795 opened Dec 18, 2023 by that-rahul-guy
1
Question about multi-adapter
#656 opened Nov 15, 2023 by KyrieCui
1
feat(client): support wait time for serverless startup time
#607 opened Nov 10, 2023 by aarnphm
feat: support InternLM
#534 opened Oct 28, 2023 by vansin
1
feat: Function calling for OpenAI Compatible Chat Completion API
#452 opened Oct 7, 2023 by XunchaoZ
@XunchaoZ
2
feat: HTTPS support
#449 opened Oct 6, 2023 by ColinLeverger
1
ProTip! Add no:assignee to see everything that’s not assigned.