Skip to content

Issues: ggerganov/llama.cpp

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

306 Open 3,077 Closed
306 Open 3,077 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Bug: Failed to load model bug-unconfirmed critical severity Used to report critical severity bugs in llama.cpp (e.g. Crashing, Corrupted, Dataloss)
#8516 opened Jul 16, 2024 by Fulgurance
Newest apple model unsupported...
#8514 opened Jul 16, 2024 by 0wwafa
Bug: GGML_CUDA_FORCE_CUBLAS cannot be compile for hipblas bug-unconfirmed medium severity Used to report medium severity bugs in llama.cpp (e.g. Malfunctioning Features but still useable)
#8513 opened Jul 16, 2024 by sorasoras
1
Llama.cpp release notes lacking descriptions in the github.com page bug-unconfirmed low severity Used to report low severity bugs in llama.cpp (e.g. cosmetic issues, non critical UI glitches)
#8509 opened Jul 16, 2024 by MathiasSchindler
Run Llama.cpp in silent mode
#8507 opened Jul 16, 2024 by MathiasSchindler
Bug: ROCm CUDA error bug-unconfirmed medium severity Used to report medium severity bugs in llama.cpp (e.g. Malfunctioning Features but still useable)
#8504 opened Jul 16, 2024 by m828
1
Bug: Weird output from llama-speculative bug-unconfirmed medium severity Used to report medium severity bugs in llama.cpp (e.g. Malfunctioning Features but still useable)
#8499 opened Jul 16, 2024 by bong-furiosa
6
Bug: In a small n_ctx_slot, the llama.cpp begins gibberish bug-unconfirmed high severity Used to report high severity bugs in llama.cpp (Malfunctioning hinder important workflow)
#8498 opened Jul 16, 2024 by 1cekrim
1
1
Bug: GGML_HIP_UMA causes consistency errors bug-unconfirmed medium severity Used to report medium severity bugs in llama.cpp (e.g. Malfunctioning Features but still useable)
#8496 opened Jul 15, 2024 by jeroen-mostert
Bug: MESA: error: ../src/intel/vulkan/anv_device.c:4237: VK_ERROR_OUT_OF_DEVICE_MEMORY bug-unconfirmed low severity Used to report low severity bugs in llama.cpp (e.g. cosmetic issues, non critical UI glitches)
#8492 opened Jul 15, 2024 by yli147
4
Bug: gemma2 perplexity pending forever bug-unconfirmed medium severity Used to report medium severity bugs in llama.cpp (e.g. Malfunctioning Features but still useable)
#8490 opened Jul 15, 2024 by StatPan
Bug - Can't build vulkan backend on RISC-V platform anymore bug-unconfirmed medium severity Used to report medium severity bugs in llama.cpp (e.g. Malfunctioning Features but still useable)
#8488 opened Jul 15, 2024 by yli147
5
Feature Request: Hope to support Qwen VL enhancement New feature or request
#8487 opened Jul 15, 2024 by nne998
4 tasks done
Feature Request: T-MAC: CPU Renaissance via Table Lookup for Low-Bit LLM Deployment on Edge enhancement New feature or request
#8485 opened Jul 15, 2024 by sorasoras
4 tasks done
3
Bug: RuntimeError: Internal: could not parse ModelProto from ../llama3/Meta-Llama-3-8B-Instruct/tokenizer.model bug-unconfirmed low severity Used to report low severity bugs in llama.cpp (e.g. cosmetic issues, non critical UI glitches)
#8484 opened Jul 15, 2024 by jie80219
Feature Request: Improve Gemma v2 model performance on Vulkan backend enhancement New feature or request
#8476 opened Jul 14, 2024 by lin72h
4 tasks done
llama-cli chat templates ignored?
#8469 opened Jul 13, 2024 by 0wwafa
2
glm-4-9b-chat-1m mopdel issue: wrong shape
#8467 opened Jul 13, 2024 by 0wwafa
tiktoken package missing from requirements
#8466 opened Jul 13, 2024 by 0wwafa
1
instruct models don't work with latest llama cppBug: bug-unconfirmed medium severity Used to report medium severity bugs in llama.cpp (e.g. Malfunctioning Features but still useable)
#8463 opened Jul 12, 2024 by joshknnd1982
5
Bug: mmproj from LLaVA 1.6 (spatial_unpad) seems to be broken bug-unconfirmed medium severity Used to report medium severity bugs in llama.cpp (e.g. Malfunctioning Features but still useable)
#8457 opened Jul 12, 2024 by MeemeeLab
Bug: llama.cpp with Vulkan not running on Snapdragon X + Windows (Copilot+PCs) bug-unconfirmed low severity Used to report low severity bugs in llama.cpp (e.g. cosmetic issues, non critical UI glitches)
#8455 opened Jul 12, 2024 by AndreasKunar
3
Feature Request: Drop dependency on cublas library on build / TinyBLAS support enhancement New feature or request
#8452 opened Jul 12, 2024 by amakropoulos
4 tasks done
5
Unable to convert a fireworks ai model to GGUF with gguf-my-repo bug-unconfirmed medium severity Used to report medium severity bugs in llama.cpp (e.g. Malfunctioning Features but still useable)
#8451 opened Jul 12, 2024 by markat1
2
Bug: ggml-aarch64.c does not compile on Windows ARM64 with MSVC bug-unconfirmed medium severity Used to report medium severity bugs in llama.cpp (e.g. Malfunctioning Features but still useable)
#8446 opened Jul 12, 2024 by AndreasKunar
8
ProTip! Find all open issues with in progress development work with linked:pr.