-
Notifications
You must be signed in to change notification settings - Fork 81
Issues: huggingface/optimum-nvidia
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
Expected all tensors to be on the same device, but found at least two devices, cpu and cuda:0!
#141
opened Jun 29, 2024 by
d142796
No engine file found for LLama 3 and Cuda API error with LLama 2 with use_fp8
#128
opened May 14, 2024 by
PhilSapiens
Is there support for StoppingCriteria?
enhancement
New feature or request
#123
opened Apr 26, 2024 by
RomanKoshkin
FileNotFoundError: [Errno 2] No such file or directory: 'trtllm-build'
#116
opened Apr 15, 2024 by
Quang-elec44
Incorrect tensorrt_llm config class initialization
bug
Something isn't working
#90
opened Mar 7, 2024 by
Wojx
How do you use the library in your scripts after pulling and running the Docker image?
#72
opened Feb 15, 2024 by
jddunn
Previous Next
ProTip!
Find all open issues with in progress development work with linked:pr.