-
Notifications
You must be signed in to change notification settings - Fork 1.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat: Add max_retries to AzureOpenAIGenerator #7983
feat: Add max_retries to AzureOpenAIGenerator #7983
Conversation
I've signed the CLA. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good, let's just make this one simplification suggested
f315bfa
to
6338aa2
Compare
We need to add reno note @nvzard See https://github.com/deepset-ai/haystack/blob/main/CONTRIBUTING.md for more details |
6338aa2
to
b77ec92
Compare
My bad @vblagoje, I totally forgot about it. |
There are still some failures @nvzard |
Please let's also read the timeout from an env var if not set at init, as we do in |
fbf9409
to
9d52a77
Compare
Good catch @anakin87. I've added it as well. All tests are passing locally now 🤞🏻 |
Pull Request Test Coverage Report for Build 9817242905Details
💛 - Coveralls |
max_retries: if not set is read from the OPENAI_MAX_RETRIES env variable or set to 5. timeout: if not set is read from the OPENAI_TIMEOUT env variable or set to 30. Signed-off-by: Nitanshu Vashistha <[email protected]>
9d52a77
to
1f3dbdc
Compare
Pull Request Test Coverage Report for Build 9828135301Details
💛 - Coveralls |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for this contribution @nvzard
Thanks for your patience and reviews 😄 |
Related Issues
max_retries
andtimeout
params to allAzureOpenAI
classes #7945Proposed Changes:
AzureOpenAIGenerator can be initiated using
max_retries
.How did you test it?
Unit tests
Notes for the reviewer
I thought it'd be a good idea also to return
max_retries
whento_dict
is called since we are doing it fortimeout
as well. Let me know if this is not required.Checklist
fix:
,feat:
,build:
,chore:
,ci:
,docs:
,style:
,refactor:
,perf:
,test:
.