Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Autoretry process_job for any RequestException #992

Merged
merged 1 commit into from
Nov 1, 2024

Conversation

mvandenburgh
Copy link
Member

@mvandenburgh mvandenburgh commented Nov 1, 2024

@jjnesbitt instead of trying to enumerate all the possible ways requests can fail transiently (such as the new ChunkedEncodingError here), what do you think about just retrying all RequestException exceptions? That's the parent class that all these exceptions inherit from.

The only downside I see is that we may end up retrying legitimate request failures, but in that case it will just retry it 3 times and propagate the exception to Sentry. That seems more reasonable to me, any thoughts?

Copy link
Collaborator

@jjnesbitt jjnesbitt left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this is fine

@mvandenburgh mvandenburgh merged commit 90108f3 into main Nov 1, 2024
15 checks passed
@mvandenburgh mvandenburgh deleted the handle-chunked-encoding-error branch November 1, 2024 15:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants