[FIXED] Webhook failures handling

Hey there! We’ve been using webhooks over the past few months to send notice of task completions and other fun things to some other systems.

It works! Great!

However, for various reasons from time to time, the webhook will timeout for an hour or two (system maintenance at the receiving end, etc), and once the webhook fails a certain number of times it just completely deactivates itself. No exponential backoff, no “try again later” logic – just turns itself off.

This wouldn’t be so bad if we at least were made aware that webhook failed, but often the only way we know is if things stop syncing, and we use Postman to get all webhooks from Fibery and search for the “failed” status one.

We then have to delete it and recreate it.

Any way to expose webhook failures in a more visible way, or to add some exponential backoff logic to them?

1 Like

Hello.

At the moment we retry 5 times with exponential back off with formula
Math.pow(Math.E, retry + 1) * 1000

This is indeed low time, just several minutes on last retry :thinking: .

I will increase retry count to 10, which will lead to 3.5 hour total delay before disabling a webhook.

Also I’ll make a change, that will send fibery notification to all workspace admins when webhook got disabled due to subsequent failures.

1 Like

This is incredible, and this is why I love this software so much. Awesome solution. Thanks for digging into this! :partying_face::partying_face:

2 Likes

fixed

2 Likes