More Gmail Integration sync frequency options please!

My Gmail integration disconnects semi-frequenly, due to rate limiting – usually around every week or two it will fail and stop syncing. I’ve talked about this in the past in these forums, but I know it’s a very specific area that’s hard to diagnose.

If I set the sync frequency to an hour, it stays connected reliably. However if I set it to 5 min (the next smallest option!), we see the disconnections as stated above.

Could we simply add another option between 1 hour and 5 minutes? Even 10 minutes would be a godsend – It would allow us to have regular updates but would halve the amount Gmail API calls and hopefully prevent it from overrunning limits.

1 Like

I don’t know how busy your Gmail account is, but have you tried turning on the “Receive instant data updates using webhook” integration feature? If the account is not too busy, this may work.

This should be default option in fact, since it provides instant updates without sync. So you can have like Daily think and still have all updates

1 Like

Yes, webhooks is already turned on, but thank you for that recommendation - it certainly seems to be a quicker update process.

My Gmail sync is only checking two folders, so I’m not sure why it would EVER disconnect (there’s maybe 3 or 4 things amongst those folders per day). Yet, we still have to reconnect a couple of times per month.

I also dislike that after a rate limiting error, it just never turns back on again until manually sync’d. I wish it would smartly retry via exponential backoff so that we don’t have to reconnect each time (as usually these errors resolve within a few hours).

1 Like

Good idea, we will discuss it

1 Like

Fixed in last release

LOL WHAT?!??! You actually pushed this feature in less than a day after I posted it?? You guys are incredible!

The core issue of the disconnects is still there (at least for me, maybe no one else! :joy:), but at least this makes the quick fix so much less onerous. Thanks for this.

Customer. For. Life.

2 Likes

I blow the dust off of this old thread to again sadly report that our email integration keeps breaking every few days. Sad stuff.

We have webhook-based syncing turned on.

The error message says that the rate-limit for Gmail was hit. But of course the syncing never retries, stays disabled. We have to manually re-connect / re-sync and then it might be good for another day or two.

I wonder if part of the solution here goes back to my original post in this thread – Perhaps 5min (the shortest option) is too much for Gmail rate limits, but the next available option (1 hour) is far too slow to be of much good.

I’d love to set this to 10 minutes, and cut the rate at which we hit Gmail in half. Data would still appear in Fibery in a reasonable amount of time and hopefully the fragility of the integration would decrease as a result. Thoughts @mdubakov ?

could u please share your workspace name?

could u try again please? reenable webhooks and configure hourly syncs.

If it’s still helpful, our workspace is “ripfish”

Email syncing seems to working this morning, just had a successful one a few minutes ago.

Were you bugfixing, or was there a change to the email sync flow that we need to know about?

Thanks!

We fixed one bug in webhooks implementation that we think was the root cause