Managing Message Queues
Generally emails are directly delivered to the destination server. However, if the delivery attempt to the destination server is returning a temporary failure, all email sent to known valid recipients are queued locally on the filtering servers for delivery retry. Emails which have been permanently rejected by the destination server with a 5xx error code, will NOT be queued and are rejected by the systems. If the destination mailserver acts as catch-all for the domain, no recipients will be cached and therefore email will only be queued if the valid recipients have been explicitly set as Local Recipient in the SpamExperts control panel. In case a recipient is not cached as valid, the message will be temporarily rejected and queued at the sender instead of on the filtering server (unless Local Recipients is enabled).
Queue Access
You can access the email queue from the webinterface, from which you can also manually retry delivery of a queued message.
Automatic Retry Schedule
Messages queued for known valid recipients because of temporary problems with the destination route (for example network problems) are automatically retried for delivery at the following approximate intervals:
- During the first 2 hours, delivery is retried at a fixed interval of 15 minutes.
- During the next 14 hours, delivery is retried at a variable interval, starting at 15 minutes and multiplying by 1.5 with each attempt (e.g. after 15 minutes, then 22.5 minutes, then 34 minutes, and so on).
- From 16 hours since the initial failure, until 4 days have passed, delivery is retried at a fixed interval of every 6 hours.
- After 4 days we generate a bounce to the sender. If the bounce cannot be delivered immediately, it will be frozen. After this time, delivery of the message will have permanently failed. Optionally via the Software API the 4 days can be overruled to a longer (or shorter) period.
When a message is frozen, (when a message can neither be delivered to its recipients nor returned to its sender) no more automatic delivery attempts are made. A super administrator can “thaw” ( force retry) such messages when the problem has been corrected.
SpamExperts caches valid recipients up to 4 days. When such entry has expired, SpamExperts will not queue email for such recipients and instead temporarily reject the message so it's queued on the sending server. The sending server in such case will automaticallty retry delivery. When using the "Local Recipients" feature, no caching is involved and SpamExperts continues to accept and queue the emails for all specified recipients.
Messages Queued
The SMTP RFC 5321 specifies a sending server must queue messages which cannot be directly delivered because of a temporary failure at the receiving end. Therefore in case of temporary issues with the email infrastructure, emails will not be bounced immediately but are instead queued on the sending server(s) and automatically retried for delivery. In case of downtime of the destination mailserver, messages are only accepted for delivery by the filtercluster if the recipient is known to be valid. Valid destination recipients are cached up to 96 hours.
When a destination server cannot be reached for 4 days, all messages will be bounced after 4 days and no new email will be accepted/queued until the destination server is back online. This 4 day period is conform the SMTP RFC. The reason it's not longer than 4 days, is because it's important for the sender to be aware that delivery of their message has been failing for 4 days so they can try and contact the recipient in another way.
Your own fallback server(s)
Please note that when you specify multiple destination routes, the SpamExperts system will assume you run your own fallback system. If the specified fallback server is not responding to recipient callouts, there will be no database built up of valid recipients internally. We recommend not to specify any fallback server(s) unless you've specifically designed your infrastructure to handle outages of the main destination server.
Troubleshooting messages in the queue
If there are messages stored in the queue there will always be a (temporary) error when delivering to the destination server. To investigate the issue:
- Verify you have set a correct destination route (also ensure there are not multiple destination routes specified, normally there should just be 1 route)
- Check the logs on your destination server to investigate why it's not accepting the delivery attempts
- Run a telnet test to check the response of your destination mailserver
- If after following these steps you still have an issue, please contact SpamExperts support providing a sample sender/recipient/date to investigate
Replying to messages in the queue
Whilst a message is queued you can reply to it directly from the webinterface by using the "Reply" option from the message options:
The resulting page allows you to immediately respond to the email, ensuring you can continue to manage your email whilst your destination mailserver environment is unavailable.
