AWS Messaging & Targeting Blog

Optimizing Email Deliverability: A User-Centric Approach to List Management and Monitoring

Some of the key changes and updates included in this 2024 version are:

  • Guidance on protecting sign-up forms with CAPTCHA to prevent bot and bad actor sign-ups
  • Heightened importance of monitoring bounce rates, complaint rates, and delivery delays due to new requirements from several mailbox providers (MBPs)
  • Introduction to Amazon SES’s Virtual Deliverability Manager (VDM) tool, and a quick explanation how it can help identify deliverability issues
  • Updated recommendations on maintaining an engaged subscriber list which includes proactively removing inactive recipients
  • Emphasis on the industry-wide adoption of mandatory one-click unsubscribe features and the benefits they provide
  • Reinforcement of the need to grow email lists organically and avoid the use of purchased/non-consensual lists

By following the best practices outlined in this updated guide, Amazon SES customers can ensure their email campaigns have the best chance at successfully reaching the inbox. Following these best practices will also help build trust with their subscribers which should result in higher returns on their email marketing investment.

In this blog post, we’ll review the following updated best practices to help you maintain a strong email-sending reputation and ensure high deliverability, including:

  1. Use Confirmed Opt-in (AKA, Double Opt-in )
  2. Carefully Monitor Bounces, Complaints, and Delivery Delays
  3. Maintain an Engaged Subscriber List by Removing Inactive Recipients
  4. Make Unsubscribing Easy to Maintain a Clean, Compliant List
  5. Build Trust by Growing Your List Organically

Use Confirmed Opt-in (AKA, Double Opt-in )

Targeting active and engaged users is one of the most effective ways to maintain a strong sender reputation. This time-tested best practice is known as confirmed opt-in (also known as double opt-in). This process is quick to implement and highly effective. When a user signs up for a newsletter or special offer using their email address via a form on your website, you should verify the legitimacy of the email address by sending a verification email to the provided address and asking the requestor to click a link that confirms their consent to receive your emails. By clicking this link, the email address owner explicitly provides their consent to receiving email notifications. Once the recipient verifies the request, you then add their email address to your active mailing list. Most users are now familiar with this type of verification, and legitimate recipients will have no trouble confirming their interest.

Our guidance regarding the confirmed opt-in best practice has evolved due to the prevalence of online bots and bad actors. To maintain a strong sender reputation, we now recommend protecting your web sign-up forms with a CAPTCHA (or similar mechanism). This helps ensure the requests to join your mailing list come from a real human, not a ‘bot or some form of automation or deception. Only after a requestor proves they are human would you accept their email address and then send the verification email. This additional layer of protection prevents bots and bad actors from signing up users without their consent.

CAPTCHA has become a foundational element of the double opt-in process. Protecting the sign-up process with a CAPTCHA will limit the number of unsolicited confirmation messages sent to users, and subsequently reduce the chances of mailbox providers labeling the confirmation messages as spam. If the confirmation messages are blocked by MBPs, then the double opt-in process simply isn’t viable.

<img src="AWS-CAPTCHA.png" alt="AWS WAF CAPTCHA examples.">

Figure 1: AWS WAF CAPTCHA examples.

By verifying the legitimacy of your email recipients upfront through confirmed opt-in, you will reduce the number of invalid recipient bounces associated with fake emails, typographical errors, and illegitimate sign-ups by bad actors and bots. This is crucial, as these types of invalid addresses can negatively impact your sending reputation.

<img src="ideal-opt-in.png" alt="Figure X: A diagram showing the ideal confirmed opt-in architecture to limit risk of bot abuse.">

Figure 2: A diagram showing the ideal confirmed opt-in architecture to limit risk of bot abuse.

  1. Adding a CAPTCHA on the sign-up web form proves that a human is interacting with the sign-up process.
  2. Ensuring the link is clicked proves that a person or application with access to the mailbox was able to click the link.
  3. Requiring the recipient to enter the correct one-time passcode, commonly referred to as OTP, into the web form proves that the human requesting sign-up is the same as the person confirming the sign-up
  4. Monitoring bounce, complaint, and delivery delay events proves that the email address is valid and that there are not recipients who are marking the confirmation messages as spam.
    • Use a subdomain for sending the confirmation messages to limit reputational impact on deliverability in case there are signs of web form abuse
    • If there are signs of web form abuse, give recipients an easy option to report abuse so that they don’t mark the messages as spam.

Confirmed opt-in ensures you only send to subscribers who have explicitly consented to receive your messages. By honoring their subscription preferences, you further reduce the chances of complaints. Providing recipients with an easy, one-click unsubscribe option is crucial, as it demonstrates your commitment to respecting their communication preferences.

Many successful senders capitalize on the verification window by immediately sending a welcome email. This offers two key benefits:

    1. Boost Engagement: While conveying a warm welcome, the email subtly re-engages the new subscriber, and keeps your brand fresh in their mind.
    2. Double-Duty Verification: These emails often include a call-to-action (CTA) that serves as additional verification and validation of the recipient’s interest in receiving your emails.
    3. Increases Trust in your Brand: By offering an easy way to unsubscribe from the welcome email, it gives recipients confidence that they will be able to unsubscribe at any time.

Carefully Monitor Bounces, Complaints, and Delivery Delays

Update: Monitoring these metrics has become substantially more important due to recent changes by mailbox providers. As of February 2024, Google, Yahoo, Microsoft and other MBPs now require all bulk-senders to keep their spam complaint rates below 0.3%. These MBPs explain that maintaining a low spam complaint rate benefits both senders and recipients by enhancing email deliverability, preserving sender reputation, and fostering a more positive user experience for their in-box subscribers.

To fully understand the latest industry standards and requirements, we recommend:

  • Read the Overview: Get a quick grasp of the key compliance guidelines
  • Watch the Webinar: Dive deeper into the specific details and best practices presented by the AWS and Gmail teams.

Amazon SES provides real-time feedback on bounces, complaints, and delivery delay events through its event publishing feature. This enables you to quickly identify and remove problematic email addresses, ensuring you maintain a clean and healthy subscriber list.

If you receive a hard bounce or a complaint, it’s essential to remove that email address from your list and investigate the root cause. For example, a sudden increase in bounce and/or complaint rates for new subscriptions may indicate an issue with fake sign-ups. In such cases, leveraging confirmed opt-in (the BCP, or best current practice, of list building) can help discourage this problem. By using a separate domain for your signups and OTPs, you can distinguish bounces and complaints from sign-ups and other transactional message types, in comparison to your marketing or promotional messages.. More can be found here.

Amazon SES’s Virtual Deliverability Manager (VDM) is an Amazon SES feature that helps senders identify deliverability trends and potential deliverability issues without the need to build additional dashboards. VDM provides deep insights into your sending data and offers actionable recommendations to improve deliverability. VDM helps monitor bounce rates, complaint rates, and other key performance indicators (KPIs) to support email delivery success metrics. VDM allows senders to explore deliverability issues, including the ability to drill down from account level statistics all the way down to the individual message level. This will help identify problematic emails without needing to sift through all of your deliverability data. Key capabilities include:

  • Bounce Details: Use VDM to identify bounced emails by recipient addresses, timestamps. and SMTP response codes. These are received directly from the recipient mailbox providers. Users can then group emails by bounce type (permanent and transient) and recipient domains to analyze and take correct action before before smaller deliverability events like message delays turn into larger problems like messages being blocked by the MBPs.
  • Complaints: Identify recipients who marked emails as spam so they can be removed from the active mailing list.
    • Note: for metric tracking tied specifically to Gmail recipients, customers should also be monitoring Google Postmaster Tools to track their reputation and keep their spam complaint rates low.
  • Delivery Metrics: Monitor delivery attempts, retries, and success to make informed decisions based on real-time data to continuously improve deliverability.

VDM proactively flags potential problems like bounces and complaints that could harm your sender reputation and delivery rates. By addressing these issues early, you can verify that your emails consistently reach the inbox, instead of the spam folder.

While VDM is a paid service for Amazon SES customers, there is a free tier that provides a flexible way to test out the tool without any expenses or commitments.

To dive deeper into VDM consult these resources:

For additional guidance on SES bounce and complaint monitoring, refer to the following resources:
Amazon SES Documentation:

Maintain an Engaged Subscriber List by Removing Inactive Recipients

As an email marketer, you must operate under the assumption that if a subscriber is not opening your emails, or is no longer engaging with the calls-to-action in your emails, they are no longer interested in the content that you are sending. Subscribers who fall into this category should be periodically removed from your mailing lists to help ensure your subscriber lists are healthy and engaged. Increase campaign success and deliverability by periodically reviewing and updating your subscription lists with this two-pronged approach:

Track Subscriber Engagement with Amazon SES

Amazon SES provides methods to monitor your sending activity using events, metrics, and statistics. These monitoring methods can be used to measure the rates at which your customers engage with the emails you send. For example, you can identify your overall open and click through rates by utilizing SES’ event publishing when using custom email domains that you associate with configuration sets as discussed in the SES documentation.

<img src="SES-event-data-analytics.png" alt="Serverless Architecture to Analyze Amazon SES events">

Figure 3: Serverless Architecture to Analyze Amazon SES events

To track your email sending activities at a granular level, refer to the AWS blog post, Analyzing Amazon SES event data with AWS Analytics Services.

Proactively Remove Non-Engaging Subscribers

Imagine a scenario where a subscriber signs up for your email list but never engages by opening or clicking through your messages. This lack of activity could indicate the subscriber’s loss of interest. To address this, we recommend you set a reasonable timeframe for engagement based on your industry standards (e.g., 6 months of no opens or clicks). However, this timeframe may need to be adjusted depending on how regularly you send emails to your subscribers. For instance, if you send a daily newsletter, a 6-month period of inactivity may be too long before removing the subscriber. Conversely, if you only send monthly updates, a 6-month window may be more appropriate. The key is to find the right balance – remove subscribers who have clearly lost interest, but don’t be too hasty in culling your list if they simply don’t engage as frequently as your regular email cadence. By tailoring the engagement timeframe to your specific email frequency, you can ensure your subscriber list remains active and engaged.

Consider a “Win-back” Email Campaign

Before removing completely inactive subscribers from your list, consider sending them a special “win-back” email. This final attempt to re-engage them can be an effective strategy to win-back valuable subscribers. The win-back email should have a clear and compelling call-to-action, encouraging recipients to re-engage with the messages you are sending to them. This could include updating their preferences or confirming their interest in your messages. By giving these subscribers another chance, you may be able to reactivate a portion of your list and retain those recipients. However, if the win-back email fails to elicit a response, it’s best to remove those addresses from your active mailing list to maintain a healthy, engaged subscriber base.

Even subscribers who originally opted in through a confirmed double opt-in process can become inactive over time. Occasionally these email addresses are abandoned and can be converted into spam traps by the domain owner. Spam traps are email addresses used by organizations to identify senders who may not be following best practices for list building and long-term list hygiene. If you continue to email these inactive addresses, several negative consequences can occur. our domain could be at risk of generating poor reputation at a mailbox provider, or end up on a real-time blocklist, which may impact deliverability to multiple mailbox providers. In some cases, this could result in your Amazon SES service being suspended.

Proactively removing non-engaging subscribers is the only way to avoid these potential pitfalls and maintain a strong sender reputation.

For a deeper dive into the topic, refer to the following resources:

When you proactively remove subscribers who fail to interact with your emails, you are better able to keep your subscriber base fresh and engaged, improving your overall deliverability and campaign success rates. As an added benefit, pruning inactive subscribers reduces your email sending costs, as you’ll only be reaching out to genuinely interested subscribers, improving the return on investment from your email campaigns.

Removing inactive subscribers is a powerful complement to your confirmed opt-in practices, helping you maintain a healthy, high-performing email list.

Make Unsubscribing Easy to Maintain a Clean, Compliant List

Update: Providing recipients with clear, easy-to-use unsubscribe options has become even more crucial due to recent changes by major email providers.

As of February 2024, Google and Yahoo now require all bulk email senders to include a prominent unsubscribe link within their messages. In June 2024 the implementation of one-click unsubscribe headers (as defined by RFC 2369 and RFC 8058) also become mandatory across the industry.

<img src="unsubscribe-flow-gmail-1.png" alt="A diagram of one-click unsubscribe flow.">

Figure 4: A diagram of one-click unsubscribe flow.

The new industry wide bulk sender requirements ultimately benefit both senders and recipients by:

  • Reducing Spam Complaints – Easy unsubscribe options decrease the likelihood of frustrated recipients marking your emails as spam. This helps maintain a positive sender reputation.
  • Improving Sender Reputation – A clean email list with engaged and consented subscribers keeps your sender reputation healthy, ensuring your messages consistently reach the inbox rather than the spam folder.

It is critical you respect your audience’s wishes as they relate to your email sending. When you offer recipients a straightforward, easy unsubscribe path to manage their communication preferences, it will allow you keep your email lists clean and compliant which helps you maintain a strong sender reputation. Many regions, including the US, Canada, and parts of Europe and Asia, have adopted laws requiring senders to provide clear, accessible unsubscribe mechanisms. Adhering to these regulations helps you avoid potential legal issues related to your sending and local messaging laws.

Amazon SES provides a basic, subscription management capability that supports the Bulk Sender Requirements as outlined in the SES documentation. Some SES customers have opted to develop & deploy their own custom, more comprehensive systems, to process end-user unsubscribe requests. For a deeper dive into the topic, refer to the AWS blog post Using one-click unsubscribe with Amazon SES.

Build Trust by Growing Your List Organically

Avoid the Temptation of Shortcuts

It may be tempting to take shortcuts, such as using purchased email lists from brokers. However, these “opt-in” addresses often belong to recipients who signed up for the broker’s list, not yours. Relying on these non-organic lists can lead to disastrous consequences:
  • Spam Complaints: Recipients who never consented to receive your emails are much more likely to mark them as spam, harming your sender reputation.
  • Legal Issues: Many countries, especially with the new <0.3% spam rate requirement, have strict laws prohibiting the use of non-consensual email lists.
  • Unsubscribes and Lost Trust: Sending unwanted emails can result in high unsubscribe rates and damage your brand’s reputation.

Focus on Building Your List Organically

Instead of acquiring lists from brokers, focus on building your email list organically by following the best practices we’ve discussed, such as confirmed opt-in and clear unsubscribe options. This will help you attract and retain engaged subscribers who genuinely want to receive your content, fostering trust and a positive sender-to-recipient relationship.

Respect Individual Preferences

It’s crucial to respect each recipient’s communication preferences, even within your own organization. Just because someone signed up for emails from Brand A doesn’t mean they want to receive messages from Brand B, even if both brands are from the same company. Sending these types of cross-brand unsolicited emails can harm your reputation and lead to spam complaints. To avoid this common pitfall, build separate email lists for each of your brands. This ensures recipients only receive the content they’ve explicitly opted-in for, strengthening their trust and increasing engagement.
The long-term benefits of an organically grown, engaged email list are well documented and include improved deliverability, higher open/click rates and better return on your email marketing investments.

Land in Inboxes, Not Spam Folders: The Power of Streamlined List Management

Throughout this updated guide, we’ve explored five essential best practices for email list management that can help Amazon SES customers maintain a strong sender reputation and ensure high deliverability.

We initially discussed the importance of confirmed opt-in (or double opt-in), and how incorporating CAPTCHA has become a foundational element to protect against bot and bad actor sign-ups. By verifying the legitimacy of your subscribers upfront, you minimize the impact of invalid addresses and reduce the chances of complaints as a result of form abuse.

Next, we emphasized the heightened need to carefully monitor key metrics like bounces, complaints, and delivery delays. We discussed email management tools and features like Amazon SES Virtual Deliverability Manager that can provide critical deliverability insight into your email program. Addressing deliverability issues early is crucial to preserving your sender reputation and keeping your messages flowing to the inbox.

We also covered strategies for maintaining an engaged subscriber list, including proactively removing inactive recipients and considering targeted “winback” campaigns. Keeping your list fresh and responsive pays dividends in the form of better inbox placement and campaign performance.

Making unsubscribing easy for recipients has likewise become an essential practice, not just for compliance but also for building trust and reducing spam complaints. The one-click unsubscribe standards now required by mailbox providers work to the benefit of both senders and recipients.

Lastly, we stressed the importance of organic list growth over shortcuts like purchased email lists. Respecting individual preferences, even within your own brand, helps you attract and retain subscribers who are genuinely interested in your content.

By adhering to these five best practices of email list management, you’ll be able to build and maintain a marketing asset in the form of an email list that will provide you a long-term channel for communicating with your customers and end-users.

If you have any questions or need further guidance, feel free to reach out to us via the SES Forums or in the comments section of this blog post. We’re here to help you navigate the evolving email landscape and unlock the full potential of your Amazon SES investment.

About the Authors

Brett
Brett Ezell is your friendly neighborhood Solutions Architect at AWS, where he specializes in helping customers optimize their SMS and email campaigns using Amazon Pinpoint and Amazon Simple Email Service. As a former US Navy veteran, Brett brings a unique perspective to his work, ensuring customers receive tailored solutions to meet their needs. In his free time, Brett enjoys live music, collecting vinyl, and the challenges of a good workout. And, as a self-proclaimed comic book aficionado, he can often be found combing through his local shop for new books to add to his collection.
Zip
Zip is an Amazon Pinpoint and Amazon Simple Email Service Sr. Specialist Solutions Architect at AWS. Outside of work he enjoys time with his family, cooking, mountain biking and plogging.
Jesse Thompson
Jesse Thompson is an Email Deliverability Manager with the Amazon Simple Email Service team. His background is in enterprise development and operations, with a focus on email abuse mitigation and encouragement of authenticity practices with open standard protocols. Jesse’s favorite activity outside of technology is recreational curling.