AWS Storage Blog
Category: AWS Lambda
Automate the configuration of Amazon S3 Object Lambda to process data as its retrieved
Customers often have multiple applications consuming information from a single dataset stored in Amazon S3, but each application requires different variations to meet their specific needs. For example, one application may require that data be in a redacted CSV format, while another application requires unredacted information. As another example, a stock image website may require […]
Enhanced disaster recovery monitoring with CloudEndure and Amazon CloudWatch
Update (March 4, 2022): Updated Amazon CloudWatch events section to utilize Amazon EventBridge rules instead, allowing you to further customize your serverless event architecture. AWS is also deprecating the requests module in botocore to improve flexibility and performance, and added the ability to use Layers within AWS Lambda to continue using this module. Code has […]
Copying objects greater than 5 GB with Amazon S3 Batch Operations
Update (3/4/2022): Added support for Glacier Instant Retrieval storage class. Update (4/19/2022): Included the copy destination prefix parameter in the Amazon CloudFormation template. Update (10/26/2022):Added performance guidance and best practices, and included template optimized for copying objects restored from archive to a different storage class. A large number of customers store their data in Amazon […]
How to retain resource tags in AWS Backup restore jobs
UPDATE (2/3/2022): Source code extended to support AWS Backup for Amazon S3. UPDATE (6/24/2022): Source code updated to read tags from recovery points inline with changes to AWS Backup boto3 APIs. Update (2/23/2023): Fixed bug in source code related to support for Amazon S3 backup restores. AWS customers use tags to track ownership of resources, […]
Automatically sync files from Amazon WorkDocs to Amazon S3
Today, many customers use Amazon S3 as their primary storage service for various use cases, including data lakes, websites, mobile applications, backup and restore, archive, big data analytics, and more. Versatile, scalable, secure, and highly available worldwide, S3 serves as a cost-effective data storage foundation for countless application architectures. Often, customers want to exchange files and […]
Using Okta as an identity provider with AWS Transfer Family and Amazon EFS
Earlier this year, AWS Transfer Family launched support for Amazon EFS. With this update, you can grant your end users access to files stored in Amazon EFS file systems using any of the protocols supported by Transfer Family. However, if you use Okta as the identity provider, there are additional considerations during setup. For example, […]
Monitoring CloudEndure Disaster Recovery with AWS Lambda
Many organizations must monitor and track their disaster recovery (DR) initiatives to meet business and audit objectives. CloudEndure Disaster Recovery provides fast and reliable recovery of physical, virtual, and cloud-based servers into AWS. It uses email alerts and has a high-level dashboard for monitoring DR jobs. However, many organizations require more robust reporting mechanisms. This […]
Validate your disaster recovery solution and simplify compliance reporting on AWS
Data protection is a key element of compliancy, and organizations must deploy controls to manage the protection of their data and handle operational disruptions. With ongoing configuration and resource changes within IT infrastructure, it can be challenging to continuously and efficiently validate, maintain, and report on compliance to ensure that internal policies and regulatory standards […]
Automate centralized backup at scale across AWS services using AWS Backup
UPDATE 11/11/2021: Updated to improve the user experience in the walkthrough steps. Reliable and consistent backup of cloud data is important to have a secure data archive and restore in the event of data loss. Traditionally, backup administrators used manual backup procedures that were difficult to scale and lowered productivity, with data distributed across multiple […]
How Ryanair used S3 Object Lambda to deliver their COVID-19 wallet
Ryanair Holdings plc, Europe’s largest airline group, is the parent company of Buzz, Lauda, Malta Air and Ryanair. Carrying 149 m guests p.a. (pre Covid-19) on more than 2,500 daily flights from over 80 bases, the Group connects over 225 destinations in 37 countries on a fleet of 450 aircraft, with a further 210 Boeing […]