AWS Storage Blog

Category: Advanced (300)

Amazon S3 featured image - new

How to develop a user-facing data application with IAM Identity Center and S3 Access Grants (Part 2)

This post is Part 2 of a two-part blog post series that will take you, an application developer, through the process of configuring and developing a data application that authenticates users with Microsoft Entra ID and then uses S3 Access Grants to access data on those users’ behalf. Part 1 of this series gave an […]

Amazon S3 featured image - new

How to develop a user-facing data application with IAM Identity Center and S3 Access Grants (Part 1)

This is Part 1 of a two-part blog series: Configuring the application. Here is Part 2: Developing the application. When we at AWS talk to our customers about their data lakes, they usually describe a desired access pattern in which users and groups from a corporate directory are granted access to datasets in Amazon Simple […]

Amazon S3 featured image - new

Accelerate Amazon S3 throughput with the AWS Common Runtime

Data is at the center of every machine learning pipeline. Whether pre-training foundation models (FMs), fine-tuning FMs with business-specific data, or serving inference queries, every step of the machine learning lifecycle needs low-cost, high-performance data storage to keep compute resources busy and performing useful work. Customers use Amazon Simple Storage Service (Amazon S3) to store training data […]

Amazon S3 featured image - new

Scaling data access with Amazon S3 Access Grants

To adhere to the principle of least privilege, users define granular access to their Amazon Simple Storage Service (Amazon S3) data based on applications, personas, groups or organization units (OUs). This practice helps customers to mitigate the risk of unauthorized access, limiting potential damage in case of a security breach as employees only have access […]

Amazon FSx for Lustre

Use Amazon FSx for Lustre to share Amazon S3 data across accounts

As enterprises evolve their cloud governance practices, multiple teams working in separate accounts may need to share data. One team may oversee an enterprise data lake in one account, while a data science team develops a high-performance computing (HPC) use case in another account. Customers want to take advantage of low-cost object storage and be […]

Simple and comprehensive data protection with Amazon Data Lifecycle Manager

Enterprises often use distinct accounts to group workloads and associated resources used across multiple teams and projects. This helps organizations align ownership, decision making, and costs so that they can be easily managed across internal teams. However, each team in an account may have different requirements and processes when it comes to backing up their […]

Automating application-consistent Amazon EBS Snapshots for MySQL and PostgreSQL

MySQL and PostgreSQL are popular relational database management systems that many organizations use to power web applications, dynamic websites, and embedded systems. For customers self-hosting MySQL and PostgreSQL with AWS, they can use their choice of tools to manage the operating system, database software, patches, data replication, backup, and restoration. As customers back up their […]

Automating application-consistent Amazon EBS Snapshots for Windows applications

Customers have been running Microsoft workloads on AWS for over 16 years. Through conversations with these customers, a common challenge we’ve found is that as they back up their Windows applications to fulfill data protection needs, they often spend significant time and manual effort managing the orchestration of backup workflows. The time- and labor-intensive process […]

Amazon S3 featured image - new

Manage event ordering and duplicate events with Amazon S3 Event Notifications

Customers use data events to build applications to trigger and communicate between decoupled services. An event is a change in state of, or an update to, data. For certain applications, such as batch order processing or content management, customers may need to implement application logic to handle duplicate and out-of-order events. For these use cases, […]

Automate Amazon S3 File Gateway on Amazon EC2 with Terraform by HashiCorp

Infrastructure as Code (IaC) involves managing IT infrastructure through code and automation tools to reduce manual management prone to errors, slow scaling, and overhead. For organizations implementing a hybrid cloud infrastructure, automation can ensure uniformity, scalability, and cost reduction while getting cloud resources provisioned efficiently. Automated provisioning and configuration enable organizations to adapt, innovate, and […]