Category: Amazon Simple Storage Service (S3)

Dremio Cloud is a cloud lakehouse platform on AWS that democratizes data and provides self-service access to data consumers by connecting business intelligence users and analysts directly to data on Amazon S3 and beyond. Learn about the benefits of Dremio Cloud, how to set it up, and start using Dremio’s high-performance lakehouse platform in less than 15 minutes. Review Dremio Cloud’s key features and explore a getting started tutorial with sample datasets.

Amazon Athena is a serverless interactive query service that makes it easy to analyze data in Amazon S3 using standard SQL. Data stored in S3 can span gigabytes to petabytes, however, and querying such massive data poses unique challenges. Follow along as experts from AWS and Innovative Solutions present a use case-based approach to help evaluate these challenges and propose solutions to improve Amazon Athena query performance.

AWS customers running on-premises workloads that leverage Amazon S3 previously needed to set up proxies running on Amazon EC2 to access S3 gateway endpoints. With AWS PrivateLink for Amazon S3, you can provision interface VPC endpoints (interface endpoints) in your virtual private cloud. These endpoints are directly accessible from applications that are on-premises over VPN and AWS Direct Connect, or in a different AWS region over VPC peering.

Verisk provides data analytic insights to customers in insurance, energy and specialized markets, and financial services. Learn how a joint team from AWS and Verisk Argus migrated petabytes of SQL Server data from on-premises to Amazon S3 and Amazon S3 Glacier using AWS Snowball Edge and the Amazon EMR custom Spark ingestion framework. Through this migration framework, Verisk Argus is positioned to save millions of dollars by moving to AWS from their data center.

Many customers operate in a hybrid environment with on-premises infrastructure interconnected with a cloud provider’s infrastructure. This post details how HCLTech used the AWS Centralized Log Management Reference Architecture, and discusses how HCLTech removed the requirements for Amazon Kinesis Data Streams. We also explore how HCLTech used Amazon Kinesis Data Firehose to stream from an Amazon CloudWatch Logs destination in a centralized logging account.

Cloud security is the highest priority at AWS, and we work closely with industry-leading partners such as Trend Micro to build security solutions for customers. In this post, we share a malware scanning solution jointly built by Trend Micro and AWS that detects and automates response to malware payload uploaded to Amazon Simple Storage Service (Amazon S3). The solution uses Trend Micro threat intelligence capabilities and AWS Security Hub.

Bitbucket Pipelines, an integrated CI/CD tool within Bitbucket Cloud that enables developers to execute builds right from within Bitbucket, recently introduced an integration with OpenID Connect and AWS. OpenID Connect is an identity layer above the Oauth 2.0 protocol. With this integration, Bitbucket Pipelines users can authenticate with Amazon S3, Amazon CloudFront, and other AWS resources without having to store secret tokens in Bitbucket.

With the general availability of AWS PrivateLink for Amazon S3 released earlier this year, customers can take advantage of private connectivity between S3 and on-premises resources using private IPs from your virtual network. Learn how to leverage interface VPC endpoints (AWS PrivateLink) for Amazon S3 and its integrations with VMware Cloud on AWS, which brings VMware’s enterprise-class software-defined data center software to the AWS Cloud.

When you use Amazon S3 to store corporate data and host websites, you need additional logging to monitor access to your data and the performance of your applications. An effective logging solution enhances security and improves detection of security incidents. Learn how to use the Elastic Beats to extract logs stored in S3 buckets that can be indexed, analyzed, and visualized with the Elastic Stack. Elastic is an AWS ISV Partner that helps you find information, gain insights, and protect your data when you run on AWS.

Migrating your Veritas protected data, tape backups, and infrastructure to AWS allows for increased flexibility in managing data through its lifecycle. Leveraging this strategy in conjunction with Veritas NetBackup‘s deduplication capabilities allows you to realize cost savings over managing your data on-premises. Veritas on AWS ensures your data is highly available and provides savings over storing data in your data center and/or managing the tape backup archival process.