Posted On: Jun 8, 2020
You can now write the results of an Amazon Redshift query to an external table in Amazon S3 either in text or Apache Parquet formats. The external table metadata will be automatically updated and can be stored in AWS Glue, AWS Lake Formation, or your Hive Metastore data catalog. This enables you to easily share your data in the data lake and have it immediately available for analysis with Amazon Redshift Spectrum and other AWS services such as Amazon Athena, Amazon EMR, and Amazon SageMaker. Amazon Redshift Spectrum enables you to power a lake house architecture to directly query and join data across your data warehouse and data lake.
To start writing to external tables, simply run CREATE EXTERNAL TABLE AS SELECT to write to a new external table, or run INSERT INTO to insert data into an existing external table. This enables you to simplify and accelerate your data processing pipelines using familiar SQL and seamless integration with your existing ETL and BI tools. You can use the PARTITIONED BY option to automatically partition the data and take advantage of partition pruning to improve query performance and minimize cost. For example, you can write your marketing data to your external table and choose to partition it by year, month, and day columns. For more information, refer to the Amazon Redshift documentation for CREATE EXTERNAL TABLE and INSERT.
Amazon Redshift write to external tables feature is supported with Redshift release version 1.0.15582 or later. Refer to the AWS Region Table for Amazon Redshift availability.