The broad availability of zero-ETL integrations between Amazon DynamoDB and Amazon Redshift and Amazon Aurora PostgreSQL.
The zero-ETL connections between Amazon Redshift and Amazon Aurora PostgreSQL-Compatible Edition are now widely accessible. Zero-ETL integration easily makes transactional or operational data available in Amazon Redshift by removing the need to build and manage complex data pipelines that perform extract, transform, and load (ETL) operations. In addition to managing source data replication to Amazon Redshift, it updates source data for you to use in analytics and machine learning (ML) skills to extract timely insights and effectively respond to significant, time-sensitive events.
You no longer need to build and manage distinct data pipelines to publish data from numerous relational and non-relational data sources into a single data warehouse in order to do unified analytics on your data from diverse applications thanks to these new zero-ETL connectors.
To build a zero-ETL integration, a source is supplied and Amazon Redshift is the target. As data is replicated from the source to the target data warehouse and made readily available in Amazon Redshift, the integration monitors the pipeline's health.
Aurora PostgreSQL zero-ETL integration with Amazon Redshift
The combination of Amazon Redshift with Amazon Aurora zero-ETL enables near real-time analytics on petabytes of transactional data.Why integrate Amazon Redshift with Aurora zero-ETL?
The integration of Amazon Redshift with Amazon Aurora zero-ETL enables machine learning (ML) and near real-time analytics on petabytes of transactional data. Zero-ETL seamlessly makes transactional data available in Amazon Redshift a few seconds after it was input into Amazon Aurora, removing the need to build and manage complex data pipelines that perform extract, transform, and load (ETL) operations.
Benefits
Data accessibility in nearly real-time
Access transactional data from Aurora in Amazon Redshift in a few seconds to do machine learning and analytics on petabytes of data in near real-time.Easy to use
You may easily analyze your transactional data in nearly real time without having to build and manage ETL pipelines to transmit it to analytics platforms.Seamless data integration
Combine several tables from various Aurora database clusters and replicate your data to a single Amazon Redshift data warehouse to provide unified analytics across multiple apps and data sources.Lack of infrastructure management
Analyzing transactional data in near real-time without having to worry about infrastructure management is possible with Amazon Redshift Serverless and Amazon Aurora Serverless v2.Use cases
Near-real-time operational analytics
Utilize Amazon Redshift analytics and machine learning capabilities to draw conclusions from transactional and other data in nearly real-time in order to react to significant, time-sensitive events. Near real-time analytics can help you receive more accurate and timely insights for use cases including fraud detection, data quality monitoring, content targeting, improved gaming experiences, and customer behavior research.Comprehensive analytics
The Aurora zero-ETL connector allows you to use Amazon Redshift's capabilities to examine petabytes of your transactional data that have been pooled across several Aurora database clusters. Amazon Redshift offers a wide range of analytical capabilities, such as materialized views, integrated machine learning, data sharing, and federated access to many data stores and data lakes. The seamless integration of Amazon Redshift ML into Amazon SageMaker allows you to create billions of predictions with just basic SQL queries.Reduce the operating burden
Moving data from a transactional database into a central data warehouse often requires the development, management, and operation of a complex data pipeline ETL system. With a zero-ETL integration, moving your Aurora database's schema, existing data, and data updates to a new or existing Amazon Redshift cluster is simple. Zero-ETL integration eliminates the need for complicated data pipeline management.How to get started
When you create a zero-ETL interface between Aurora and Redshift, you provide an Aurora DB cluster as the data source and an Amazon Redshift data warehouse as the target. The integration replicates data from the source database into the target data warehouse. The data is available in Amazon Redshift in a matter of seconds, allowing data analysts to begin using the platform's analytics and machine learning capabilities.The price
Through AWS, Aurora zero-ETL connection with Amazon Redshift is provided at no cost. A zero-ETL integration uses pre-existing, paid resources from Amazon Redshift and Aurora to create and process the change data. These resources might include:- More I/O and storage are used when change data capture is enabled.
- The snapshot export fee is for the initial data export to seed your Amazon Redshift databases.
- Additional Amazon Redshift storage to replicate data
- Additional Amazon Redshift compute for processing data duplication
- Fees associated with cross-AZ data transfers between sources and destinations.
0 Comments