Once data is available in Amazon Redshift, businesses can start analyzing it immediately and apply advanced features like data sharing and Amazon Redshift ML to get holistic and predictive insights.Īdditionally, businesses can replicate data from multiple Amazon Aurora database clusters into a single Amazon Redshift instance to derive insights across several applications. With Amazon Aurora zero-ETL integration with Amazon Redshift, transactional data is automatically and continuously replicated seconds after it is written into Amazon Aurora and seamlessly made available in Amazon Redshift. Additionally, it can take days before data is ready for analysis, and intermittent data transfer errors can delay access to time-sensitive insights even further, leading to missed business opportunities. Anyone who has done this type of work knows that the data pipelines can be costly to build and challenging to manage, requiring developers to write custom code and constantly manage the infrastructure to ensure it scales to meet demand.ĪWS noted that some companies maintain entire teams just to facilitate this process. To accomplish this, many businesses use a three-part solution to analyze their transactional data-a relational database to store data, a data warehouse to perform analytics, and a data pipeline to ETL data between the relational database and the data warehouse. Why? Businesses want to better understand core business drivers and develop strategies to increase sales, reduce costs, and gain a competitive advantage. Specifically, AWS noted that the requirement for near real-time insights on transactional data (e.g., purchases, reservations, and financial trades) is growing. One aspect that the new capabilities address is helping businesses get insights in near real time. See also: Amazon Web Services AI and ML Offerings: An Overview Zero-ETL: Running petabyte-scale analytics on transactional data in near real time The new announcements build on the integrations of AWS’s database and analytics portfolio to make it faster, easier, and more cost-effective for businesses to access and analyze data across data stores on AWS. That is why AWS has invested in zero-ETL capabilities like Amazon Aurora ML and Amazon Redshift ML, which let customers take advantage of Amazon SageMaker for ML-powered use cases without moving data between services.Īdditionally, AWS is offering seamless data ingestion from AWS streaming services (e.g., Amazon Kinesis and Amazon MSK) into a wide range of AWS data stores, such as Amazon Simple Storage Service (Amazon S3) and Amazon OpenSearch Service, so businesses can analyze data as soon as it is available. To help, AWS provides a range of purpose-built tools like Amazon Aurora to store transactional data in MySQL and PostgreSQL-compatible relational databases, and Amazon Redshift to run high-performance data warehousing and analytics workloads on petabytes of data.īut to truly maximize the value of data, businesses need these tools to work together seamlessly. When making the announcement, the company noted that many organizations are seeking to get the maximum value out of their vast data resources. “By eliminating ETL and other data movement tasks for our customers, we are freeing them to focus on analyzing data and driving new insights for their business.” “The new capabilities help us move customers toward a zero-ETL future on AWS, reducing the need to manually move or transform data between services,” said Swami Sivasubramanian, vice president of Databases, Analytics, and Machine Learning at AWS. Businesses can also now run Apache Spark applications on Amazon Redshift data using AWS analytics and machine learning (ML) services (e.g., Amazon EMR, AWS Glue, and Amazon SageMaker). Specifically, the new capabilities enable businesses to analyze Amazon Aurora data with Amazon Redshift in near real time, eliminating the need to extract, transform, and load (ETL) data between services. The details: The company announced two new integrations that make it easier for businesses to connect and analyze data across data stores without having to move data between services. In his keynote address this week, AWS CEO Adam Selipsky touted a zero-ETL future, introducing new integration between the Redshift data warehouse service and the Aurora relational database service. Given the dominance of Amazon Web Services in the cloud marketplace, many look to its annual re:Invent conference to get a glimpse of what’s to come. The new capabilities enable businesses to analyze Amazon Aurora data with Amazon Redshift in near real time, eliminating the need to extract, transform, and load (ETL) data between services.
0 Comments
Leave a Reply. |
Details
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |