After we first launched Amazon Athena, our mission was to make it easy to question information saved in Amazon Easy Storage Service (Amazon S3). Athena prospects discovered it simple to get began and develop analytics on petabyte-scale information lakes, however instructed us they wanted to affix their Amazon S3 information with information saved elsewhere. We added connectors to sources together with Amazon DynamoDB and Amazon Redshift to provide information analysts, information engineers, and information scientists the flexibility to run SQL queries on information saved in databases working on-premises or within the cloud alongside information saved in Amazon S3.
As we speak, hundreds of AWS prospects from practically each trade use Athena federated queries to floor insights and make data-driven choices from siloed enterprise information—utilizing a single AWS service and SQL dialect.
We’re excited to increase your potential to derive insights from extra of your information with right now’s launch of 10 new information supply connectors, which embrace among the most generally used information shops available on the market.
New information sources for Athena
Now you can use Athena to question and floor insights from 10 new information sources:
- SAP HANA (Specific Version)
- Teradata
- Cloudera
- Hortonworks
- Snowflake
- Microsoft SQL Server
- Oracle
- Azure Knowledge Lake Storage (ADLS) Gen2
- Azure Synapse
- Google BigQuery
As we speak’s launch tremendously expands the variety of information sources supported by Athena. For an entire record of supported information sources, see Utilizing Athena Knowledge Supply Connectors.
To coincide with this launch, we enhanced the Athena console that will help you browse obtainable sources and hook up with your information in fewer steps. Now you can search, kind, and filter the obtainable connectors on the console, after which observe the guided setup wizard to connect with your information.
Simply as earlier than, we’ve open-sourced the brand new connectors to ask contributions from the developer neighborhood. For extra info, see Writing a Knowledge Supply Connector Utilizing the Athena Question Federation SDK.
Join the dots in your analytics technique with Athena
With the breadth of information storage choices obtainable right now, it’s frequent for data-driven organizations to decide on a knowledge retailer that meets the necessities of particular use instances and functions. Though this flexibility is good for architects and builders, it could actually add complexity for analysts, information scientists, and information engineers, which prevents them from accessing the info they want. To get round this, many customers resort to workarounds that usually contain studying new programming languages and database ideas or constructing information pipelines to organize the info earlier than it may be analyzed. Athena helps reduce by way of this complexity with help for over 25 information sources and its simple-to-use, pay-as-you-go, serverless design.
With Athena, you should utilize your present SQL data to extract insights from a variety of information sources with out studying a brand new language, creating scripts to extract (and duplicate) information, or managing infrastructure. Athena permits you to do the next:
- Run on-demand evaluation on information unfold throughout a number of cloud suppliers and techniques of report utilizing a single device and single SQL dialect
- Visualize information in enterprise intelligence functions that use Athena to carry out advanced, multi-source joins
- Design self-service extract, remodel, and cargo (ETL) pipelines and event-based information processing workflows with Athena’s integration with AWS Step Capabilities
- Unify numerous information sources to supply wealthy enter options for machine studying mannequin coaching workflows
- Develop user-facing data-as-a-product functions that floor insights throughout information mesh architectures
- Assist analytics use instances whereas your group migrates on-premises sources to the AWS Cloud
Get began with Athena’s information supply connectors
To get began with federated queries for Athena, on the Athena console, select Knowledge Sources within the navigation pane, select a knowledge supply, and observe the guided setup expertise to configure your connector. After the connection is established and the supply is registered with Athena, you may question the info through the Athena console, API, AWS SDK, and suitable third-party functions. To study extra, see Utilizing Amazon Athena Federated Question and Writing Federated Queries.
You can too share a knowledge supply reference to workforce members, permitting them to make use of their very own AWS account to question the info with out establishing a replica connector. To study extra, see Enabling Cross-Account Federated Queries.
Conclusion
We encourage you to guage Athena and federated queries in your subsequent analytics challenge. For assist getting began, we suggest the next assets:
In regards to the Authors
Scott Rigney is a Senior Technical Product Supervisor with Amazon Net Providers (AWS) and works with the Amazon Athena workforce primarily based out of Arlington, Virginia. He’s keen about constructing analytics merchandise that allow enterprises to make data-driven choices.
Jean-Louis Castro-Malaspina is a Senior Product Advertising and marketing Supervisor with Amazon Net Providers (AWS) primarily based in Hershey, Pennsylvania. He enjoys highlighting how prospects use Analytics and Amazon Athena to unlock innovation. Outdoors of labor, Jean-Louis enjoys spending time along with his spouse and daughter, working, and following worldwide soccer.
Suresh Akena is a Principal WW GTM Chief for Amazon Athena. He works with the startups, enterprise and strategic prospects to supply management on massive scale information methods together with migration to AWS platform, huge information and analytics and ML initiatives and assist them to optimize and enhance time to marketplace for information pushed functions when utilizing AWS.
