Question
A company created an extract, transform, and load (ETL) data pipeline in AWS Glue. A data engineer must crawl a table that is in Microsoft SQL Server. The data engineer needs to extract, transform, and load the output of the crawl to an Amazon S3 bucket. The data engineer also must orchestrate the data pipeline.
Which AWS service or feature will meet these requirements MOST cost-effectively?
- A. AWS Step Functions
- B. AWS Glue workflows Correct
- C. AWS Glue Studio
- D. Amazon Managed Workflows for Apache Airflow (Amazon MWAA)
Explanation
AWS Glue workflows are designed to orchestrate ETL jobs, including crawling data sources like Microsoft SQL Server and loading the transformed output into an S3 bucket, making it the most cost-effective option as it integrates seamlessly with other AWS Glue features without additional management overhead.
