Question
A company has a large, unstructured dataset. The dataset includes many duplicate records across several key attributes.
Which solution on AWS will detect duplicates in the dataset with the LEAST code development?
- A. Use Amazon Mechanical Turk jobs to detect duplicates.
- B. Use Amazon QuickSight ML Insights to build a custom deduplication model.
- C. Use Amazon SageMaker Data Wrangler to pre-process and detect duplicates.
- D. Use the AWS Glue FindMatches transform to detect duplicates. Correct
Explanation
The correct answer is D because AWS Glue's FindMatches transform is specifically designed for detecting duplicate records in datasets with minimal code development, aligning with the requirement of least code development. This feature leverages machine learning to identify and group similar records based on specified attributes without needing extensive custom coding or manual intervention.
