Detect and handle data skew on AWS Glue
AWS Big Data
MAY 1, 2024
As a result, a developer may observe that their AWS Glue jobs are completing without apparent errors, yet the system could be operating far from its optimal efficiency. Another thing that you can use is the summary metrics for each stage. You can detect data skew with data analysis or by using the Spark UI. Angel Conde Manjon is a Sr.
Let's personalize your content