Monitoring: AWS Glue
AWS Glue is a fully-managed, serverless data integration service provided by Amazon Web Services (AWS). It makes extracting, transforming, and loading (ETL) data for analytics easy by using popular open-source tools such as Apache Spark and Apache Hive. AWS Glue provides a visual interface to create, run, and monitor ETL jobs. With AWS Glue, users can easily connect to various data sources, including on-premises data stores, Amazon S3, and JDBC-compatible data sources.
Why should you monitor AWS Glue?
Monitoring AWS Glue is crucial to ensure the smooth functioning of data integration processes and to prevent any issues that may arise during ETL jobs. One of the primary reasons for monitoring AWS Glue is to receive timely notifications about failed jobs. AWS Glue performs ETL operations on large volumes of data, and when jobs fail, it can lead to delays in data processing and affect decision-making processes.
How does monitoring AWS Glue work?
Without further ado, marbot monitors AWS Glue. Here is what a notification delivered to a Microsoft Teams channel looks like.
And here is the same alert in Slack.
How do you set up monitoring of AWS Glue?
marbot works with Slack and Microsoft Teams. Please select your platform:
marbot for Slack
marbot works with Slack and Microsoft Teams. Please select your platform and follow the Getting Started guide.
Which events does marbot monitor in detail?
marbot creates EventBridge rules to monitor the following events automatically.
| Event Type | Description |
|---|---|
Glue Job State Change |
Get alerted if a job fails. |
Chatbot for AWS Monitoring
Configure monitoring for Amazon Web Services: CloudWatch, EC2, RDS, EB, Lambda, and more. Receive and manage alerts via Slack. Solve incidents as a team.
