PinnedAvoid Observability MELTdown using Metrics, Events, Logs and TracesAt the end of August 2022, I was honoured to represent Habu and attend and talk at the inaugural super{summit} developer conference in…Oct 28, 2022Oct 28, 2022
Event-driven serverless ETL using AWS Lambda, Step Functions, EMR and FargateIn this crisp article, I will show you how to design an end-to-end serverless ETL application that is event-driven and orchestrated using…Mar 6, 2019Mar 6, 2019
Click Stream Processing on Apache Flink using Kafka Source and AWS S3 SinkKafka-Flink-S3 : How-to-guideJan 8, 20192Jan 8, 20192
Distributed Batch Processing using Apache Flink on AWS EMR YARN ClusterBatch processing using Apache Flink on AWS EMRDec 18, 20181Dec 18, 20181
AWS EMR Log Aggregation and Visualization using Lambda, Elasticsearch, and KibanaTo me, error analysis is the sweet spot for improvement.Nov 17, 20181Nov 17, 20181
Part 2: Event-driven serverless monitoring and interactive Slack alertingHow we implemented monitoring and interactive Slack alerting using Lambda, API Gateway and few other AWS servicesNov 6, 20181Nov 6, 20181
Part 1: Event-driven serverless architecture for supporting EMR Spot Instance Fleet in DataPipelineThis post describes the problem statement, implementation, and the learnings of how we solved an AWS limitation using AWS services.Nov 1, 2018Nov 1, 2018
