PinnedAvoid Observability MELTdown using Metrics, Events, Logs and TracesAt the end of August 2022, I was honoured to represent Habu and attend and talk at the inaugural super{summit} developer conference in…Oct 28, 2022Oct 28, 2022
Event-driven serverless ETL using AWS Lambda, Step Functions, EMR and FargateIn this crisp article, I will show you how to design an end-to-end serverless ETL application that is event-driven and orchestrated using…Mar 6, 2019Mar 6, 2019
Click Stream Processing on Apache Flink using Kafka Source and AWS S3 SinkKafka-Flink-S3 : How-to-guideJan 8, 2019A response icon2Jan 8, 2019A response icon2
Distributed Batch Processing using Apache Flink on AWS EMR YARN ClusterBatch processing using Apache Flink on AWS EMRDec 18, 2018A response icon1Dec 18, 2018A response icon1
AWS EMR Log Aggregation and Visualization using Lambda, Elasticsearch, and KibanaTo me, error analysis is the sweet spot for improvement.Nov 17, 2018A response icon1Nov 17, 2018A response icon1
Part 2: Event-driven serverless monitoring and interactive Slack alertingHow we implemented monitoring and interactive Slack alerting using Lambda, API Gateway and few other AWS servicesNov 6, 2018A response icon1Nov 6, 2018A response icon1
Part 1: Event-driven serverless architecture for supporting EMR Spot Instance Fleet in DataPipelineThis post describes the problem statement, implementation, and the learnings of how we solved an AWS limitation using AWS services.Nov 1, 2018Nov 1, 2018