PinnedSiddharth SharmaAvoid Observability MELTdown using Metrics, Events, Logs and TracesAt the end of August 2022, I was honoured to represent Habu and attend and talk at the inaugural super{summit} developer conference in…9 min read·Oct 28, 2022----
Siddharth SharmaEvent-driven serverless ETL using AWS Lambda, Step Functions, EMR and FargateIn this crisp article, I will show you how to design an end-to-end serverless ETL application that is event-driven and orchestrated using…3 min read·Mar 6, 2019----
Siddharth SharmaClick Stream Processing on Apache Flink using Kafka Source and AWS S3 SinkKafka-Flink-S3 : How-to-guide5 min read·Jan 8, 2019--2--2
Siddharth SharmaDistributed Batch Processing using Apache Flink on AWS EMR YARN ClusterBatch processing using Apache Flink on AWS EMR8 min read·Dec 18, 2018--1--1
Siddharth SharmaAWS EMR Log Aggregation and Visualization using Lambda, Elasticsearch, and KibanaTo me, error analysis is the sweet spot for improvement.4 min read·Nov 17, 2018--1--1
Siddharth SharmaPart 2: Event-driven serverless monitoring and interactive Slack alertingHow we implemented monitoring and interactive Slack alerting using Lambda, API Gateway and few other AWS services5 min read·Nov 6, 2018--1--1
Siddharth SharmaPart 1: Event-driven serverless architecture for supporting EMR Spot Instance Fleet in DataPipelineThis post describes the problem statement, implementation, and the learnings of how we solved an AWS limitation using AWS services.4 min read·Nov 1, 2018----