In this article we will understand about the core components of a Data Lake and how AWS Services like S3, AWS Glue, AWS Kinesis Data Streams and Data Analytics, Amazon Athena, Amazon Elasticsearch Service, API Gateway and other such services can be used for data movement, cataloging, processing and visualization…

At work, I run a large Ad Tech Platform that does tons of data processing of several billions of events, product feeds, owned and operated apps and therefore has data of several form that is stored, processed and actioned upon by various teams. We have a strong belief that organizations…

AWS S3 is a block storage space and for our projects, we have been using it both as a data lake as well as a storage space for our structured data. We very recently made use of the AWS S3 Select functionality. S3 Select gave us the ability to query…

I was recently teaching a course on AWS services and an incident with a student group reminded me of the importance of Billing Alarms. …

Once your software application has gone live, its important that it stays up and active monitoring is an integral part of the equation. There is no major need to emphasize on the importance of monitoring systems and therefore, I will directly get to the point of explaining how to use…