Question 1

What is Soumil Shah's expertise in data lakehouse architecture?

Accepted Answer

Soumil Shah is an AWS Data Engineer and Lakehouse Architect with 6+ years of experience building production data lakehouses using Apache Hudi, Apache Iceberg, and Delta Lake on AWS. He specializes in medallion architecture (bronze/silver/gold), CDC ingestion, ACID transactions on data lakes, and open table format migration strategies.

Question 2

What AWS data engineering services does Soumil Shah work with?

Accepted Answer

Soumil Shah has deep expertise across the AWS data stack including AWS Glue (ETL), Amazon S3 (storage), Amazon Athena (query), Amazon EMR (Spark), AWS Lambda (serverless), AWS Step Functions (orchestration), Amazon Kinesis (streaming), Amazon DynamoDB, and Amazon Bedrock (generative AI). He builds end-to-end data pipelines and lakehouse platforms on these services.

Question 3

How does Soumil Shah use AI and generative AI in data engineering?

Accepted Answer

Soumil Shah integrates AI/ML into data engineering workflows including building LLM-powered data pipelines, leveraging Amazon Bedrock and Claude AI for intelligent data processing, and designing agentic AI architectures. He holds certifications in Claude AI from Anthropic and creates educational content on AI-augmented data platforms.

Question 4

Where can I find Soumil Shah's data engineering tutorials?

Accepted Answer

Soumil Shah publishes data engineering tutorials on his YouTube channel (46K+ subscribers) covering Apache Hudi, Iceberg, Spark, AWS, and AI topics. He also writes on Medium (@shahsoumil519) and LinkedIn with 600+ technical articles. Visit soumilshah.com/articles for a curated collection.

Certificates & Achievements

The Complete Python 3 Course: Go from Beginner to Advanced!

The Complete SQL Bootcamp

Python and Flask Bootcamp: Create Websites using Flask!

Introduction to Databases and SQL Querying

Deep Learning: An Introduction

Learn Python Programming Masterclass

Complete Guide to TensorFlow for Deep Learning with Python

AWS - Mastering Boto3 & Lambda Functions Using Python

Python for Data Science and Machine Learning Bootcamp

C# Intermediate: Classes, Interfaces and OOP

Beginning C++ Programming - From Beginner to Beyond

Python for Data Science and Machine Learning Bootcamp

Complete Guide to TensorFlow for Deep Learning with Python

Learning Terraform

Apache Kafka Essential Training: Getting Started

Amazon Web Services: Data Analytics

Advanced Design Patterns: Design Principles

Advanced Python

Python Parallel and Concurrent Programming Part 2

Elasticsearch Essential Training

API Testing Foundations

Building RESTful Web APIs with Django

Agile Software Development: Clean Coding Practices

Python: Advanced Design Patterns

Apache PySpark by Example

Python: XML, JSON, and the Web

jQuery Essential Training

JavaScript Essential Training (2017)

Bootstrap 4 Essential Training

Docker for Data Scientists

Google Universal Analytics Essential Training (2020)

AWS for Developers: Step Functions

AWS for Developers: ECS and Multi-Region Load Balancing

Amazon Web Services: Data Analytics

AWS: Monitoring, Logging, and Remediation

Confidence: How to Overcome Self-Doubt Insecurity, and Fears

Be the Manager People Won't Leave

Claude Code

The Builder Award — Engineering Person of the Month

Introduction to Claude Cowork

Claude 101

Claude with Amazon Bedrock