AWS Task Processor
Serverless Event-Driven Task Processing
A serverless task processing system built with AWS Lambda, SQS, RDS, API Gateway, S3, and CloudFront using Terraform IaC.
Role
Cloud Engineer
Duration
2023
Team
Solo Project
Tech Stack
AWS LambdaSQSRDSAPI GatewayS3CloudFrontTerraformGo
Impact
Results & Metrics
SQS + DLQ
Event-Driven
Asynchronous task pipelines
Lambda
Auto Scaling
Scale to zero and on demand
Terraform
IaC Coverage
Repeatable cloud environments
Problem
Challenges Faced
Decoupled Processing
Needed reliable task submission while keeping processing workloads isolated.
Private Data Storage
RDS had to stay private while Lambdas accessed it securely in a VPC.
Cost Control
Designed for low-cost, development-friendly AWS infrastructure.
Solution
How I Solved Them
SQS + DLQ Pipelines
Buffered tasks with SQS and dead-letter queues for resilient processing.
VPC Lambda Access
Deployed processing Lambdas in private subnets with secure RDS access.
Edge-Delivered UI
Served the React frontend via CloudFront + S3 with API proxying.
Capabilities
Key Features
Task submission REST API
SQS queue decoupling
Lambda-based processing
RDS MySQL persistence
CloudFront + S3 frontend delivery
Dead letter queue handling
CloudWatch monitoring
Terraform infrastructure