Lead Data Engineer – AWS

Experience: 10–12 Years
Location: Cairo, Egypt (Onsite)
Employment Type: Full-Time

Position Overview

We are seeking an experienced Lead Data Engineer with deep expertise in AWS to architect, lead, and oversee the development of enterprise-grade, scalable data platforms. The role demands strong technical leadership, solution architecture skills, and ownership of end-to-end data engineering initiatives. The candidate will mentor teams, drive best practices, and ensure secure, high-performance, and cost-optimized data solutions.

Key Responsibilities

• Lead design and implementation of batch and real-time data pipelines on AWS
• Architect and implement ETL/ELT solutions using AWS Glue, Spark on EMR, and other AWS-native services
• Lead workflow orchestration using Apache Airflow (MWAA)
• Architect serverless data processing solutions with AWS Lambda
• Design enterprise-grade data warehousing solutions using Amazon Redshift
• Develop and enforce data storage strategies using Amazon S3 and DynamoDB
• Implement and govern data cataloging, governance, and access control using AWS DataZone
• Establish monitoring, logging, and observability using Amazon CloudWatch
• Drive performance optimization, scalability, and cost efficiency
• Troubleshoot complex data processing and infrastructure issues
• Collaborate with cross-functional teams including Analytics, BI, Data Science, and Business teams
• Provide technical leadership, conduct code reviews, and mentor junior engineers
• Ensure adherence to security, compliance, and data governance standards
• Participate in architecture discussions and contribute to long-term data strategy

Required Skills & Experience

• 10–12 years of experience in Data Engineering or related roles
• 5+ years of hands-on experience designing enterprise-grade AWS solutions
• Expertise with: AWS Glue, Amazon EMR (Spark), AWS Lambda, Apache Airflow (MWAA), Amazon EC2, Amazon CloudWatch, Amazon Redshift, Amazon DynamoDB, AWS DataZone, Amazon S3
• Strong programming skills in Python
• Advanced SQL skills with performance tuning expertise
• Strong understanding of data warehousing, data modeling (Star/Snowflake), ETL/ELT best practices
• Experience designing scalable, distributed data processing systems
• Proven experience in leading teams, mentoring engineers, and making architectural decisions
• Experience working in Agile/Scrum delivery environments

Nice to Have

• AWS Professional Certification (Solutions Architect / Data Analytics Specialty)
• Experience with real-time streaming (Kinesis, Kafka)
• Exposure to metadata management, data lineage, and governance tools
• Expertise in cost optimization strategies in AWS
• Experience working with large-scale enterprise data platforms