Data Engineer

We are seeking an experienced AWS Data Engineer to join our dynamic team. This role is crucial for developing and managing scalable data pipelines on the AWS platform, contributing significantly to our AI initiatives. The ideal candidate will possess a deep understanding of cloud-based data engineering and ETL processes, ensuring efficient and robust data solutions.

Key Responsibilities

• Design, build, and maintain scalable data pipelines using AWS services.
• Implement and optimize ETL processes for data ingestion and transformation.
• Develop data solutions utilizing AWS Lambda, Step Functions, Glue, and S3.
• Write and optimize complex PySpark code for data processing.
• Collaborate with cross-functional teams to understand data requirements and deliver high-quality data products.
• Ensure data quality, reliability, and performance across all data pipelines.
• Troubleshoot and resolve issues in data pipelines and related infrastructure.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related field.
• 6+ years of professional experience as an AWS Data Engineer or similar role.
• Strong hands-on experience with AWS services, including Lambda, Step Functions, Glue, and S3.
• Expertise in PySpark for data manipulation and processing.
• Excellent SQL skills with a proven track record of writing complex queries.
• Demonstrated experience in developing and optimizing data pipelines.
• Good understanding of cloud-based data engineering and ETL methodologies.
• Ability to work effectively with immediate or short notice periods.

What We Offer

• Opportunity to work on cutting-edge AI and data engineering projects.
• Collaborative and innovative work environment.
• Professional growth and development opportunities.
• Be part of a team driving the AI revolution.