Sr. Cloud Data Engineer

Astrosofttech is actively seeking a highly skilled and experienced Senior Cloud Data Engineer to join our dynamic team in Hyderabad. This pivotal role is perfect for professionals with a robust background in AWS Data Engineering, Data Lake/Lakehouse solutions, and modern DevOps practices. As a Senior Cloud Data Engineer, you will be instrumental in designing, building, and optimizing scalable cloud-native data platforms, driving critical insights, and fostering a data-driven culture within the organization. We are looking for an immediate joiner who is passionate about leveraging cutting-edge cloud technologies to solve complex data challenges and contribute significantly to our innovative projects.

You will play a crucial role in enhancing our data infrastructure, ensuring high performance, reliability, and security of our data assets. This is an exciting opportunity to work with advanced data technologies and shape the future of our data ecosystem while collaborating with cross-functional teams.

Key Responsibilities

• Design, develop, and maintain robust, scalable, and efficient data pipelines using a variety of AWS services for data ingestion, transformation, and storage.
• Lead the architecture and implementation of Data Lake and Lakehouse solutions to support diverse analytics and machine learning initiatives.
• Utilize and optimize a wide array of AWS data services including S3, Athena, Glue, Redshift, Kinesis, and Lambda for advanced data processing and analysis.
• Implement and manage workflow orchestration using Apache Airflow, ensuring automated and reliable data workflows.
• Apply Medallion Architecture principles to standardize data quality, governance, and accessibility across different data layers.
• Drive the adoption of modern DevOps methodologies, CI/CD pipelines, and Git for seamless and automated deployment of data solutions.
• Collaborate with cross-functional teams, including data scientists and analysts, to understand data requirements and deliver impactful, scalable solutions.
• Monitor and troubleshoot data infrastructure, ensuring optimal performance, cost efficiency, and data integrity.

Requirements

• Bachelor's degree in Computer Science, Information Technology, or a related quantitative field.
• Minimum of 4 years of hands-on, professional experience as a Cloud Data Engineer, specifically within the AWS ecosystem.
• Demonstrated expertise in Python and SQL for data manipulation, scripting, and complex database interactions.
• In-depth knowledge and practical experience with core AWS data services such as S3, Redshift, Glue, Athena, and Lambda.
• Proficiency in big data technologies including PySpark, Spark, Kafka, and Kinesis for processing large datasets.
• Strong understanding and practical experience with DevOps principles, CI/CD automation, and version control using Git.
• Proven ability to design and build highly scalable, reliable, and secure cloud-native data platforms.
• Excellent problem-solving skills, with a proactive approach to identifying and resolving complex data engineering challenges.

What We Offer

• An opportunity to work on challenging and innovative cloud data engineering projects with a leading firm.
• A collaborative, supportive, and intellectually stimulating work environment where your contributions are valued.
• Exposure to cutting-edge cloud technologies and continuous learning opportunities to advance your career.
• A competitive compensation package commensurate with your experience and skills.
• Defined shift timings (12:30 PM - 9:30 PM IST) to ensure a healthy work-life balance.
• Immediate joining preference for candidates ready to make an immediate impact and grow with us.