AI Data Engineer

IBM is seeking an experienced and highly skilled GCP Data Engineer to join our dynamic team in Gurgaon. This pivotal role requires an individual with a profound understanding of Google Cloud Platform (GCP) data services and extensive experience in designing, developing, and managing robust data solutions. As a GCP Data Engineer, you will be instrumental in architecting and implementing scalable data pipelines that transform raw data into actionable insights, driving critical business decisions across various business units. If you possess a strong background in big data technologies, exceptional SQL skills, and a passion for leveraging cloud capabilities, we invite you to contribute to cutting-edge projects and advance your career with a global leader in technology.

You will play a crucial role in building the data foundations that power IBM’s next generation of intelligent solutions, ensuring data quality, accessibility, and performance.

Key Responsibilities

• Design, build, and maintain scalable and reliable data pipelines using a variety of GCP services such as Dataflow, Dataproc, BigQuery, and Cloud Storage.
• Implement efficient ETL/ELT processes to ingest, transform, and load large datasets from diverse sources into data warehouses and data lakes on GCP.
• Optimize data models and complex SQL queries for maximum performance and cost efficiency within BigQuery and other GCP data platforms.
• Collaborate closely with data scientists, data analysts, and other engineering teams to understand data requirements and deliver effective, robust data solutions.
• Ensure the highest standards of data quality, integrity, and security across all data platforms and pipelines, adhering to best practices and compliance regulations.
• Monitor, troubleshoot, and resolve issues related to data pipelines, data infrastructure, and overall data processing.
• Stay abreast of new GCP services, big data technologies, and industry trends to continuously improve our data architecture and engineering practices.

Requirements

• Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related quantitative field.
• Minimum of 7 years of progressive professional experience in data engineering, with a strong, hands-on focus on Google Cloud Platform (GCP).
• Demonstrable expertise with core GCP data services including BigQuery, Dataflow, Dataproc, Cloud Storage, and Pub/Sub.
• Proficiency in big data technologies such as Hadoop, Hive, Spark, and PySpark for large-scale data processing.
• Exceptional SQL skills are a must, with the ability to write complex queries, perform data manipulation, and optimize database performance.
• Solid understanding of data warehousing concepts, dimensional modeling, and modern ETL/ELT methodologies.
• Experience with scripting languages, particularly Python, for data processing, automation, and API integration.

What We Offer

• A challenging and stimulating work environment at the forefront of AI, cloud technology, and data innovation.
• Significant opportunities for professional growth, career advancement, and continuous learning within a leading global technology company.
• The chance to work on impactful, large-scale projects that shape the future of data analytics and machine learning.
• A collaborative and inclusive culture that values innovation, diversity, teamwork, and individual contributions.
• Competitive compensation and a comprehensive benefits package designed to support your well-being.

Join IBM and be a part of a team that is driving innovation in the data and AI space. Your expertise as a GCP Data Engineer will be crucial in building robust data foundations for the next generation of intelligent solutions. Apply today to embark on a rewarding career journey with us in Gurgaon.