Databricks Engineer

NTT DATA is on the lookout for a highly skilled and experienced Databricks Engineer to join our dynamic and growing team. This is a prime opportunity for professionals with a minimum of 5 years of experience to contribute significantly to advanced data engineering projects. As a key member of our team, the Databricks Engineer will be instrumental in designing, developing, and maintaining robust, scalable data solutions, working in a hybrid environment across our strategic locations in India.

We are seeking individuals who are not only technically proficient but also possess a keen eye for detail and a passion for data integrity. The role demands an immediate joiner or someone with a short notice period (up to 10 days), indicating the urgency and importance of this position within NTT DATA.

Key Responsibilities

• Lead the design, development, and optimization of complex data pipelines and ETL processes using Databricks, Snowflake, and Python.
• Architect and implement robust Delta Lake solutions for high-performance data warehousing and analytics, ensuring data consistency and accessibility.
• Execute comprehensive data validation and reconciliation procedures to guarantee the accuracy, completeness, and reliability of critical business data.
• Conduct rigorous unit and integration testing of all developed data solutions, adhering to best practices for quality assurance and continuous improvement.
• Effectively utilize Git for version control, fostering a collaborative and efficient development workflow within the team.
• Actively participate in and lead various cloud data engineering initiatives, leveraging expertise in cloud platforms to build scalable and resilient data infrastructures.
• Proactively troubleshoot, debug, and resolve intricate defects and performance issues in existing data pipelines and systems.
• Collaborate closely with business analysts, data scientists, and other engineering teams to understand diverse data requirements and translate them into effective technical solutions.

Requirements

• A minimum of 5 years of hands-on professional experience in data engineering, with a significant track record of working on Databricks platforms.
• Exceptional proficiency in Databricks, Snowflake, SQL, and Python programming is absolutely essential for this role.
• Extensive demonstrable experience with Delta Lake implementations and developing high-volume, real-time, or batch data pipelines.
• Strong understanding and practical experience with advanced data validation, reconciliation techniques, and various testing methodologies.
• Solid expertise in using Git for effective source code management and collaborative development.
• Proven experience in large-scale cloud data engineering projects, including familiarity with major cloud service providers.
• Candidates who can join immediately or within a 10-day notice period will be given strong preference.

What We Offer

• An unparalleled opportunity to advance your career with NTT DATA, a global leader in IT services and innovation.
• Engage in challenging, cutting-edge data projects that push the boundaries of technology, within a supportive and collaborative hybrid work environment.
• Access to continuous learning programs, professional development courses, and mentorship opportunities to enhance your technical skills and career trajectory.
• A competitive compensation package reflective of your experience and contribution, alongside excellent opportunities for career growth and advancement.
• Be part of a diverse and inclusive culture that values innovation, teamwork, and employee well-being.

If you are an accomplished Databricks Engineer eager to tackle complex data challenges and thrive in a fast-paced environment, we invite you to apply. Join NTT DATA and be a part of a team that is driving the future of data-driven solutions!