Data Engineer

We are seeking a highly skilled and experienced Data Engineer to join our dynamic team on a contract basis. This role is crucial for designing, building, and maintaining scalable data pipelines and robust data models. The ideal Data Engineer will possess a strong technical background in SQL, Python, and modern data warehousing technologies, contributing significantly to our data infrastructure.

Key Responsibilities

• Develop and optimize complex SQL queries, including Common Table Expressions (CTEs), advanced joins, and window functions for data transformation and analysis.
• Design, build, and maintain efficient and reliable data pipelines using various tools and technologies.
• Implement and manage data models within Snowflake, ensuring data integrity, performance, and scalability.
• Utilize DBT for data transformation, including the creation of macros, packages, and custom materializations.
• Conduct thorough data profiling to identify data quality issues related to primary keys, unique keys, cardinality, data types, precision, scale, and data skew.
• Develop and implement data quality frameworks to ensure accuracy and consistency of data across all systems.
• Collaborate with cross-functional teams to understand data requirements and deliver effective data solutions.
• Contribute to the continuous improvement of CI/CD pipelines specifically for DBT deployments.

Requirements

• Proven expertise in SQL, including advanced concepts like CTEs, complex joins, window functions, and analytical functions.
• Hands-on experience with Python for data manipulation, scripting, and automation.
• Demonstrable experience working with Snowflake data warehouse.
• Strong knowledge of DBT (data build tool), including practical application of macros, packages, and custom materializations.
• Experience with data profiling techniques and understanding of data quality dimensions.
• Familiarity with data pipelines, data modeling principles, and data quality frameworks.
• Understanding of CI/CD pipelines, particularly in the context of DBT deployments.
• Excellent communication, problem-solving, and collaboration skills are essential for this Data Engineer role.

What We Offer

• Opportunity to work on challenging and impactful data engineering projects.
• A collaborative and innovative hybrid work environment in the USA.
• Engagement with cutting-edge data technologies and methodologies.