AI Data Engineer

Zecdata is actively seeking an experienced and highly skilled Data Engineer to join our dynamic team. In this pivotal remote-friendly role, you will be instrumental in designing, building, and maintaining robust data pipelines that power critical analytics and machine learning initiatives. As a Data Engineer at Zecdata, you will play a crucial part in transforming raw data into valuable, actionable insights for our clients and internal stakeholders, contributing directly to our mission of data excellence.

We are looking for a professional with a strong foundation in data architecture and a passion for crafting efficient and scalable data solutions. This is an exciting opportunity to leverage cutting-edge technologies and work with a diverse range of e-commerce and retail data, driving significant impact within a collaborative and forward-thinking environment.

Key Responsibilities

• Design, develop, and optimize scalable raw, standardized, and curated data pipelines to support various business functions.
• Create reusable data products encompassing critical entities such as ASIN, SKU, product, brand, inventory, search, media, and vendor performance.
• Implement comprehensive data quality checks, reconciliation processes, and freshness monitoring mechanisms to ensure data integrity and reliability.
• Provide essential support for ASIN/SKU identity mapping and crosswalks across disparate data sources.
• Prepare and transform data for advanced analytics, intuitive dashboards, sophisticated feature engineering, and high-performing Machine Learning models.
• Collaborate closely with data analysts, data scientists, and key business stakeholders to understand requirements and deliver data solutions that align with strategic objectives.
• Ensure efficient and secure data storage, retrieval, and processing using modern cloud-based data platforms.

Requirements

• Minimum of 5-7 years of professional experience in a Data Engineering role or a similar capacity.
• Demonstrated expertise in SQL, Python, and PySpark for data manipulation, transformation, and analysis.
• Extensive hands-on experience with AWS data services including S3, Glue, Athena, Lake Formation, Step Functions, and Lambda.
• Proven ability to implement both API-based and batch ingestion strategies for diverse data sources.
• Strong understanding and practical experience in data modeling, ensuring data quality, partitioning strategies, metadata management, and data lineage tracking.
• Experience with modern data warehousing solutions like Snowflake or Databricks is a significant advantage.
• Prior experience working with commerce, retail, media, or CPG data domains is highly preferred.
• An AWS Certification is a plus, demonstrating a deep understanding of AWS cloud technologies.

What We Offer

• A challenging and rewarding remote-friendly work environment where your contributions make a tangible impact.
• Opportunities for continuous learning and professional development in cutting-edge data technologies.
• Collaborate with a team of passionate and skilled data professionals dedicated to innovation.
• Exposure to a wide array of industry data, enhancing your expertise in various business domains.
• Flexible working arrangements that support work-life balance and personal growth.