AI Data Engineer

We are seeking an experienced Sr. AI Data Engineer (Cloud) to join our dynamic team in Chicago, IL. This role is crucial for developing, optimizing, and maintaining robust data pipelines and AI integration strategies, focusing on cloud environments. If you are passionate about leveraging cutting-edge AI technologies and possess strong data engineering skills, we encourage you to apply.

Key Responsibilities

• Design, build, and maintain scalable data pipelines using SQL, Python, Spark, and Snowflake.
• Optimize data storage and retrieval processes for enhanced performance.
• Develop and integrate APIs to facilitate seamless data flow and AI service consumption.
• Implement and manage Generative AI, LLMs, and RAG frameworks, including embedding techniques.
• Monitor and evaluate LLM performance, ensuring observability and reliability.
• Integrate AI services through REST APIs, particularly with AWS Bedrock.
• Collaborate with cross-functional teams to deliver innovative AI-driven solutions.
• Contribute to the continuous improvement of data engineering practices and tools.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related field.
• 8+ years of overall experience in data engineering, with a strong focus on AI and cloud.
• Proficiency in SQL, Python, and Spark for data manipulation and processing.
• Extensive experience with Snowflake and AWS cloud services.
• Demonstrated expertise in building and optimizing data pipelines and API development.
• Hands-on experience with Generative AI, Large Language Models (LLMs), and Retrieval-Augmented Generation (RAG).
• Familiarity with LLM evaluation, observability, and monitoring tools.
• Experience integrating AI services through REST APIs.
• Knowledge of Snowflake Cortex AI and AWS Bedrock is highly desirable.
• Experience with Snowpark and Snowflake Native Apps is a plus.

What We Offer

• An exciting opportunity to work on cutting-edge AI and cloud technologies.
• A collaborative and innovative hybrid work environment in Chicago, IL.
• Opportunity to contribute to high-impact projects.
• Competitive contract rates for qualified candidates.
• Professional growth and development opportunities in a rapidly evolving field.