Data Engineer

PanApps is seeking a highly skilled Data Engineer to join our dynamic remote team. This role is ideal for professionals at both Associate and Senior Associate levels who are passionate about building and managing scalable data pipelines within a modern Azure-based data platform. As a Data Engineer, you will play a crucial role in data integration, transformation, and ensuring the highest data quality in regulated environments.

Key Responsibilities

• Design, develop, maintain, and optimize robust ETL/data pipelines using Python and SQL Server for seamless data ingestion, transformation, and integration from diverse sources including databases, structured files, and REST APIs.
• Write clean, efficient, and scalable Python code for data processing, automation, and integrations, adhering strictly to best practices and coding standards.
• Develop, manage, and optimize complex SQL queries, views, and stored procedures to effectively support business logic, reporting needs, and high-performance data processing.
• Build and manage data workflows using Azure Data Factory, Azure SQL, Blob Storage, and other related Azure services, ensuring unparalleled reliability and scalability.
• Proactively monitor and troubleshoot data pipelines, performance bottlenecks, and data quality issues, striving for minimal downtime and exceptional system efficiency.
• Ensure stringent data quality, integrity, lineage, and compliance with organizational and regulatory standards such as HIPAA and SOC2.
• Collaborate effectively with cross-functional teams, including data analysts, software engineers, and DevOps specialists, to understand requirements and align data solutions with overarching business needs.
• Provide technical guidance, mentorship, and leadership to junior team members, contributing significantly to architectural decisions (for experienced candidates).

Requirements

• Strong proficiency in Python and SQL (T-SQL, SQL Server) with a proven track record in ETL pipeline development and data integration.
• Hands-on exposure to Azure Data Services including Azure Data Factory (ADF), Azure SQL, and Blob Storage.
• Experience with REST APIs and integrating data from various external data sources.
• Solid understanding of data quality, validation, and pipeline monitoring techniques.
• Familiarity with Git/version control systems and best practices.
• Strong analytical and problem-solving skills with an ability to diagnose and resolve complex data issues.
• Knowledge of data modeling and warehousing concepts.
• Understanding of data security and compliance standards, particularly related to Digital Personal Data Protection Rules, 2025, DPDP Act, 2023, ISMS, and ISO/IEC 27001:2022.

What We Offer

• An opportunity to work remotely from anywhere, offering excellent work-life balance.
• Be part of a forward-thinking team leveraging modern Azure data technologies.
• Exposure to regulated environments and critical data compliance standards.
• Opportunities for professional growth, mentorship, and leadership roles for senior candidates.
• A collaborative and supportive work environment with cross-functional team interaction.