Data Engineer

We are seeking an experienced Data Engineer to join our dynamic team. The Data Engineer will be instrumental in designing, developing, and maintaining robust and scalable data pipelines and the underlying data infrastructure. This critical role involves extensive work with large datasets, leveraging various cloud platforms, advanced databases, and cutting-edge data processing technologies to meet complex analytics and critical business requirements.

As a Data Engineer, you will contribute significantly to our data strategy, ensuring data integrity, accessibility, and performance across all systems. Your expertise will directly impact our ability to derive insights and drive informed business decisions.

Key Responsibilities

• Design, develop, and maintain efficient and scalable ETL/ELT data pipelines to support various business functions.
• Develop and implement scalable data processing solutions primarily using Python and SQL.
• Work extensively with both structured and unstructured data, ensuring proper storage, retrieval, and analysis.
• Build and maintain resilient data warehouses and data lakes, optimizing for performance and cost-efficiency.
• Perform comprehensive data transformation, validation, and quality checks to ensure high data accuracy.
• Develop advanced data solutions utilizing Apache Spark/PySpark for large-scale data processing.
• Collaborate with cloud platforms such as AWS, Azure, and GCP to deploy and manage data services.
• Work with modern data platforms like Snowflake, Databricks, and various relational databases.

Requirements

• 10+ years of professional experience specifically in Data Engineering roles.
• Strong, proven experience in developing and optimizing ETL/ELT pipelines.
• Hands-on expertise with Python, SQL, Apache Spark, and major cloud technologies (AWS, Azure, GCP).
• Extensive experience with databases, data warehouses, and effective data modeling techniques.
• Proficiency in data processing, data modeling, and data warehousing concepts.
• Familiarity with Data Engineering technologies such as Databricks, Apache Airflow, and Kafka.
• Experience with Git and CI/CD practices for data pipeline management.

What We Offer

• An opportunity to work on challenging and impactful data projects.
• A collaborative and innovative work environment.
• Exposure to cutting-edge cloud and data engineering technologies.
• Competitive compensation package.