Databricks Engineer

Are you an experienced and highly skilled Senior Databricks Engineer looking for a challenging contract opportunity? We are seeking a talented individual to join our dynamic team and drive the development of cutting-edge data solutions. This fully remote position offers the chance to leverage your expertise in Databricks to design, implement, and optimize scalable data pipelines and analytical platforms.

As a key member of our team, you will be instrumental in transforming complex data into actionable insights, ensuring high performance and reliability across our data infrastructure. If you possess a strong background in data engineering, a deep understanding of the Databricks ecosystem, and a passion for building robust data solutions, we encourage you to apply.

Key Responsibilities

• Design, develop, and implement scalable and high-performance data pipelines using Databricks, Apache Spark, and related technologies.
• Lead the optimization and tuning of existing Databricks workloads, ensuring efficient data processing and cost-effectiveness.
• Collaborate with cross-functional teams, including data scientists, analysts, and product managers, to understand data requirements and deliver effective solutions.
• Develop and maintain robust ETL/ELT processes to ingest, transform, and load data from various sources into the Databricks Lakehouse Platform.
• Ensure data quality, integrity, and security standards are met throughout the data lifecycle.
• Provide technical leadership and mentorship to junior engineers, fostering best practices in data engineering and Databricks usage.
• Stay abreast of the latest developments in Databricks, cloud data platforms (AWS, Azure, GCP), and the broader data ecosystem.
• Troubleshoot and resolve complex data-related issues, ensuring minimal disruption to business operations.

Requirements

• Minimum of 8+ years of professional experience in data engineering, with a strong focus on large-scale data processing.
• Proven expert-level proficiency with the Databricks platform, including Delta Lake, Unity Catalog, and Databricks SQL.
• Extensive experience with Apache Spark using Python (PySpark) or Scala for data manipulation and transformation.
• Strong command of SQL for data querying, analysis, and database management.
• Hands-on experience with at least one major cloud platform (AWS, Azure, or GCP) and its data services.
• Solid understanding of data warehousing concepts, dimensional modeling, and data lake architectures.
• Ability to design and implement efficient ETL/ELT strategies for diverse data sets.
• Excellent problem-solving skills, with a keen eye for detail and a commitment to data accuracy.
• Strong communication and collaboration skills, with the ability to articulate complex technical concepts to non-technical stakeholders.

What We Offer

• A fully remote contract position, offering flexibility and work-life balance.
• Opportunity to work on challenging and impactful projects with cutting-edge data technologies.
• Engage with a supportive and collaborative team that values innovation and continuous improvement.
• Competitive contract compensation for your valuable expertise as a Senior Databricks Engineer.
• Exposure to a diverse set of industries and data challenges.