Senior Azure & Databricks Administrator (SME)

Tekgence is actively seeking a highly skilled and experienced Databricks Admin to join our client's team on a contract basis. This critical role involves managing and optimizing the Azure Databricks environment, ensuring robust data platform operations, and supporting advanced analytics initiatives. As a Databricks Admin, you will play a pivotal role in maintaining the integrity, security, and performance of our data infrastructure, working onsite in Plano, TX.

We are looking for a dedicated professional with a strong background in Azure Databricks administration and a deep understanding of cloud data ecosystems. This is an excellent opportunity for an individual who thrives in a dynamic environment and is eager to contribute to cutting-edge data solutions.

Key Responsibilities

• Administer and manage Azure Databricks workspaces, clusters, and users to ensure optimal performance and resource utilization.
• Implement and enforce robust security protocols, including Role-Based Access Control (RBAC) and Unity Catalog for data governance.
• Oversee the lifecycle management of Delta Lake tables and ensure efficient storage and retrieval of data in ADLS Gen2.
• Develop and maintain CI/CD pipelines for Databricks deployments, automating infrastructure provisioning using Terraform.
• Monitor Databricks environments for health, performance, and security, proactively identifying and resolving issues.
• Collaborate with data engineers and data scientists to support their data processing and analytics needs within the Databricks platform.
• Ensure compliance with organizational data policies and industry best practices for data management and security.

Requirements

• Proven experience as a Databricks Admin with strong expertise in Azure Databricks Administration.
• In-depth knowledge and hands-on experience with Unity Catalog for data governance and access management.
• Demonstrated proficiency in implementing and managing Role-Based Access Control (RBAC) within Databricks.
• Extensive experience with Databricks Cluster Management, including configuration, scaling, and optimization.
• Solid understanding of Delta Lake architecture and its integration with Azure Data Lake Storage Gen2 (ADLS Gen2).
• Proficiency in using Terraform for infrastructure as code to manage and provision Azure resources.
• Experience with setting up and maintaining CI/CD pipelines for Databricks-related projects.
• Ability to work effectively in an onsite, collaborative team environment for 5 days a week.

What We Offer

• An exciting opportunity to work on complex and impactful data platform projects with a leading organization.
• A collaborative and supportive work environment where your contributions are valued.
• Exposure to cutting-edge cloud technologies and the chance to further develop your expertise in Azure Databricks.
• The stability of a long-term contract position (12+ months) with potential for extension.
• A chance to be a key player in optimizing and securing critical data infrastructure for advanced analytics.

If you are a highly motivated Databricks Admin looking for a challenging contract role in Plano, TX, we encourage you to apply. Join us and help shape the future of our data ecosystem!