AWS Data Engineer - Databricks

We are seeking a highly skilled and experienced AWS Data Engineer with specialized expertise in IAM (Identity and Access Management) to join our dynamic team in Juno Beach, FL. This is an exciting onsite contract opportunity for a professional who thrives on designing, building, and optimizing robust data solutions within the Amazon Web Services ecosystem. The ideal AWS Data Engineer will play a critical role in managing our data infrastructure, ensuring data integrity, security, and accessibility, particularly through meticulous IAM configurations and best practices.

As an AWS Data Engineer, you will be instrumental in developing scalable and secure data pipelines, working with large datasets, and implementing advanced data warehousing solutions. Your deep understanding of AWS services, coupled with a strong focus on security via IAM, will enable us to enhance our data capabilities and support critical business functions. This role demands a proactive individual who is ready to tackle complex challenges and contribute to a cutting-edge data environment.

Key Responsibilities

• Design, develop, and maintain secure and scalable data pipelines using a range of AWS services such as S3, Glue, Redshift, Lambda, and Kinesis.
• Implement, configure, and manage AWS Identity and Access Management (IAM) policies, roles, and user permissions to ensure stringent data security and compliance.
• Build and optimize ETL/ELT processes for extracting, transforming, and loading data from various sources into data lakes and data warehouses.
• Collaborate with data architects, analysts, and other engineering teams to understand data requirements and translate them into effective technical solutions.
• Monitor data pipeline performance, troubleshoot issues, and implement optimizations to ensure high availability and efficiency of data infrastructure.
• Ensure data quality, integrity, and governance throughout the data lifecycle, adhering to industry best practices and security standards.
• Develop and maintain comprehensive documentation for data architecture, pipelines, and IAM configurations.
• Stay abreast of new AWS services and data engineering trends, recommending and implementing innovative solutions to improve our data platform.

Requirements

• Proven professional experience as an AWS Data Engineer or similar role, with a strong portfolio of AWS data projects.
• Deep expertise in AWS services, including but not limited to S3, Glue, Redshift, Lambda, EC2, CloudWatch, and particularly IAM.
• Demonstrable experience with AWS Identity and Access Management (IAM) for managing access control, policies, and roles in complex data environments.
• Proficiency in programming languages such as Python or Scala for data manipulation and automation.
• Strong command of SQL for querying and manipulating large datasets, along with experience in data modeling techniques.
• Experience with big data technologies and distributed computing frameworks.
• Understanding of data warehousing concepts, dimensional modeling, and ETL/ELT methodologies.
• Excellent problem-solving skills, with an ability to diagnose and resolve complex technical issues efficiently.
• Strong communication and collaboration skills to work effectively within cross-functional teams.

What We Offer

• The opportunity to work on mission-critical data infrastructure within a dynamic AWS environment.
• A challenging and rewarding contract role focused on cutting-edge data engineering and security.
• A collaborative and supportive onsite work environment in Juno Beach, FL.
• Opportunities for professional growth and to deepen expertise in AWS and IAM.
• Competitive compensation for a skilled AWS Data Engineer.