AWS Data Engineer - Databricks

Valzosoft is actively seeking a highly skilled and experienced Senior AWS Data Engineer to join our dynamic team in Juno Beach, FL. In this pivotal role, you will be instrumental in designing, developing, and optimizing scalable data solutions that leverage the full power of AWS services, Python, and Amazon DynamoDB. This is an exceptional opportunity for a seasoned professional to drive significant impact, shaping our data architecture and pipelines to support critical business initiatives.

As a Senior AWS Data Engineer, you will be at the forefront of building robust and efficient data infrastructure, working with large datasets, and ensuring the highest standards of data quality and performance. If you are passionate about cloud-native data engineering, possess a deep understanding of AWS technologies, and thrive in a collaborative onsite environment, we encourage you to apply and contribute to our innovative projects.

Key Responsibilities

• Design, develop, and maintain highly scalable, reliable, and efficient data pipelines and data processing solutions using AWS services.
• Implement advanced data modeling techniques and optimize schema designs specifically for Amazon DynamoDB to ensure peak performance and scalability.
• Develop robust ETL/ELT processes in Python for ingesting, transforming, and loading diverse datasets from various sources into our data ecosystem.
• Collaborate closely with data scientists, analysts, and other engineering teams to understand data requirements and deliver high-quality, actionable data products.
• Monitor, troubleshoot, and optimize existing data infrastructure and processes, proactively identifying and resolving performance bottlenecks and data quality issues.
• Ensure the security, compliance, and governance of data throughout its lifecycle within the AWS environment.
• Contribute to the architectural vision and strategic direction for Valzosoft's data platform, promoting best practices in data engineering and cloud infrastructure.
• Automate operational tasks and data workflows, enhancing efficiency and reducing manual intervention.

Requirements

• A minimum of 10 years of progressive professional experience in Data Engineering, Software Engineering with a data focus, or a related field.
• Exceptional proficiency in Python programming, with a strong emphasis on scripting, data manipulation, and building scalable applications.
• Extensive hands-on experience with a broad range of AWS cloud services, including but not limited to S3, Lambda, Glue, Kinesis, Redshift, and EMR.
• Demonstrated expert-level knowledge of Amazon DynamoDB, encompassing data modeling, indexing strategies, query optimization, and performance tuning for high-throughput applications.
• Proven track record of designing, building, and maintaining complex, high-performance data pipelines from inception to production.
• Strong understanding of data warehousing concepts, dimensional modeling, and experience with both relational and NoSQL databases.
• Ability to work effectively and collaboratively in an onsite capacity at our Juno Beach, FL location.
• Excellent problem-solving skills, with a keen eye for detail and a commitment to data integrity and accuracy.

What We Offer

• The opportunity to work on challenging and impactful data engineering projects that drive business intelligence and innovation.
• A collaborative and supportive work environment where your expertise is valued and your professional growth is encouraged.
• Exposure to cutting-edge AWS technologies and the chance to contribute significantly to our cloud-native data strategy.
• A competitive compensation package that reflects your experience and contributions.
• The chance to be part of a forward-thinking team dedicated to leveraging data for strategic decision-making.