Data Engineer

AgileSquadInc is actively seeking an experienced Data Engineer to join our dynamic team in Houston, Texas. This pivotal role involves designing, building, and maintaining robust data pipelines and infrastructure, crucial for our data-driven initiatives. As a Data Engineer, you will be instrumental in transforming raw data into actionable insights, ensuring data quality, reliability, and accessibility across the organization.

We are looking for a highly skilled individual with a strong background in cloud-based data solutions and database management. The ideal candidate will possess a deep understanding of data engineering best practices and be eager to contribute to a forward-thinking environment.

Key Responsibilities

• Design, develop, and optimize scalable data pipelines using Amazon S3, Databricks, and other modern data technologies.
• Implement and manage DevOps practices for data infrastructure, ensuring continuous integration and continuous delivery (CI/CD).
• Perform SQL Server and PostgreSQL/Aurora database assessments and facilitate seamless migrations.
• Contribute to data modeling and database modernization efforts to enhance system efficiency and performance.
• Develop and maintain automated schema validation processes and ensure data integrity.
• Utilize Medallion/Lakehouse patterns for efficient data organization and management.
• Implement API-based data access and event-driven integration strategies for real-time data flow.
• Ensure compliance with data contracts and manage data catalogs for improved data governance.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related field.
• 5-9 years of progressive experience as a Data Engineer or in a similar role.
• Proven expertise with Amazon S3 Buckets, Databricks, and DevOps methodologies.
• Strong background in SQL Server assessment and PostgreSQL/Aurora migration.
• Experience with transactional database engineering and data modeling.
• Familiarity with CI/CD, Terraform, and database DevOps practices.
• Understanding of automated schema validation and Medallion/Lakehouse patterns.
• Knowledge of data catalogs, API-based data access, event-driven integration, and data contracts.

What We Offer

• A competitive salary and benefits package.
• Opportunity to work on cutting-edge data engineering projects with innovative technologies.
• A collaborative and supportive work environment that fosters professional growth.
• Chances to contribute significantly to the company's data strategy and impact business outcomes.
• Continuous learning and development opportunities within a growing organization.