Data Engineer

Rapidera Technologies is seeking a skilled Data Engineer to join our innovative team in Pune. This role is perfect for a professional with a strong background in data analysis, Python, and RDBMS, eager to work with large-scale distributed systems and contribute to cutting-edge data solutions. As a Data Engineer, you will be instrumental in designing, building, and maintaining robust data pipelines.

Key Responsibilities

• Develop and maintain scalable data pipelines using Python and RDBMS technologies.
• Implement web scraping and other data collection strategies to acquire diverse datasets.
• Perform comprehensive data analysis and manipulation using tools like Excel and handle various data file formats (CSV, text).
• Utilize strong analytical skills to quickly understand and resolve complex data tasks with minimal supervision.
• Contribute to the architecture and optimization of data storage and processing solutions in a distributed environment.
• Collaborate with cross-functional teams to understand data requirements and deliver actionable insights.
• Ensure the quality, reliability, and integrity of data across all systems.

Requirements

• Bachelor's degree in Computer Science or a related field.
• Minimum of 3+ years of hands-on experience in data analysis within large-scale distributed systems.
• Strong proficiency in Python programming and RDBMS, with the ability to write production-quality code.
• Solid understanding of Algorithms, Data Structures, and data Persistence concepts.
• Experience with web scraping and various data collection tools and methodologies.
• Excellent communication and presentation skills, with a self-driven attitude and strong ownership.
• Good to have: Experience with Java, Hadoop, Druid, Tableau, Analytical/OLAP, Graph databases, and Elasticsearch.

What We Offer

• An exciting opportunity to work on challenging data engineering problems with a dynamic team.
• A collaborative and supportive work environment that fosters professional growth.
• Exposure to cutting-edge technologies and large-scale distributed systems.
• Opportunities to lead and mentor junior team members.
• A chance to make a significant impact on the company's data strategy and product development.