Data Engineer

Scry Analytics is seeking a highly motivated and experienced Data Engineer to join our expanding team. This role is perfect for a passionate professional with a strong background in building and managing large enterprise data and analytics platforms. As a Data Engineer, you will play a crucial role in understanding complex business and architectural challenges, developing innovative solutions, and working closely with our data engineering and data science teams.

Key Responsibilities

• Design, build, and maintain scalable data solutions, optimal data processing pipelines, and architecture for large-volume, big data sets.
• Develop and implement efficient pre-processing and data manipulation tasks using PySpark and Pandas DataFrames.
• Create and manage RESTful web services and API platforms for data integration and consumption.
• Implement and manage Scalable Smart Data Lakes, Data Ingestion Platforms, Machine Learning, and NLP-based Analytics Platforms.
• Work with hyper-scale processing clusters, data mining, and search engines to support various analytical needs.
• Collaborate with data science and infrastructure teams to deploy practical machine learning solutions and pipelines into production environments.
• Contribute to the development of event-driven architectures and stream-processing systems.

Requirements

• 3+ years of industry experience in creating and managing end-to-end data solutions and processing pipelines.
• Proficiency in Python, including strong design skills, knowledge of design patterns, and Object-Oriented Programming (OOP) concepts.
• Strong experience with PySpark DataFrames and Pandas DataFrames for data manipulation.
• Proven experience in creating RESTful web services and API platforms.
• Familiarity with SQL and NoSQL databases such as PostgreSQL, MongoDB, or Elasticsearch.
• Experience with stream-processing systems like Spark-Streaming and Kafka, and working with event-driven architectures.
• A proactive mindset, independent problem-solving abilities, and a commitment to continuous learning.

What We Offer

• An opportunity to work with a fast-growing company and contribute to cutting-edge data and analytics platforms.
• A collaborative and innovative work environment with a focus on professional growth.
• Exposure to advanced technologies in Machine Learning, NLP, and Big Data.
• The chance to be part of a team that values creativity and strong programming skills.
• Competitive compensation and benefits package.