Senior Data Engineer
Egypt - Remote
robusta
Robusta Studio is RTG’s digital agency. We build customer engagement tools and apps focused on digital transformations that help businesses grow.Octopus by RTG is on a mission of connecting top notch ogranizations around the globe with top notch talents. We are currently looking for a Senior Data Engineer.
Responsibilities:
- Design, develop, and maintain robust data pipelines to support machine learning workflows and GenAI applications.
- Implement data ingestion, transformation, and storage solutions for structured and unstructured data.
- Ensure data quality, integrity, and consistency across the entire pipeline.
- Optimize data infrastructure for scalability, performance, and cost-efficiency.
- Implement real-time data processing workflows
- Collaborate with ML engineers and data scientists to ensure seamless integration of data pipelines with models and applications.
Requirements
- Proficiency in programming languages for data processing (e.g., Python, Scala, Java).
- Strong experience with big data technologies (e.g., Hadoop, Spark) and ETL tools.
- Familiarity with data storage systems (e.g., SQL databases, NoSQL databases, data lakes).
- Strong Experience with vector databases and embedding stores
- Experience with cloud platforms and data services (e.g., AWS Redshift, Google BigQuery, Azure Data Factory).
- Knowledge of data modeling, warehousing, and real-time processing frameworks (e.g., Kafka, Flink).
- Strong problem-solving skills and ability to work in cross-functional teams.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: AWS Azure Big Data BigQuery Data pipelines Data quality ETL Flink Generative AI Hadoop Java Kafka Machine Learning NoSQL Pipelines Python Redshift Scala Spark SQL Unstructured data
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.