Senior Data Engineer
Tasks
- Build centralized data lake on GCP
- Collaborate with data science teams for analytics
- Create dashboards using Looker Studio
- Design data models for analytical use cases
- Design develop ELT processes
- Design develop ETL processes
- Develop maintain data dashboards
- Develop optimize batch data pipelines
- Develop optimize streaming data pipelines
- Ensure data accuracy, completeness, & consistency
- Implement data validation and quality checks
- Integrate diverse data sources
- Perform root cause analysis
- Troubleshoot data issues
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Apache Spark | Atlan | Cloud Storage | Cloud platform | DBT | Data Governance | Data Lineage | Data Modeling | Data Quality | Data Validation | Data Warehousing | Docker | ELT | ETL | GCP BigQuery | GCP DataPlex | GCP Dataflow | GCP Dataproc | GCP PubSub | Google Cloud | Google Cloud Platform | Great Expectations | Kubernetes | Looker Studio | Luigi | MongoDB | Prefect | PySpark | Python | SQL | Scala | Terraform
Education
N/A
Roles
Related jobs
-
AWS | Amazon Redshift | Apache Airflow | Apache Kafka | Apache SparkRemote collaboration tools | Remote workMid-level Full TimeSouth Africa - Cape Town23h ago
-
Senior Data Engineer - Alexandria USD 120K-209KAPI Development | Apache Spark | Azure | Azure Data | Azure Data FactoryContinuous learning | Hybrid work schedule | Mentorship | Structured onboardingSenior-level Full TimeAlexandria, Alexandria Governorate, Egypt1d ago
-
Bash | Data Ingestion | Data Processing | Dataset development | DockerAsynchronous work culture | Friendly work atmosphere | Opportunities for impactMid-level Full TimeCairo, Egypt1d ago
-
Senior-level Full TimeCairo, Cairo1d ago
-
Software Engineer - Machine Learning (SDV), POWER USD 184K-270KC# | C++ | Data Analysis | Exploratory Data Analysis | Feature EngineeringSenior-level Full TimeCAIRO - CAI1, Egypt1d ago
-
AI/ML Software Engineer USD 23K-47KAWS | Angular | Data Modeling | Data Structures | Deep learningFlexibility | Health and wellness benefits | Hybrid work optionSenior-level Full TimeNew Cairo - Al Qahirah - …2d ago
-
CI/CD | Data Engineering | Data Modeling | Data Pipelines | Data QualityCollaborative multidisciplinary team | Growth opportunities | Ownership of AI deliverySenior-level Full TimeCairo, Egypt2d ago
-
Data Analytics Engineer (Evening Shift) EUR 23K-23KAzure Databricks | CI/CD | Data Modeling | Data Quality | Data ReconciliationComprehensive health insurance | Employee assistance programme | Employee share plan | Flexible hours | Flexible work schemeMid-level Full TimeNew Cairo, Egypt; Cairo, CAIRO, Egypt; … R2d ago
-
Senior-level Full TimeCairo, EG3d ago
-
Senior-level Full TimeCairo, EG3d ago
-
Senior-level Full TimeCAIRO - CAI1, Egypt3d ago
-
Data Engineer (Data Integration) Min 6 Years of Exp. USD 112K-147KAb Initio | Apache Spark | Business Intelligence | CI/CD | Data GovernanceSenior-level Full TimeCairo, Cairo Governorate, Egypt3d ago
-
Data Engineering & Warehousing Engineer INR 1500K-2500KAWS Glue | Agile Scrum | Amazon Redshift | Apache Kafka | Apache SparkSenior-level Full TimeCairo, Cairo5d ago
-
Data Science & Analytics Engineer USD 125K-165KAWS | Agile | BigQuery | Classification | Cloud platformSenior-level Full TimeCairo, Cairo5d ago
-
AI / ML Engineer USD 110K-187KAWS Bedrock | AWS SageMaker | Azure Machine Learning | Azure OpenAI | BigQuery MLMid-level Full TimeCairo, Cairo5d ago
-
Mid-level Full TimeCairo, Cairo5d ago
-
Data Developer USD 114K-142KAgile | Amazon Redshift | Amazon Web Services | Apache Airflow | Apache SparkMid-level Full TimeCairo, Cairo5d ago
-
Emerging Technology Services Engineer USD 133K-188KAPI Integration | AWS | Agile | Artificial Intelligence | AutomationSenior-level Full TimeCairo, Cairo5d ago
-
Data Engineer USD 129K-178KAWS Glue | Amazon S3 | Analytics engineering | Data Governance | Data ModelingMid-level Full TimeAlexandria6d ago
-
Bash | Cloud platform | Data Processing | Dataset Engineering | DockerAsynchronous culture | Entrepreneurial team | Flexible management approach | Remote workMid-level Full TimeAlexandria, Egypt6d ago
-
AWS | Azure | CI/CD | Cloud platform | DockerSenior-level Full TimeNew Cairo City, Cairo Governorate, Egypt7d ago
-
Senior Data Engineer INR 1500K-2500KAWS | Alerting | Apache Airflow | Apache Iceberg | Apache KafkaCareer Growth & Development | Collaborative inclusive work environment | Opportunity to work on cutting-edge technology | Passionate teamSenior-level Full TimeEgypt - Remote R7d ago
-
AI Platform Engineering Senior Consultant USD 184K-287KAI Enterprise | AKS | AWS | Amazon EKS | AnsibleSenior-level Full TimeCairo, EG7d ago
-
Autodesk Revit | BIM | Computer Vision | Generative AI | Language ModelsMedical insurance | Social insuranceEntry-level Full TimeEgypt - Remote R7d ago
-
ETIC, Python Developer- Associate USD 125K-188KAWS | Automated testing | Azure | CI/CD | Data ModelingSenior-level Full TimeCairo - ETIC, Egypt8d ago