Mid/Senior Data Engineer
Tasks
- Build centralized data lake on GCP
- Conduct proof of concept research
- Design ETL/ELT processes
- Design data validation checks
- Develop batch data processing pipelines
- Develop data models for analytics
- Develop streaming data processing pipelines
- Enable machine learning data needs
- Ensure data quality accuracy completeness consistency
- Integrate diverse data sources
- Manage data integrity availability performance
- Optimize Spark data workflows
- Perform root cause analysis
- Support Gen AI initiatives
- Troubleshoot data issues
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Apache Spark | Apache Spark Streaming | Atlan | BigQuery | Cloud Storage | Cloud platform | DBT | Data Governance | Data Modeling | Data Warehousing | Dataflow | Dataplex | Dataproc | Docker | ELT | ETL | Google Cloud | Google Cloud Platform | Great Expectations | Kubernetes | Looker | MongoDB | PubSub | PySpark | Python | SQL | Scala | Spark Streaming | Terraform
Education
N/A
Roles
Related jobs
-
Consultant Data & IA Manager EUR 45K-60KAzure Machine Learning | Clustering | Generative AI | Language Models | Language ProcessingMid-level Full TimeTunis - Immeuble The Screen, Tunisia1mo ago
-
Full Stack Data Analyst USD 136K-176KA/B | A/B Testing | Amplitude | Attribution | B testingDeep work | Flexible schedule | Remote workMid-level Full TimeTunisia - Remote R1mo ago
-
Data Engineer EUR 45K-55KAzure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Data FactoryAgile sprints | Autonomy | Internal technology mentorship | Technical expertise growthSenior-level Full TimeTunis - Immeuble The Screen, Tunisia1mo ago
-
Data Quality Engineer AED 132K-162KCI/CD | Cloud Data | Cloud Data Platforms | Data Cataloging | Data GovernanceMid-level Full TimeTunis, Tunis, Tunisia1mo ago