GCP Data Architect
Tasks
- Build reusable job templates
- Build streaming pipelines with Pub Sub and Dataflow
- Collaborate with data architects and analysts
- Create automation scripts
- Design ETL/ELT pipelines
- Design data lake and warehouse solutions
- Develop data ingestion frameworks
- Ensure GDPR and data privacy compliance
- Implement CI/CD pipelines
- Implement data validation and data quality rules
- Model star schema and snowflake schema
- Monitor data quality with dashboards
- Optimize BigQuery queries
- Orchestrate workflows with Cloud Composer and Databricks Workflows
- Tune Dataflow pipelines for cost and performance
- Use Dataplex for data quality and governance
- Write SQL queries and stored procedures
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | BigQuery | CI/CD | Cloud Composer | Cloud Storage | Cloud platform | Clustering | Data Governance | Data Lakes | Data Quality | Data Warehousing | Databricks | Dataflow | Dataplex | Dataproc | ELT | ETL | GCS | GDPR | Google Cloud | Google Cloud Platform | Materialized views | Partitioning | PubSub | Python | Query Optimization | SQL | Snowflake Schema | Star Schema | Streaming Data
Education
N/A
Roles
Related jobs
-
Senior-level Full TimeCairo, EG1d ago
-
Data Engineering & Warehousing Engineer INR 1500K-2500KAWS Glue | Agile Scrum | Amazon Redshift | Apache Kafka | Apache SparkSenior-level Full TimeCairo, Cairo3d ago
-
Data Science & Analytics Engineer USD 125K-165KAWS | Agile | BigQuery | Classification | Cloud platformSenior-level Full TimeCairo, Cairo3d ago
-
AI / ML Engineer USD 110K-187KAWS Bedrock | AWS SageMaker | Azure Machine Learning | Azure OpenAI | BigQuery MLMid-level Full TimeCairo, Cairo3d ago
-
Mid-level Full TimeCairo, Cairo3d ago
-
Data Developer USD 114K-142KAgile | Amazon Redshift | Amazon Web Services | Apache Airflow | Apache SparkMid-level Full TimeCairo, Cairo3d ago
-
Emerging Technology Services Engineer USD 133K-188KAPI Integration | AWS | Agile | Artificial Intelligence | AutomationSenior-level Full TimeCairo, Cairo3d ago
-
Data Engineer USD 129K-178KAWS Glue | Amazon S3 | Analytics engineering | Data Governance | Data ModelingMid-level Full TimeAlexandria4d ago
-
Bash | Data Processing | Docker | GCP | LinuxMid-level Full TimeAlexandria, Egypt4d ago
-
AWS | Azure | CI/CD | Cloud platform | DockerSenior-level Full TimeNew Cairo City, Cairo Governorate, Egypt5d ago
-
Senior Data Engineer INR 1500K-2500KAWS | Alerting | Apache Airflow | Apache Iceberg | Apache KafkaCareer Growth & Development | Collaborative inclusive work environment | Opportunity to work on cutting-edge technology | Passionate teamSenior-level Full TimeEgypt - Remote R5d ago
-
AI Platform Engineering Senior Consultant USD 184K-287KAI Enterprise | AKS | AWS | Amazon EKS | AnsibleSenior-level Full TimeCairo, EG5d ago
-
Autodesk Revit | BIM | Computer Vision | Generative AI | Language ModelsMedical insurance | Social insuranceEntry-level Full TimeEgypt - Remote R5d ago
-
ETIC, Python Developer- Associate USD 125K-188KAWS | Automated testing | Azure | CI/CD | Data ModelingSenior-level Full TimeCairo - ETIC, Egypt6d ago
-
Senior Data Engineer USD 128K-164KAWS | Apache Flink | Apache Kafka | Apache Spark | Apache Spark StreamingSenior-level Full TimeMaadi, Al Qāhirah, Egypt6d ago
-
Data Engineer USD 105K-167KAb Initio | DataStage | ETL | Extract Transform | Extract Transform LoadFlexible working arrangement | Hybrid workMid-level Full TimeGiza, EG6d ago
-
Senior Backend Engineer / AI Engineer USD 134K-180KAgentic Workflows | Anthropic Claude | Anthropic Claude SDK | BullMQ | Claude SDKRemote workSenior-level Full TimeEgypt, Lebanon, Lebanon or Egypt6d ago
-
Jr AI Engineer EUR 12K-27KAI SDK | Azure | Azure Bot | Azure Bot Service | Bot FrameworkEmployee assistance program | Employee share plan | Flexible hours | Health insurance | Hybrid work modelEntry-level Full TimeNew Cairo, Egypt; Cairo, CAIRO, Egypt; … R7d ago
-
AI Engineer, AI4ALL USD 46K-58KAPI Development | API Testing | Amazon Web Services | Cloud Computing | Cloud platformCareer growth opportunities | Diversity and international collaborationEntry-level Full TimeCAIRO - CAI1, Egypt8d ago
-
Junior Machine Learning Engineer USD 138K-192KKeras | Machine Learning | NumPy | Pandas | PythonHybrid working | Medical insurance | Social insurance | TransportationMid-level Full TimeNasr City, Al Manteqah Al Oula, …8d ago
-
Senior-level Full TimeCairo, Cairo Governorate, Egypt11d ago
-
Agentic Workflows | Anthropic API | Continuous Deployment | Continuous integration | Cost OptimizationFlexible working hours | Remote workMid-level Full TimeCairo, Cairo Governorate, Egypt12d ago
-
Senior-level Full TimeCairo - ETIC, Egypt12d ago
-
AWS | Ansible | Backpressure | Backup and Recovery | BashAutonomy and responsibility | Collaborative culture | Fun dynamic workplace | Top-tier health insuranceSenior-level Full TimeRemote-Egypt, Saudi Arabia R12d ago
-
Data & Analytics Engineer (m/w/d) EUR 53K-60KAPIs | AWS Redshift | Data Governance | Data Modeling | Data MonitoringMid-level Full TimeCairo, EG13d ago