Data Engineer - Web Scraping
United Arab Emirates
A AED 264K-323K (estimate) Senior-level Full Time
Tasks
- Build data ingestion pipelines
- Clean, transform, and validate datasets
- Debug data pipeline incidents
- Design web scraping systems
- Develop automated data collection workflows
- Develop internal automation tools
- Implement data quality control checks
- Monitor and optimize scraping pipelines
- Orchestrate scraping workflows
- Process scalable data processing workflows
Perks/Benefits
Skills/Tech-stack
APIs | AWS Lambda | AWS RDS | AWS S3 | AWS SNS | AWS SQS | Apache Airflow | CI/CD | Data Warehousing | Docker | GitLab CI | GitLab CI/CD | HTML | JavaScript | Jenkins | Kubernetes | Pandas | Python | SQL | Scrapy | Selenium | XPath
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Senior Software Engineer - AI Agents & GenAI AED 180K-228KAPI Keys | CI/CD | Function Calling | Git | GuardrailsSenior-level Full TimeDubai, Dubai, United Arab Emirates1d ago
-
Applied AI Specialist AED 216K-300KAPI | Anomaly Detection | Cloud Architecture | Computer Vision | Data GovernanceContinued career development support | Employee resource groups | Flexible work-from-home policy | Generous paid time off | Paid volunteer timeSenior-level Full TimeUAE-Dubai, United Arab Emirates R1d ago
-
Engineer, Data & Agentic AI AED 120K-144KCloud Computing | Data Pipelines | Deep learning | ETL | Language ProcessingTraining and developmentMid-level Full TimeAbu Dhabi, United Arab Emirates2d ago
-
Senior-level Full TimeDubai, Dubai, United Arab Emirates2d ago
-
Agentic DevOps Lead – Data & AI AED 264K-323KAWS | Autogen | CI/CD | Cloud Architecture | Cloud platformCareer progression | Competitive rewards | Continuous coaching | Flexible work arrangements | Travel as neededSenior-level Full TimeDubai, Arenco Tower, United Arab Emirates2d ago
-
Mid-level Full TimeDubai, United Arab Emirates2d ago
-
Deep learning | Generative AI | Language Models | Language Processing | Large Language ModelsMid-level Full TimeAbu Dhabi, United Arab Emirates2d ago
-
Alerting | Amazon Redshift | Batch Processing | CI/CD | Cause analysisCollaboration with cross-functional teams | Fully remote work | Ownership over data reliability strategy | Remote opportunitySenior-level Full TimeUnited Arab Emirates R3d ago
-
Generative AI / Azure AI Engineering Lead AED 192K-234KACL | AI Foundry | AI Search | API Security | Agent systemsSenior-level Full TimeDubai, Arenco Tower, United Arab Emirates3d ago
-
Senior-level Full TimeDubai, United Arab Emirates5d ago
-
Senior Data Engineer - Python & Microservices AED 295K-349KAPI Security | AWS | Apache Kafka | Apache Spark | Asynchronous programmingSenior-level Full TimeDubai, Dubai, United Arab Emirates8d ago
-
Senior Data Engineer - UAE AED 240K-240KAzure | CI/CD | Cloud platform | Data Cleansing | Data EngineeringSenior-level Full TimeUAE Abu Dhabi9d ago
-
Data Engineer AED 144K-156KAccess Management | Amazon Redshift | Azure | Azure Data | Azure Data FactoryMid-level Full TimeUnited Arab Emirates9d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Friendly atmosphere | Portfolio and LinkedIn application opportunity | Supportive management approachMid-level Full TimeDubai, United Arab Emirates9d ago
-
Senior AI Solutions Engineer - UAE AED 286K-360KAI Evaluation | AI Observability | AI tracing | APIs | Agent OrchestrationDental insurance | Employee assistance program | Flexible time off | Medical insurance | Paid HolidaysSenior-level Full TimeRemote Dubai, United Arab Emirates R9d ago
-
Snowflake Data Engineer AED 200K-200KAPI | Access Control | Cloud Data | Cloud Data Storage | Data GovernanceMid-level Full TimeDubai, AE10d ago
-
AWS | Apache Kafka | Azure | CI/CD | Confluent Control CenterMid-level Full TimeAbu Dhabi, United Arab Emirates13d ago
-
Senior Research Engineer in the Division of Science (Computer Science) - Dr. Azza Abouzied AED 280K-323KArtificial Intelligence | C++ | Data Visualization | Database systems | DockerAnnual home leave allowance | Computing support | Dependent private school fees | Educational assistance | Housing allowanceSenior-level Full TimeAbu Dhabi, UAE14d ago
-
Lead Data Engineer AED 168K-222KApache Airflow | Astronomer | Azure | Azure Data | Azure Data FactorySenior-level Full Timedubai, Dubai, United Arab Emirates14d ago
-
AI Engineer AED 102K-102KAWS | Azure | Generative AI | Google Cloud | Image SynthesisDocumentation support | Hands on troubleshooting support | Technical training sessions | Workshops and demosMid-level Full TimeDubai, United Arab Emirates15d ago
-
AI Data Engineer AED 300K-360KAWS | Apache Airflow | Azure | BigQuery | CI/CDAccommodation | Expense reimbursements for home visits | Flight tickets | Holiday bonuses | IPhoneMid-level Full TimeDubai, United Arab Emirates15d ago
-
Data Engineer - Automation & AI AED 180K-228KAI Agents | AI Foundry | AWS Bedrock | AWS Glue | Apache SparkSenior-level Full TimeAbu Dhabi, Abu Dhabi, United Arab …15d ago
-
AWS Lakehouse Platform Engineer AED 180K-228KAWS CDK | AWS Glue | AWS Lake Formation | AWS S3 | AWS Well ArchitectedMentoring | On-site workSenior-level Full TimeAbu Dhabi, Abu Dhabi, United Arab …15d ago
-
Senior Data Scientist II - Personalization AED 120K-144KA/B | A/B Testing | Apache Spark | Attention Mechanism | B testingFitness reimbursements | Healthcare benefits | Remote work 30 days per year | Training classes access | Unlimited vacation daysMid-level Full TimeDubai, United Arab Emirates R16d ago
-
Senior-level Contract Full TimeAbu Dhabi17d ago