Senior Data Engineer - Web Scraping
United Arab Emirates
R
A AED 264K-323K (estimate) Senior-level Full Time
Tasks
- Automate web scraping platform improvements
- Build alerting systems and investigate incidents
- Collaborate with analysts and stakeholders
- Design tools and applications for data products
- Design web scrapers
- Develop deploy and maintain data pipelines
- Implement data quality control checks
- Ingest data into databases and data warehouses
- Orchestrate workflows with Apache Airflow
- Transform and prepare datasets with Python and Pandas
Perks/Benefits
Skills/Tech-stack
APIs | AWS | AWS Lambda | Amazon RDS | Amazon S3 | Amazon SNS | Amazon SQS | Apache Airflow | CI/CD | Docker | GitHub Actions | HTML | JavaScript | Jenkins | Kubernetes | Pandas | Python | SQL | Scrapy | Selenium | XPath
Education
N/A
Roles
Related jobs
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Fully remote | Remote autonomy | Work flexibilitySenior-level Contract Full TimeUnited Arab Emirates R1d ago
-
🌎 Data Engineer, Remote - Full Time USD 140K-180KAI machine learning | AWS | Apache Spark | Machine Learning | NoSQL401k company match | Health insurance reimbursement | Paid time off | Remote-first workforceMid-level Full TimeInternational R2d ago
-
Lead AI Engineer AED 286K-360KAWS | Agentic AI | Azure | Continuous Deployment | Continuous integrationDental insurance | Flexible time off program | Global Employee Assistance Program EAP | Medical insurance | Paid HolidaysSenior-level Full TimeRemote Dubai, United Arab Emirates R7d ago
-
Senior Software Engineer, Applied AI (United Kingdom) GBP 132K-170KAI Agents | API Design | AWS | Audit trails | C#Company retreats | Wellness programSenior-level Full TimeRemote - International R8d ago
-
Senior Software Engineer, Applied AI (Netherlands) EUR 143K-184KAI Agents | API Design | AWS | Access patterns | Audit trailsCasual environment | Company retreats | Wellness programSenior-level Full TimeRemote - International R8d ago
-
Customer Success Engineer AED 240K-360KAWS | Application Lifecycle Management | Application lifecycle | Cloud infrastructure | Cloud platformDental insurance | Employee Assistance Program (EAP) | Flexible time off program | Medical insurance | Paid HolidaysSenior-level Full TimeRemote Dubai, United Arab Emirates R11d ago
-
🌐🔥Senior Software Engineer AED 168K-180KAlgorithms | C++ | Code review | Data Structures | DebuggingFlexible working hours | Part-time option | Remote workSenior-level Full TimeInternational R20d ago
-
Data Insights & Analytics Lead USD 120K-180KAmplitude | Blockchain Analytics | Contract analytics | Data Visualization | Dune AnalyticsCollaborative work culture | Dental insurance | Global team | Health insurance | Professional developmentSenior-level Full TimeCayman R22d ago
-
Senior AI Solutions Engineer - UAE AED 286K-360KAI Evaluation | AI Observability | AI tracing | APIs | Agent OrchestrationDental insurance | Employee assistance program | Flexible time off | Medical insurance | Paid HolidaysSenior-level Full TimeRemote Dubai, United Arab Emirates R1mo ago
-
Senior Data Scientist II - Personalization AED 120K-144KA/B | A/B Testing | Apache Spark | Attention Mechanism | B testingFitness reimbursements | Healthcare benefits | Remote work 30 days per year | Training classes access | Unlimited vacation daysMid-level Full TimeDubai, United Arab Emirates R1mo ago
-
Senior Data Engineer (Python) AED 300K-386KAPIs | Apache Airflow | Azure | Azure Data | Azure Data FactoryEmployment Visa | Flexible working environment | Hybrid work | Medical insuranceSenior-level Full TimeDubai, Dubai, United Arab Emirates (Hybrid) R1mo ago