Senior Data Engineer - Web Scraping
Tasks
- Automate web scraping platform improvements
- Build data pipelines
- Clean and transform large datasets
- Collaborate with analysts and stakeholders
- Design data products and tools
- Design web scrapers
- Develop scheduled data delivery
- Implement data quality checks
- Orchestrate workflows with Apache Airflow
- Set up alerting and incident response
Perks/Benefits
Skills/Tech-stack
APIs | AWS Lambda | AWS RDS | AWS S3 | AWS SNS | AWS SQS | Apache Airflow | CI/CD | Docker | GitHub Actions | HTML | JavaScript | Jenkins | Kubernetes | Pandas | Python | SQL | Scrapy | Selenium | XPath
Education
Roles
Related jobs
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Autonomy | Collaborative multidisciplinary teams | Fully remote | Remote flexibilitySenior-level Contract Full TimeTurkey R1d ago
-
Senior Azure/Fabric Data Engineer | KD Pharma UAH 1377K-1549KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Gen2 | Azure DevOpsClient facing advisory | Hands-on implementationSenior-level Full TimeRemote (Europe-based candidates only) R9d ago
-
APIs | Automation | ComfyUI | ControlNet | DiffusersFitness allowance | Home-office equipment | Learning opportunities | Medical insurance coverage | Paid vacationSenior-level Full TimeAnkara, Remote, TR R15d ago
-
Analytics Engineer CAD 110K-135KDBT | DBT Cloud | DBT Core | Data Modeling | Data PipelinesAsynchronous collaboration | Flexible hours | Remote-first setup | Work-life integrationMid-level Full TimeKOHO (CAN) R16d ago
-
Senior-level Full TimeIstanbul, İstanbul, Turkey - Remote R19d ago
-
Senior-level Full Timeİstanbul, Turkey - Remote R25d ago
-
Senior AI/LLM Data Scientist in Agentic AI TRY 840K-1080KAPI Integration | Embeddings | Evaluation | Fine Tuning | Generative AIEnglish Language Development Support | Hybrid work | Meal card | Multisport membership | Private health insuranceSenior-level Full TimeIstanbul (VADI ISTANBUL PARK), Türkiye R1mo ago
-
Auto Scaling | CI/CD | CUDA | Container Orchestration | Distributed SystemsEnglish language support | On-call support | Remote workSenior-level Full TimeUkraine R1mo ago
-
AI Engineer TRY 400K-570KAsynchronous programming | BigQuery | CI/CD | Claude | Cloud NativeCareer opportunities | English Language Development Support | Health insurance | Hybrid work | Meal cardMid-level Full TimeIstanbul (VADI ISTANBUL PARK), Türkiye R1mo ago
-
AI Engineer TRY 400K-570KAgent systems | Arize | Asynchronous programming | BigQuery | CI/CDCareer opportunities | English Language Development Support | Health insurance | Hybrid work | Meal cardMid-level Full TimeIstanbul (VADI ISTANBUL PARK), Türkiye R1mo ago