Data Engineer - Web Scraping
Tasks
- Build automated data collection workflows
- Clean transform validate datasets
- Create scalable data processing pipelines
- Design web scraping systems
- Develop data ingestion pipelines
- Develop internal automation tools
- Implement data quality control checks
- Investigate data pipeline incidents
- Schedule and monitor scraping workflows
Perks/Benefits
Skills/Tech-stack
APIs | AWS | AWS Lambda | Amazon RDS | Amazon S3 | Amazon SNS | Amazon SQS | Apache Airflow | CI/CD | Data Warehousing | Docker | GitLab | HTML | JavaScript | Jenkins | Kubernetes | Pandas | Python | SQL | Scrapy | Selenium | XPath
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
API Gateway | AWS Bedrock | AWS Lambda | Amazon API | Amazon API GatewayFlexible working hours | Mentoring | Professional developmentSenior-level Full TimeRa'anana, Center District, IL20h ago
-
Senior Machine Learning Engineer USD 150K-200KAPI Development | AWS SageMaker | Data Pipelines | FastAPI | Feature EngineeringSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL20h ago
-
Computer Vision | Deep learning | Language Processing | Machine Learning | Model OptimizationMid-level Full TimePetach – Tikva, Israël22h ago
-
Airflow | Apache Kafka | Apache Spark | Bash | CI/CDSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL23h ago
-
AI Agents | API Development | Anomaly Detection | Data Engineering | Data PipelinesSenior-level Full TimeIsrael, Yokneam1d ago
-
Senior-level Full TimeTel Aviv-Yafo, Israel, IL1d ago
-
Mid-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL1d ago
-
Mid-level Full TimeRa'anana, Center District, IL1d ago
-
3D Object Detection | 3D Perception | 3D Reconstruction | C++ | Computer VisionMid-level Full TimeRamat Gan, Israel1d ago
-
Assembly | C# | C++ | CPU Benchmarking | Embedded LinuxSenior-level Full TimePetah Tikva, Israel1d ago
-
Mid-level Full TimeBinyamina-Giv'at Ada, Haifa District, IL1d ago
-
Software Engineer, Infrastructure GBP 180K-225KAI | Agent Orchestration | Bias Mitigation | C# | C++Senior-level Full TimeZurich, Switzerland | Tel Aviv, Israel …2d ago
-
3D Reconstruction | Behavior Modeling | Computer Vision | Deep learning | Machine LearningSenior-level Full TimeRamat Gan, Israel2d ago
-
Senior-level Full TimeTel-Aviv2d ago
-
Agent Frameworks | Bash | CI/CD | Cloud Computing | ContainerdSenior-level Full TimeIsrael, Yokneam2d ago
-
Machine Learning Developer USD 80K-127KComputer Vision | Deep learning | Model Evaluation | Model Training | NumPyEntry-level Full TimeTel Aviv-Yafo, Israel, IL2d ago
-
Senior-level Full TimeTel Aviv2d ago
-
API Design | Analytical Engine | Automated testing | CI/CD | Cloud platformMid-level Full TimeRamat Gan, Israel, IL2d ago
-
AWS | Apache Kafka | Capacity Planning | Distributed Systems | Fault ToleranceSenior-level Full TimeTel Aviv/ Hybrid (Israel), Israel R2d ago
-
DevOps Team Leader - Infra and DevEx ILS 420K-504KAI Agents | AI coding | AI coding tools | AWS EKS | AWS IAMDevelopment programs | Flexible work schedule | Hybrid work | Mental health insurance | Occasional long weekendsSenior-level Full TimeBnei Brak, Tel Aviv District, IL2d ago
-
Reindeer- Software Engineer (Infrastructure) USD 180K-250KAPI Integration | AWS | Authentication | Authorization | AzureSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL2d ago
-
Reindeer- AI Solutions Engineer (IL) USD 80K-170KApplication Integration | Cloud Computing | Communication | Compliance | Data AnalysisSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL2d ago
-
AI Agents | Agents SDK | Claude Agents SDK | Cloud Computing | ContainersMid-level Full TimeHerzliya, Tel Aviv District, IL3d ago
-
Alerting | Amazon Aurora | Amazon Aurora PostgreSQL | Amazon Redshift | Aurora PostgreSQLFully remoteSenior-level Full TimeIsrael R3d ago
-
Agentic AI | Automated Evaluation | Benchmarking | Cloud | Data GovernanceSenior-level Full TimeIsrael, Yokneam3d ago