Data Engineer - Web Scraping
Tasks
- Build data ingestion pipelines
- Build web scrapers for structured and unstructured sources
- Clean transform validate and manipulate datasets
- Design automated data collection systems
- Develop internal tools and automation frameworks
- Implement data quality control checks
- Implement scalable data processing workflows
- Investigate and resolve data pipeline incidents
- Schedule monitor and optimize scraping workflows
Perks/Benefits
- Autonomy
- Collaborative culture
- Continuous learning
- Exposure to modern technologies
- Flexible technology focused environment
- High ownership
- Merit driven culture
- Professional growth
Skills/Tech-stack
APIs | AWS | Apache Airflow | CI/CD | Docker | GitLab CI | GitLab CI/CD | HTML | JavaScript | Jenkins | Kubernetes | Lambda | Pandas | Python | RDS | S3 | SNS | SQL | SQS | Scrapy | Selenium | Web Scraping | XPath
Education
Roles
Related jobs
-
API Design | Command Line | Command-line interfaces | Data Modeling | Database systemsCompany-provided equipment | Continuous learning allowance | Flexible working hours | Fully remote work | Health insurance allowanceSenior-level Full TimeItaly R1d ago
-
Machine Learning Engineer (ELE-ST) EUR 32K-40KC++ | Continuous integration | Foundation Models | Git | JenkinsHybrid working | Meal allowance | Training and professional development | Welfare benefitsEntry-level Full TimeIT - Roma - Via Tiburtina …1d ago
-
AWS Fargate | AWS Lambda | AWS Step Functions | Amazon ECS | Amazon KinesisHybrid work | Remote work | Work permit supportMid-level Full TimeMilano, Italy2d ago
-
Data Engineer Business Intelligence EUR 35K-45KAWS | AWS Glue | Amazon Redshift | Azure | Cloud platformHealth insurance | Meal vouchersMid-level Full TimeBOLOGNA, EMILIA ROMAGNA, Italy2d ago
-
A/B | A/B Testing | AWS | Alerting | AutoscalingFully remote within Europe | Healthcare coverage | Paid parental leave | Professional growth | Relocation assistanceMid-level Full TimeItaly R2d ago
-
Individual Giving Data Engineer EUR 35K-39KAmazon Web Services | Apache Airflow | Apache Kafka | Cloud platform | DBTFully remoteMid-level Full TimeRome, Italy R2d ago
-
Automation & Robotics Engineer EUR 43K-65KAutoCAD | C plus plus | Lean Manufacturing | PLC programming | PTC CreoAccident insurance | Business travel support | Canteen access | Employee assistance program | Employer pension contributionSenior-level Full TimeNoventa di Piave, Italy2d ago
-
AI Assisted Development | Claude Code | Code review | Cursor | JavaScriptFlexible hours | Ongoing project based workSenior-level Full TimeMiami2d ago
-
Alerting | Amazon Aurora | Amazon Aurora PostgreSQL | Amazon Redshift | Aurora PostgreSQLCross-functional collaboration | Exposure to modern data validation frameworks | Fully remote work | Ownership over data reliability strategySenior-level Full TimeItaly R3d ago
-
AI & Data Science Consultant EUR 38K-38KAI Act | AI Governance | AI guardrails | Automated Deployment | CI/CDContinuous learning programs | Employee discounts program | Employee referral program | Health insurance | Life and permanent disability by accident coverageEntry-level Full TimeIT306 - DXC Paolo Di Dono …3d ago
-
Data Engineer Junior - Cloud Data Service Hub EUR 35K-35KAI Algorithms | Apache Kafka | Apache Spark | Continuous Delivery | Continuous DeploymentAdditional retirement benefits | Banking product discounts | Company welfare benefits | Flexible work | Health insuranceEntry-level Full TimeTorino - Milano - Napoli, IT3d ago
-
Apache Flink | Apache Spark | Azure | Cloud platform | Continuous DeliveryComplementary Pension | Flexible work | Health insurance | Professional development | Training opportunitiesEntry-level Full TimeTorino - Milano - Napoli, IT3d ago
-
C# | Digital Signal | Digital Signal Processing | Embedded firmware | Model OptimizationNone Full TimeAgrate Brianza, Italy6d ago
-
Audio Processing | Deep learning | Digital Signal | Digital Signal Processing | PyTorchSenior-level Full TimeAgrate Brianza, Italy6d ago
-
Engineering - Internal AI Transformation USD 74K-110KAPIs | Agentic Workflows | Auditability | Authentication | DockerAnnual company offsite | Co-working stipend | Learning and development stipend | Social travel stipendEntry-level Full TimeUnited States R6d ago
-
AI Data Engineer EUR 33K-40KAccess Management | Amazon Web Services | Apache Airflow | Apache Spark | AzureLanguage Learning ProgrammeMid-level Full TimePORCARI, LUCCA, 550166d ago
-
Robotics Engineer BRL 50K-70KCollaborative robots | Control Systems | Dynamics | Electromechanical Systems | Git401k company match | Flexible PTO | Green card sponsorship | H1B sponsorship | Medical, dental, vision plansMid-level Full TimeMilan/Pavia/Turin6d ago
-
Auto Scaling | Blue-Green Deployment | Blue/green | CI/CD | CUDAFlexible remote work | Fully remote | Growth opportunities | High ownership and influence | Meaningful technical impactSenior-level Full TimeItaly R6d ago
-
Cloud Computing | Data Catalog | Data Governance | Data Lineage | Data ModelingMid-level Full TimeBozen (IT), Priorität 17d ago
-
AWS | Cloud platform | Data Ingestion | Data Pipelines | Data VisualizationDiscounts and Conventions | Free TV access | Gym access | Health insurance | Hybrid workingSenior-level Full TimeMilan Monte Penice, Italy7d ago
-
Senior Data Engineer EUR 45K-60KAWS Glue | AWS IAM | AWS Kinesis | AWS Lambda | AWS S3Continuous improvement culture | Cross-functional collaboration | Hybrid work environmentSenior-level Full TimeSAN DONATO MILANESE (MI), Italy7d ago
-
Data Engineer EUR 30K-40KAWS Glue | AWS S3 | Amazon Redshift | Apache Airflow | Apache SparkHybrid work scheduleMid-level Full TimeSAN DONATO MILANESE (MI), Italy7d ago
-
Platform Engineer II - Build EUR 80K-105KArgo CD | Buildkite | CI/CD | Containerization | DebuggingCross-functional collaboration | Performance reviews | Professional developmentMid-level Full TimeMilan7d ago
-
Junior AI Engineer – NextHub Bari EUR 22K-25KData Processing | Data Processing Pipelines | Deep learning | Feature Engineering | Fine TuningHybrid workEntry-level Full TimeBari7d ago
-
Deep AI Native Software Engineering EUR 28K-36KC++ | Computer Vision | Data Pipelines | Data Preprocessing | Data RetrievalEntry-level Full TimeAssago, Via del Mulino 11a, Italy8d ago