Data Engineer - Web Scraping
Tasks
- Automate data processing workflows
- Build orchestration workflows
- Clean transform validate datasets
- Design web scraping systems
- Develop internal automation tools
- Develop web scrapers
- Implement data quality control checks
- Investigate pipeline issues
- Maintain data ingestion pipelines
- Schedule monitor optimize scraping jobs
Perks/Benefits
- Collaborative team culture
- Continuous learning opportunities
- Flexible work environment
- High ownership autonomy
- Merit driven culture
- Professional growth opportunities
Skills/Tech-stack
API | AWS | AWS Lambda | Amazon RDS | Amazon S3 | Amazon SNS | Amazon SQS | Apache Airflow | CI/CD | Docker | GitLab CI | GitLab CI/CD | HTML | JavaScript | Jenkins | Kubernetes | Pandas | Python | SQL | Scrapy | Selenium | Web Scraping | XPath
Education
Roles
Data Engineer | Engineer | Scraping Engineer | Web Scraping Engineer
Related jobs
-
Analytical Chemistry | Chemometrics | MATLAB | Multivariate analysis | Near InfraredInternational team experience | Training includedEntry-level Full TimeLACQ-PERL(FRA), LACQ, France22h ago
-
Consultant Data Expert Databricks (F/H) EUR 50K-55KAmazon Web Services | Apache Airflow | Apache Spark | Azure | Azure DataEmployee stock ownership | Health insurance paid | Return To Work After Maternity Reduced Schedule | Training courses | Vacations bonusSenior-level Full TimeNantes, Pays de la Loire, France1d ago
-
Evaluation metrics | Figma | Language Processing | Natural Language | Natural Language ProcessingEntry-level Apprenticeship Full TimeAubervilliers, IDF, France1d ago
-
Consultant Microsoft Data Engineer (H/F) EUR 50K-55KAzure AI | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeLyon, Auvergne-Rhône-Alpes, France1d ago
-
Data Engineer Expérimenté F/H EUR 34K-45KBigQuery | CI/CD | Cloud platform | Composer | Data GovernanceCareer development | Geographic mobility | Mentorship | Remote work flexibility | Training programSenior-level Full TimeParis La Défense, FR, 920371d ago
-
AI Large Language Model (LLM) Engineer EUR 42K-60KAgentic AI | Audit Logging | Content Moderation | Deep learning | EmbeddingsMid-level Full TimeParis, Axe France1d ago
-
Alternance Data Analytics & AI (H/F) EUR 41K-55KArtificial Intelligence | Big Data | Data Science | Data analytics | Machine LearningActionnariat salarié | Mutuelle familiale avantageuse | Programme Share for You | Restaurant d'entreprise | Télétravail 2 jours par semaineEntry-level Apprenticeship Part TimeEurope, France, Ile de France, CERGY-PONTOISE R1d ago
-
Director, Generative AI Experience Engineering EUR 130K-200KAI guardrails | AWS | Agent systems | Azure | CI/CDHybrid work | In office required daysExecutive-level Full TimeParis1d ago
-
Analytics Engineer - Pricing data (f/m/d) EUR 48K-48KAWS | Airflow | BigQuery | CI/CD | DBTProvided equipment | Remote work | Technical certifications | Training and developmentEntry-level Full TimeLille, Upline, Nord, France R1d ago
-
AI Engineer – Consultant·e confirmé·e / senior EUR 55K-60KAnthropic | Azure | Bash | Cloud platform | Data PipelinesCareer development plan | Certification budget | Employee profit-sharing | Health insurance coverage | Internal coachingSenior-level Full TimeParis, France1d ago
-
AI Search | AWS | Agents | Amazon Bedrock | AsyncioAgile environment | Career growth | Client exposure | Professional developmentMid-level Full TimeNantes, Pays de la Loire, France2d ago
-
Ingénieur Big Data (F/H) EUR 50K-70KApache Kafka | Apache Spark | Big Data | Data Ingestion | Distributed ComputingFlexible internal work modes | Parental leave support | Telework 3 days per week | Training and ASI AcademyMid-level Full TimeRennes, Brittany, France R2d ago
-
AI Search | AWS | Agents | Asyncio | AzureMid-level Full TimeRennes, Brittany, France2d ago
-
DBT | Generative AI | Python | SQL | SnowflakeTraining opportunitiesSenior-level Full TimeLevallois Perret, Île-de-France, France2d ago
-
Stage 6 mois - Data Engineer H/F EUR 22K-22KData Modeling | Data Quality | Data Warehouse | ETL | GitHealth insurance | Meal tickets | Paid internship support | Work-life balanceEntry-level Full TimeParis, IDF, France2d ago
-
Transport Automation & Analytics Expert EUR 45K-70KAI | Analytics | Automation | BigQuery | Data Modeling1Password Family Account | Health insurance | Hybrid work model | Remote work day per weekSenior-level Full TimeLyon2d ago
-
Data Scientist Apprentice EUR 14K-20KAI Agents | APIs | AWS | Automation Scripts | Azure AIInclusion support | Multicultural environment | Online and in-person trainingEntry-level ApprenticeshipPARIS TECH CENTER, J, FR2d ago
-
AWS | Autoscaling | Azure | Bash | CI/CDEquity package | Fully remote work within Europe | Healthcare coverage | Paid parental leave | Relocation assistanceMid-level Full TimeFrance R2d ago
-
CI/CD | CPU | Computer Vision | Data Augmentation | Deep learningHybrid work | Occasional remote work | Professional mentorshipMid-level Full TimeParis, France R2d ago
-
AWS | Agentic AI | Azure | Cloud infrastructure | DashDigital communication support | Humanitarian involvement | R and D support | RSE engagement | Technology learningMid-level Full TimeParis, France2d ago
-
Mid-level Full TimeParis, France2d ago
-
Airbyte | DBT | DBT Cloud | Data Modeling | Data WarehousingRemote work 3 days per week | Structured onboardingExecutive-level Full TimeParis, France R2d ago
-
Senior-level Full TimeParis, France2d ago
-
Airbyte | Basedash | BigQuery | DBT | DBT CloudAutonomy | Fast recruitment process | Flexible remote work | Open office in ParisMid-level Full TimeParis, France R2d ago
-
Azure DevOps | Back-end | Back-end development | Data Modeling | DevOpsCompany events | Telework 2 days per weekMid-level Full TimeParis, France R2d ago