Senior Data Engineer - Web Scraping
Tasks
- Automate web scraping platform improvements
- Build data pipelines
- Clean transform datasets
- Collaborate with stakeholders
- Design web scrapers
- Implement data quality checks
- Improve data products
- Ingest data into databases
- Orchestrate workflows
- Set up alerting and incident response
Perks/Benefits
Skills/Tech-stack
APIs | AWS | AWS Lambda | Amazon RDS | Amazon S3 | Amazon SNS | Amazon SQS | Apache Airflow | Docker | GitHub Actions | HTML | JavaScript | Jenkins | Kubernetes | Pandas | Python | SQL | Scrapy | Selenium | XPath
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Amazon RDS | Amazon Redshift | Apache Airflow | Cause analysis | Data ModelingAnnual company retreats | Flexible working hours | Paid annual leave | Performance incentives | Premium equipmentSenior-level Full TimeIreland R21h ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Fully remote | Remote flexibilitySenior-level Contract Full TimeIreland R23h ago
-
AI Engineer EUR 53K-53KAWS | Azure | CI/CD | Computer Vision | Data AnalysisEnhanced leave options | Health and wellbeing supports | Pension and savings options | Training and coachingSenior-level Full TimeDublin, Ireland R2d ago
-
AWS | Apache Kafka | Automated testing | CI/CD | Caching100 percent remote | Company offsite weeks | Engineering Ownership | Flexible work location | High-growth environmentSenior-level Full TimeIreland R2d ago
-
Alerting | Data Pipelines | Distributed Systems | GPU Performance | InferenceMid-level Full TimeIreland R3d ago
-
LLM Application Engineer EUR 49K-67KAPIs | Agentic Workflows | Backend Development | Context engineering | DatabasesMid-level Full TimeIreland R3d ago
-
Senior AI Software Engineer EUR 39K-48K.NET | AI Foundry | AI Search | AKS | Access ControlHybrid work arrangement | Paid time offSenior-level Full TimeIRL Cork Albert Quay, Ireland R3d ago
-
Staff Engineer - Data Platform Experience EUR 86K-126KApache Kafka | Cloud Platforms | Cloud cost allocation | Cost Allocation | Developer ProductivityBest in class onboarding | Continuous career development | Cross departmental buddy program | Employee stock purchase plan | Hybrid workplaceSenior-level Full TimeDublin, Ireland; Madrid, Spain; Paris, France R3d ago
-
AI Research Engineer/Scientist (OpenVINO, NNCF) EUR 76K-120KOpenVINO | Pruning | PyTorch | Python | QuantizationHybrid work modelMid-level Full TimeIRL - Leixlip, Ireland R4d ago
-
Senior AI Engineer (Agents) EUR 39K-54KAI Agents | AWS | Azure | Best practices | CI/CDRemote/hybrid workSenior-level Full TimeCork, Ireland R6d ago
-
AI Agents | API Integration | Data Contracts | Data Modeling | Data PipelinesHybrid work model | Learning and development supportSenior-level Full TimeDublin, Ireland R6d ago
-
Dagster | Data Exploration | Deep learning | Fiona | GDALFlexible work across eligible locations | Fully remote work | Inclusive culture | International collaboration | Professional growthSenior-level Full TimeIreland R6d ago
-
Agent architecture | Cadence | Coverage analysis | Data Structures | Debug automationMid-level Full TimeDublin R6d ago
-
AWS | BigQuery | ClickHouse | Cloud infrastructure | Continuous ImprovementContinuous learning opportunities | Flexible location work | Inclusive workplace culture | Professional growth opportunities | Remote-friendly work environmentMid-level Full TimeIreland R7d ago
-
Senior AI Engineer – Notebooks EUR 70K-90KBackend Development | Evaluation | Go | LLM | Language ModelsEmployee stock purchase plan | Global health benefits | Hybrid workplace | Inclusive community culture | Mentor/Buddy programSenior-level Full TimeBordeaux, France; Dublin, Ireland; France, Remote; … R7d ago
-
AWS | AWS CloudFormation | AWS Glue | AWS Glue Catalog | AWS LakeCollaborative Agile environment | Flexible work location | Fully remote | Technical autonomySenior-level Contract Full TimeIreland R7d ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Contract opportunity | Fully remote | International collaborative environment | Ownership and influence | Part time to full time transition opportunitySenior-level Contract Full TimeIreland R8d ago
-
API Integration | AWS | Agile | Angular | EmbeddingsFlexible work options | Hybrid work environment | Inclusive culture | Professional development opportunitiesMid-level Full TimeDublin - Frame, Ireland R14d ago
-
AI Engineer USD 95KAWS | Agent Frameworks | Azure | Crossplane | Function CallingHybrid work | Professional development opportunities | Remote flexibility | Supportive leadershipMid-level Full TimeDublin - Frame, Ireland R15d ago
-
Lead, Finance Analytics & Enablement AI/ML EUR 50K-61KAmplitude | Business Intelligence | Cloud platform | Data Modeling | Data ScienceFlexdesk Access Pass | Travel stipend | Work from homeSenior-level Full TimeIreland - Remote R23d ago
-
Staff AI Engineer - 2nd Horizon | Ireland | Remote EUR 117K-147KAWS | Agent systems | Agentic Workflows | Cloud platform | Context engineeringAnnual leave policy | In-person onboarding | Remote workSenior-level Full TimeRepublic of Ireland (Remote) R28d ago
-
Data Platform Engineer EUR 45K-57KAirflow | ArgoCD | Avo | CI/CD | DBTCollaborative team | Hybrid work setupMid-level Full TimeAmsterdam; Dublin; Helsinki HQ R1mo ago
-
Senior Gen AI Developer USD 32K-32KAPI Integration | AWS | Agent Orchestration | Angular | Distributed SystemsHybrid work | Learning and development opportunities | Office based collaboration 3 days per week | Supportive leadershipSenior-level Full TimeDublin - Frame, Ireland R1mo ago
-
Senior-level Full TimeIreland - Dublin - Hybrid R1mo ago
-
Senior Software Engineer, Analytics Platform EUR 56K-88KAWS | Ansible | Apache Druid | Apache Flink | Apache KafkaCareer development | Dental plan | Hybrid work options | Mentoring | Paid Maternity LeaveSenior-level Full TimeVirtual Office (Ireland) R1mo ago