Senior Data Engineer — Lab Data Pipelines & Data Mesh
Location: Dublin, Ireland
EUR 60K-89K (estimate) Senior-level Full Time
Tasks
- Build lab to cloud connectivity
- Collaborate with cross functional stakeholders to deliver adopted capabilities
- Create APIs datasets and curated views for scientists
- Curate and publish domain data products
- Define standardized schemas for lab data
- Design and deliver automated data pipelines
- Embed auditability data integrity and access controls
- Implement ELN to mesh extraction
- Implement logging alerting lineage retries and runbooks
- Integrate heterogeneous data sources
Perks/Benefits
- N/A
Skills/Tech-stack
AI | AWS | Access Control | Data Ingestion | Data Modeling | Data Transformation | Data Validation | Data pipeline | Data pipeline orchestration | Databricks | Delta Lake | EC2 | EKS | Glue | IAM | Lineage | Logging | Machine Learning | Monitoring | Pipeline Orchestration | Python | REST API | Role-Based Access | Role-Based Access Control | S3 | SQL
Education
Roles
Related jobs
-
DPO | Data Pipelines | Deployment Workflows | Distributed Training | Evaluation FrameworksFlexible working across eligible locations | Long-term growth opportunities | Mentoring and team collaboration | Remote-first environment | Significant ownershipSenior-level Full TimeIreland16h ago
-
Alerting | Batching | Caching | Distributed Systems | DockerAutonomy | Continuous learning | Professional growth | Remote work flexibilitySenior-level Full TimeIreland R18h ago
-
Data Analyst, Product GBP 95K-124KA/B | A/B Testing | Analytical Functions | Apache Airflow | B testingSenior-level Full TimeUnited Kingdom3d ago
-
Senior-level Full TimeDublin3d ago
-
Attention Mechanisms | Batching | CUDA | Compute Graphs | Distributed SystemsDirect product impact | Engineering focused culture | Flexible remote work | Ownership & autonomySenior-level Full TimeIreland3d ago
-
APIs | Agent systems | Cost Optimization | CrewAI | Data ProcessingSenior-level Full TimeDublin, Ireland3d ago
-
Adversarial Testing | Bias Assessment | Experiment tracking | Factual consistency | Hallucination detectionContract opportunity | Remote work flexibilitySenior-level Contract Full TimeIreland R3d ago
-
BF16 | Backpropagation | Checkpointing | Data parallelism | DeepSpeedContinuous learning | Equity opportunities | Experimentation culture | Fast feedback loops | High ownershipMid-level Full TimeIreland3d ago
-
Deep learning | Distributed Training | Experiment tracking | GPU Computing | Inference OptimizationAsync-first culture | Equity opportunities | High ownership | Remote-friendlySenior-level Full TimeIreland3d ago
-
ADK | APIs | Agent Development | Agent Development Kit | Agent systemsAccess to research and engineering experts | Collaborative culture | Travel opportunitiesSenior-level Full TimeDublin, Ireland4d ago
-
AI Data | AI Data Security | AISPM | AWS | AzureLong-term contract | Onsite work in DublinMid-level Full TimeDublin, Ireland4d ago
-
API Integration | Cloud Data | Cloud Data Warehouse | Data Contracts | Data IngestionCollaborative environment | Flexible working hours | Fully remote | High autonomy | Professional growth opportunitiesSenior-level Full TimeIreland R4d ago
-
Software Senior Engineer (Performance) EUR 82K-124KAI | API Design | Anomaly Detection | C# | C++Bonus programs | Career development opportunities | Employee benefits | Employee resource groups | Flexible work arrangementsSenior-level Full TimeCork, Co. Cork, Ireland4d ago
-
AI Research Engineer/Scientist (OpenVINO, NNCF) EUR 76K-120KDeep learning | Network Compression | Neural Network | Neural Network Compression | OpenVINOHybrid work model | On site and off site work optionMid-level Full TimeIRL - Leixlip, Ireland4d ago
-
Agentic AI - Lead Software Engineer EUR 48K-62KAI SDK | Agentic AI | Agents SDK | Automation | CI/CDSenior-level Full TimeDublin, Ireland4d ago
-
Agentic AI - Senior Software Engineer EUR 48K-62KAI SDK | AI orchestration | Agentic AI | Agents SDK | AutomationSenior-level Full TimeDublin, Ireland4d ago
-
Senior Engineer, Embedded Software EUR 54K-72KARM | Abstraction layer | Agile | Automated testing | BashCareer growth | Mentorship | Technical leadershipSenior-level Full TimeIreland, Cork4d ago
-
QA Testing Specialist Data Engineer EUR 48K-61KAzure | CI/CD | Data Quality | Data Validation | Data WarehouseHybrid work model | Office commute requirementMid-level Full TimeTralee, IE4d ago
-
Mid-level Full TimeDublin, 1 Grand Canal Square, Ireland4d ago
-
Embedded Software Test Engineer EUR 43K-70KAgile | Automated testing | Bitbucket Pipelines | Bug tracking | C#Career growth | Comprehensive benefits package | Flexible work schedulesMid-level Full TimeGalway, Ireland5d ago
-
A/B | A/B Testing | B testing | Data Pipelines | Data version controlAnnual leave policy | Global culture | Remote work | Restricted stock unitsSenior-level Full TimeRepublic of Ireland (Remote) R5d ago
-
APIs | AWS | AWS Lambda | Amazon RDS | Amazon S3Continuous learning | Flexible work arrangements | High ownership | Professional growthSenior-level Full TimeIreland5d ago
-
API | API Design | Backend architecture | Command Line | Command-line InterfaceCompany-provided equipment | Continuous learning allowance | Flexible working hours | Fully remote | Health insurance allowanceSenior-level Full TimeIreland R5d ago
-
APIs | AWS | Angular | Azure | Cloud ComputingChildcare | Company health insurance | Continuing education | Convert Pay To Time Off | Flexible working hoursMid-level Full TimeMünster, DE5d ago
-
Senior-level Full TimeCork, Ireland; Dublin, Ireland6d ago