Lead Data Engineer – AI & Foundation Models
Tasks
- Build data pipelines for batch and streaming
- Collaborate with platform teams on cloud native distributed processing
- Design scalable data pipelines for AI training and inference
- Enable feature engineering feature stores and training datasets
- Ensure data governance quality availability lineage and monitoring
- Implement data quality checks validation and alerts
- Implement secure data access controls and auditability
- Lead code and design reviews
- Manage data ingestion transformation and aggregation
- Mentor data engineers and provide technical direction
- Optimize data modeling schema management partitioning and performance
- Plan delivery estimate dependencies and manage risks
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Spark | Azure | CI/CD | Cloud platform | Data Governance | Data Lineage | Data Modeling | Data Partitioning | Data Quality | Feature Engineering | Feature Store | Google Cloud | Google Cloud Platform | Machine Learning | SQL | Schema management | Testing | Version control
Education
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Staff Forward Deployed Engineer, Google Cloud Consulting EUR 122K-125KAPIs | Agent systems | Cloud platform | CrewAI | Google CloudEquity | Health benefits | Performance bonus | Professional development | Relocation assistanceSenior-level Full TimeDublin, Ireland4h ago
-
AWS | Access Control | Access Management | Airflow | CI/CDCareer growth | Equity participation | Flexible work arrangements | Fully remote | High ownership and autonomyMid-level Full TimeIreland R10h ago
-
Senior-level Full TimeDublin, Ireland23h ago
-
Entry-level Full TimeDublin, Ireland23h ago
-
API Integration | ComfyUI | Control Mechanisms | ControlNet | Dataset PreparationFitness and wellness allowance | Fully remote | Home office equipment allowance | Learning Support | Medical insuranceSenior-level Full TimeIreland R1d ago
-
Senior Forward Deployed Engineer, GenAI, Google Cloud EUR 150K-153KAgent systems | Cloud platform | Cost Per | Cost Per Request | EvaluationSenior-level Full TimeDublin, Ireland; London, UK1d ago
-
Data Analytics Engineer (Payments) EUR 69K-105KDBT | Dagster | Data Analysis | Data Modeling | Data PipelinesMid-level Part TimeDublin, Ireland1d ago
-
Senior AI Engineer (m/f/x) EUR 54K-75KAI Governance | Apache Spark | Artificial Intelligence | CI/CD | Cloud platform30 days holiday | Bike4Work scheme | CSR Programme Support | Coaching | Continuous learningSenior-level Full TimeDublin, 2 Grand Canal Square, Ireland R1d ago
-
AI Native SW Engineer EUR 39K-57KAgent Orchestration | Anthropic API | Autogen | Braintrust | CI/CDEntry-level Full TimeDublin, 1 Grand Canal Square, Ireland1d ago
-
AI Engineer USD 95KAWS | Agent Frameworks | Azure | Crossplane | Function CallingHybrid work | Professional development opportunities | Remote flexibility | Supportive leadershipMid-level Full TimeDublin - Frame, Ireland R1d ago
-
Data Platform Engineer - Cybersecurity EUR 70K-105KAWS | AWS CloudFormation | Access Management | Alerting | AnsibleBlameless postmortems | Flexible work schedule | Hybrid work model | Remote work optionMid-level Full TimeIreland, Dublin1d ago
-
Agentic Workflows | Context engineering | Data Engineering | Distributed Systems | Fine TuningCareer development | Employee resource groups | Flexible work from home | Generous PTO | Paid volunteer timeSenior-level Full TimeIreland-Remote R1d ago
-
Associate TSE II EUR 61K-96KAWS | Application Architecture | Automation | Backup | BenchmarkingHybrid workingMid-level Full TimeDublin, Ireland2d ago
-
Data Platform Engineer - Data License Plus EUR 72K-98KASM | Alerting | Ansible | Auditing | Backup and RecoverySenior-level Full TimeDublin2d ago
-
Senior Developer - DevOps/MLOps EUR 71K-90K.NET | AI Act | AI Foundry | Access Control | Audit LoggingBike to work | Educational assistance | Employee assistance programme | Employee discount | Financial adviceSenior-level Full TimeDublin, County Dublin, Ireland2d ago
-
Datadog | Debugging | Distributed Systems | GPU Computing | GitHub ActionsFlexible work environment across Europe | Fully remote work | High ownership role | Professional growth opportunitiesSenior-level Full TimeIreland R2d ago
-
C++ | Cloud infrastructure | Control Systems | Data Pipelines | DeploymentCompany-provided laptop | Equity participation | Flexible stipends | Fully remote work | Health insuranceSenior-level Full TimeIreland R2d ago
-
API Integration | Agent systems | Cloud platform | Google Cloud | Google Cloud PlatformSenior-level Full TimeDublin, Ireland2d ago
-
API Integration | Azure | Azure AI | Context Management | Database IntegrationComprehensive benefits package | Exposure to cutting-edge AI technologies | Inclusive workplace culture | International team collaboration | Professional growth opportunitiesSenior-level Full TimeIreland2d ago
-
AWS | Azure | Cloud Computing | Data Analysis | Data PreparationAutonomy | Collaborative team environment | Continuous learning | Flexible working hours | Fully remoteMid-level Full TimeIreland R2d ago
-
Senior SIEM Data Engineer, Vice President EUR 60K-66KCI/CD | CIM | Cause analysis | Cribl Stream | Data EnrichmentSenior-level Full TimeKilkenny, Ireland2d ago
-
SIEM Data Engineer, Assistant Vice President EUR 71K-107KCSV | Cloud Storage | Cribl Stream | Data Enrichment | Data NormalizationEmployee networks | Flexible work/life support | Hybrid work | Inclusive development opportunities | Paid volunteer daysExecutive-level Full TimeKilkenny, Ireland2d ago
-
Applied AI Lead EUR 54K-75KArtificial Intelligence | Data Pipelines | Experimentation | Learning operations | Machine LearningHybrid workSenior-level Full TimeIRL Dublin, Ireland2d ago
-
Senior Software Engineer EUR 71K-107KAWS | AWS CodePipeline | Airflow | Apache Beam | Atlassian ConfluenceBirthday day off | Buy and sell holiday | Contributory pension | Cycle to work | Dining and leisure discountsSenior-level Full TimeIRL - Dublin, Ireland2d ago
-
Software Engineer EUR 42K-57KAPI Development | AWS | Cloud platform | Deep learning | Distributed SystemsRelocation benefitsMid-level Full TimeDublin LMR - Long Mile Works …2d ago