Sr Manager, Batch & Streaming Infra
Tasks
- Coordinate with data engineering data science and product teams
- Define and enforce SLA and SLO targets
- Drive data security and governance automation
- Execute large scale infrastructure migrations
- Lead batch processing infrastructure scaling and upgrades
- Manage and mentor Platform Engineers
- Optimize data lakehouse storage and open table formats
- Own real time streaming platform architecture and reliability
- Perform infrastructure cost optimization and capacity planning
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Flink | Apache Iceberg | Apache Kafka | Apache Spark | Data Cataloging | Data Governance | Data Security | Delta Lake | Docker | Encryption | Go | HDFS | Hadoop | Infrastructure as Code | Java | Kubernetes | Presto | Python | SLA SLO | Scala | Trino | “as-code”
Education
N/A
Related jobs
-
Manager of Software Engineering (AI Tooling) EUR 60K-73KAWS | Agile | Cloud Native | Continuous Delivery | Continuous integrationMid-level Full TimeDublin, Ireland1d ago
-
Senior Manager, AI Enablement & Data Governance EUR 84K-157KArtificial Intelligence | Automation | Data Governance | Data Quality | Data-Driven SolutionsSenior-level Full TimeDublin (NOCC), Ireland7d ago
-
Senior Manager, AI Enablement & Data Governance EUR 84K-157KArtificial Intelligence | Automation | Compliance | Data Governance | Data QualityHybrid work | Relocation support not availableSenior-level Full TimeDublin (NOCC), Ireland7d ago
-
Director, Data engineering USD 170K-305KAWS | Apache Kafka | Apache Spark | DBT | Data ArchitectureExecutive-level Full TimeDublin, Ireland (Mountain View)9d ago
-
ADR | AI Assisted Development | AWS | Agile | Automated testingMid-level Full TimeDublin Office, Ireland9d ago
-
Senior Specialist - Portfolio Health EUR 55K-65KAPIs | Artificial Intelligence | Compliance Management | Dashboards | Data GovernanceSenior-level Full TimeDublin, Ireland11d ago
-
Data Quality Lead EUR 93K-139KData Controls | Data Governance | Data Lineage | Data Management | Data MonitoringEmployee assistance programme | Family leave options | Healthcare Scheme | Hybrid working | Pension schemeSenior-level Full TimeDublin, IE, IE13d ago
-
AI Lead, Manufacturing & Supply Chain EUR 84K-84KALCOA plus | Anomaly Detection | Artificial Intelligence | CSA | CSVHybrid work | In office minimum three days per week | Reasonable accommodationsSenior-level Full TimeIreland - Dublin College Park14d ago
-
Senior-level Full TimeIreland - Dublin College Park14d ago
-
Sr. Software Eng, Data Platforms EUR 70K-90KABAC | Amazon S3 | Apache Airflow | Apache Flink | Apache IcebergCareer development | Conference support | Global benefits | Hybrid remote friendly | Learning resources supportSenior-level Full TimeDublin, Ireland15d ago
-
APIs | Amazon Web Services | Azure | CI/CD | Cloud platformAdditional annual leave | Bike to work scheme | Discounted health insurance | Gym membership | Hybrid workingSenior-level Full TimeDublin 2, IE17d ago
-
Model Risk and Validation Lead EUR 55K-73KArtificial Intelligence | Bias Mitigation | Continuous Monitoring | Explainability | FairnessSenior-level Full TimeDublin, Ireland21d ago
-
Director of AI Engineering EUR 85K-128KArtificial Intelligence | Bias Assessment | Embeddings | Fine Tuning | Generative AIExecutive-level Full TimeDublin, Ireland21d ago
-
AI Governance | Access Management | Breach response | Data Architecture | Data BreachAdditional annual leave | Bike to work scheme | Discounted health insurance | Flexible working | Free gym membershipSenior-level Full TimeDublin 2, IE28d ago
-
AWS | Automation | Capacity Planning | Crossplane | Data MigrationSenior-level Full TimeCork30d ago
-
Director, Merchant Risk Data Science EUR 85K-110KAWS SageMaker | Anomaly Detection | Autoencoders | Data Pipelines | Deep learningBuy/sell holiday | Charity days | Dental insurance | Discounts on gym and leisure | Flexible working hoursExecutive-level Full TimeDublin, Ireland, IE, D01 K8401mo ago
-
Senior Manager Data Architecture and AI EUR 56K-84K.NET | AWS | Access Management | Analytics hub | AutomlAccess to coaching and certifications | Discounted Corporate Gym Membership | Free Onsite Breakfast & Lunch | Healthcare | Learning development and trainingSenior-level Full TimeIRL Dublin Office Hanover Quay, Ireland1mo ago
-
AWS CloudFormation | AWS Glue | AWS Lake Formation | AWS Lambda | AlertingCareer development | Dental plan | Financial planning resources | Flexible-hybrid work | Income protectionSenior-level Full TimeVirtual Office (Ireland) R1mo ago
-
Conformance management | Corrective Action | Corrective Action Preventive Action | Dashboards | Data DictionarySenior-level Full TimeIE - Cork, Ireland1mo ago
-
Engineering Manager, Data Engineering EUR 68K-84KAmazon Redshift | Apache Airflow | BigQuery | CI/CD | DBTCompany events | Health & dental care | Hybrid work | Paid parental leave | Paid sabbaticalMid-level Full TimeGalway, Ireland1mo ago