Senior Data Platform Engineer (Spark, AWS, Apache Iceberg, Production Systems)
Virtual Office (Ireland)
R
EUR 56K-85K (estimate) Senior-level Full Time
Tasks
- Design build maintain high scale data ingestion pipelines
- Develop reliable scalable backend services
- Diagnose resolve system failures end to end
- Ensure scalability availability latency security and compliance
- Evaluate adopt new technologies and drive operational excellence
- Implement unit integration and end to end tests in CI CD
- Lead system design architecture discussions and code reviews
- Mentor teammates and share engineering testing best practices
Perks/Benefits
- Career development
- Dental plan
- Financial planning resources
- Flexible-hybrid work
- Income protection
- Life assurance
- Maternity leave
- Mentorship opportunities
- Paternity leave
- Pension scheme
- Private health insurance
- Remote flexibility
- Wellness support
Skills/Tech-stack
AWS CloudFormation | AWS Glue | AWS Lake Formation | AWS Lambda | Alerting | Amazon IAM | Amazon S3 | Amazon SNS | Amazon SQS | Amazon Web Services | Apache Iceberg | Apache Spark | CI/CD | Code review | Data Catalog | Data Governance | Data Lake | Data Modeling | Distributed Systems | ETL | End to End | End-to-End Testing | Fault Tolerance | Git | Gradle | HIPAA | Integration Testing | Java | JavaScript | Lake Formation | Logging | Maven | Messaging Systems | Microservices | Monitoring | PySpark | Pytest | Python | REST API | Scala | Serverless | Synchronization | Tox | Unit Testing | Web Services
Education
Related jobs
-
API Integration | Anomaly Detection | Containerization | Data Modeling | Data Pipelines100 percent remote work | Career growth | Flexible work environment | Global collaboration opportunitiesMid-level Full TimeIreland R16h ago
-
AWS | Alerting | Amazon SageMaker | CI/CD | Cloud ArchitectureCareer growth opportunities | Collaborative international teams | Flexible employment options | Inclusive workplace | Remote-first work environmentSenior-level Full TimeIreland R1d ago
-
Accelerate | Data Analysis | Deep learning | Diffusers | Distributed SystemsAutonomy and ownership | Career growth opportunities | Continuous learning | Flexible work environment | Fully remoteMid-level Full TimeIreland R1d ago
-
Data Curation | Deep learning | Distributed machine learning | GPU Training | JAXFlexible work schedule | Fully remote | High-performance computing access | Professional growth opportunitiesSenior-level Full TimeIreland R1d ago
-
AWS | Azure | Bash | Caching | Cloud platformEquity via restricted stock units | Home office stipend | Pension plan | Private healthcare | Remote work supportSenior-level Full TimeIreland R5d ago
-
AWS | AWS Bedrock | AWS SageMaker | Computer Vision | Data IngestionFlexible scheduling | Fully remote | Inclusive team culture | Paid training | Professional development supportMid-level Full TimeIreland R5d ago
-
AI Software Engineer II (R-18544) EUR 42K-67KAgentic Workflows | CI/CD | Container Orchestration | Debugging | FastAPIEducational assistance program | Employee Health Insurance | Family-friendly leave | Flexible working (hybrid model) | Life assuranceMid-level Full TimeDublin - Ireland R6d ago
-
Machine Learning Developer (Freelance) USD 116K-116KLLM | Langchain | MLOps | Machine Learning | NumPyPart-time project-based workMid-level FreelanceIreland - Remote R6d ago
-
Senior Platform Engineer, Storage EUR 96K-125KAWS | Argo CD | Azure | Bash | DatadogCompany RSUs | Home office stipend | Pension plan with employer match | Private healthcare | Unlimited vacationSenior-level Full TimeIreland - Remote R7d ago
-
Freelance Data Science Engineer (Python & SQL) USD 116K-116KLLM | Langchain | MLOps | Matplotlib | NumPyFreelance assignments | Part-time engagement | Project based workMid-level FreelanceIreland - Remote R7d ago
-
Senior-level Full TimeIreland - All - Fully Flexible R7d ago
-
Freelance Machine Learning Engineer USD 116K-116KLangchain | Language Models | Large Language Models | MLOps | Machine LearningFlexible schedule | Part-time availability | Project based workMid-level FreelanceIreland - Remote R7d ago
-
API Integration | Airflow | Anomaly Detection | BI Dashboards | Data LineageFlexible working hours | Global collaboration | Remote work | Stock options | Work-life balanceSenior-level Full TimeIreland R8d ago
-
Principal Software Engineer - AI/ML (Ireland) EUR 58K-86KC++ | CUDA | Cache Management | Cloud Native | Data-Driven OptimizationSenior-level Full TimeRemote Ireland R8d ago
-
Alerting | Cloud platform | Containerization | Continuous Deployment | Continuous integrationFlexible schedule | Fully remote | Laptop provided | Performance-based bonuses | Stable internet supportMid-level FreelanceIreland - Remote R10d ago
-
Bash | Black box testing | Black-box | Box testing | Code CoverageEnglish proficiency requirement B2 | Flexible schedule | Fully remote | Project-based collaboration | Supportive communitySenior-level Full TimeIreland - Remote R10d ago
-
Artificial Intelligence | Data Analysis | Git | GitHub | LinuxSenior-level Full TimeWaterford City, Ireland R12d ago
-
Senior Machine Learning Engineer (Speech Synthesis) EUR 100K-100KData Processing | Diffusion Models | Distributed Training | Docker | Experiment trackingContinuous learning | Remote workSenior-level Full TimeDublin; Amsterdam; Krakow R14d ago
-
AI Engineer EUR 48K-75KAWS | Agent Frameworks | Azure | Crossplane | EvaluationHybrid work | Professional development opportunities | Remote flexibilityMid-level Full TimeDublin - Charlotte, Ireland R15d ago
-
Senior Staff Backend Engineer EUR 75K-85KBackpressure | CAP Theorem | Circuit Breaker | Concurrency | Consensus AlgorithmsCareer development | Employee resource groups | Flexible work from home | Internet reimbursement | Mental wellness programsSenior-level Full TimeIreland-Cork R15d ago
-
Data Platform Engineer - Fixed Term Contract GBP 70K-90KBatch Processing | CI/CD | Cloud Native | Cloud-native infrastructure | Data ContractsSenior-level Contract TemporaryGermany (Remote) ; Ireland (Remote); Netherlands … R18d ago
-
Lead Data Analytics & AI Engineer EUR 78K-117KAWS | Airflow | Apache Spark | CI/CD | Cloud platformBonus plan | Health insurance | Hybrid work | Long-term illness protection | PensionSenior-level Full TimeIE Dublin, Ireland R25d ago
-
Senior Software Engineer ll EUR 112K-145KAmazon Web Services | Datadog | Django | Functional testing | GRPCHome office stipend | Pension plan with employer match | Private healthcare plan | Unlimited vacation | Wellness stipendSenior-level Full TimeIreland - Remote R1mo ago
-
Senior Staff Applied Engineer EUR 75K-85KAI Engineering | Cloud Native | Data Pipelines | Data integration | Distributed SystemsCareer development | Employee resource groups | Flexible work from home | Internet reimbursement | Paid time offSenior-level Full TimeIreland-Cork R1mo ago
-
Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure SQLCompany trips | Equipment provided | Flexible working hours | Health insurance | Pension schemeSenior-level Full TimeIreland - Remote R1mo ago