Senior Data Platform Engineer (Spark, AWS, Apache Iceberg, Production Systems)
Virtual Office (Ireland)
R
EUR 56K-85K (estimate) Senior-level Full Time
Tasks
- Design build maintain high scale data ingestion pipelines
- Develop reliable scalable backend services
- Diagnose resolve system failures end to end
- Ensure scalability availability latency security and compliance
- Evaluate adopt new technologies and drive operational excellence
- Implement unit integration and end to end tests in CI CD
- Lead system design architecture discussions and code reviews
- Mentor teammates and share engineering testing best practices
Perks/Benefits
- Career development
- Dental plan
- Financial planning resources
- Flexible-hybrid work
- Income protection
- Life assurance
- Maternity leave
- Mentorship opportunities
- Paternity leave
- Pension scheme
- Private health insurance
- Remote flexibility
- Wellness support
Skills/Tech-stack
AWS CloudFormation | AWS Glue | AWS Lake Formation | AWS Lambda | Alerting | Amazon IAM | Amazon S3 | Amazon SNS | Amazon SQS | Amazon Web Services | Apache Iceberg | Apache Spark | CI/CD | Code review | Data Catalog | Data Governance | Data Lake | Data Modeling | Distributed Systems | ETL | End to End | End-to-End Testing | Fault Tolerance | Git | Gradle | HIPAA | Integration Testing | Java | JavaScript | Lake Formation | Logging | Maven | Messaging Systems | Microservices | Monitoring | PySpark | Pytest | Python | REST API | Scala | Serverless | Synchronization | Tox | Unit Testing | Web Services
Education
Related jobs
-
Bash | Data Ingestion | Data Pipelines | Distributed Systems | DockerAccess to cutting edge AI and data technologies | Autonomy | Collaborative engineering culture | Distributed first work environment | Fully remoteMid-level Full TimeIreland R18h ago
-
AI Observability | AWS | Azure | CI/CD | Cloud ArchitectureCareer advancement | Collaborative engineering culture | Exposure to emerging technologies | Fully remote work | Leadership opportunitiesSenior-level Full TimeIreland R3d ago
-
Senior Analytics Engineer (AI & Quality) EUR 44K-57KCloud platform | Data Governance | Data Modeling | Data Quality | GitHubInternational team collaboration | Remote work | Supportive work environmentSenior-level Full TimeDublin, Ireland R3d ago
-
API | Automation platforms | Classification | Event Driven | Event-driven architectureCompany-sponsored health insurance | Employee discounts | Flexible working hours | Home office setup allowance | Learning and development opportunitiesMid-level Full TimeIreland R4d ago
-
Machine Learning Engineer EUR 60K-76KAWS | Azure | Cloud infrastructure | Experiment tracking | GCPDonation support | Generous time off | Healthcare | Occasional travel | Parental leaveMid-level Full TimeRemote - Ireland R4d ago
-
Data Analysis | Data Ingestion | Data cleaning | Exploratory Data Analysis | Feature EngineeringFlexible schedule | Part-time hours | Project based work | Remote workMid-level FreelanceIreland - Remote R5d ago
-
Causal Inference | Data Analysis | Decision Trees | Embeddings | Ensemble ModelsCaregiver reimbursement | Employee stock purchase plan | Flexible working hours | Hackathons | Learning groupsSenior-level Full TimeLeinster-Dublin, Ireland R6d ago
-
AI Coding Assistants | AI coding | Alerting | BigQuery | CI/CDContinuous improvement culture | Flexible working hours | High autonomy | Learning community access | Long-term ownershipSenior-level Full TimeIreland R6d ago
-
Computer Vision | Deep learning | Deep learning frameworks | Diffusers | Diffusion ModelsAnnual vacation | Conference reimbursement | English language learning discounts | Fully remote | Professional development reimbursementSenior-level Full TimeIreland R6d ago
-
Agentic Systems | C Sharp | Chat orchestration | DPO | Data PreparationAnnual vacation | Conference support | English language learning discounts | Fully remote | Healthcare support budgetSenior-level Full TimeIreland R7d ago
-
C# | MATLAB | NumPy | Pandas | PythonFlexible hours | Freelance project-based | Part-time | Remote workSenior-level FreelanceIreland - Remote R14d ago
-
CI/CD | ClearML | Git | Go | KubeflowSenior-level Full TimeRemote Ireland R14d ago
-
Full Stack AI Engineer (Remote in Ireland) EUR 58K-75K.NET | API Integration | Access Management | Agentic AI | AnthropicAutonomy and responsibility | Equipment provided | Fun company events | Home-office allowance | Online GymMid-level Full TimeIreland - Supports R19d ago
-
Principal Data Engineer - PerfectScale by DoiT EUR 97K-124KAWS | Analytical Databases | Apache Iceberg | Benchmarking | CI/CDEmployee stock option plan | Flexible working options | Health insurance | Home-office allowance | Parental leaveSenior-level Full TimeRemote Ireland R20d ago
-
Lead AI Engineer EUR 67K-93KAI | CI/CD | Docker | ETL | KubernetesFlexible work environment | Hybrid work 3 days per week on site | Professional development opportunities | Supportive leadersSenior-level Full TimeDublin - Charlotte, Ireland R21d ago
-
Senior AI Engineer EUR 58K-86KArtificial Intelligence | CI/CD | Docker | ETL | KubernetesHealth insurance | Hybrid work | Professional development opportunities | Supportive leaders | Workplace wellnessSenior-level Full TimeDublin - Charlotte, Ireland R21d ago
-
Classification | Context window | Context window management | Data labeling | Direct Preference OptimizationCo-working space budget | Fully remote | Health insurance support | Learning budget | Paid time offSenior-level Full TimeIreland R28d ago
-
Senior Data Engineer (Perm, Ireland) EUR 56K-80KAWS | Amazon Redshift | Apache Hadoop | Apache Spark | AutomationDeath in service | Income protection | Paid time off | Pension match | Private healthcareSenior-level Full TimeIreland R1mo ago
-
AWS | AWS EC2 | Azure | C# | C++Onsite work flexibility | Remote workSenior-level Full TimeDublin - MSO, Ireland R1mo ago
-
Senior Machine Learning Engineer (Speech Synthesis) EUR 100K-100KData Processing | Diffusion Models | Distributed Training | Docker | Experiment trackingContinuous learning | Remote workSenior-level Full TimeDublin; Amsterdam; Krakow R1mo ago
-
AI Engineer EUR 48K-75KAWS | Agent Frameworks | Azure | Crossplane | EvaluationHybrid work | Professional development opportunities | Remote flexibilityMid-level Full TimeDublin - Charlotte, Ireland R1mo ago
-
Data Platform Engineer - Fixed Term Contract GBP 70K-90KBatch Processing | CI/CD | Cloud Native | Cloud-native infrastructure | Data ContractsSenior-level Contract TemporaryGermany (Remote) ; Ireland (Remote); Netherlands … R1mo ago