Lead Software Engineer (Big Data)
Tasks
- Build extensible data acquisition solutions
- Collaborate with cross-functional product teams
- Deliver streaming applications and pipelines
- Extract transform and distribute data
- Lead engineering teams to deliver consumable products
- Manage data integration and analysis
- Troubleshoot software components for data platforms
Perks/Benefits
Skills/Tech-stack
AWS | AWS Glue | AWS Lambda | Agile | Amazon Athena | Amazon DynamoDB | Amazon EMR | Amazon RDS | Amazon S3 | Apache Airflow | Apache Avro | Apache Kafka | Apache ORC | Apache Parquet | Apache Spark | Big Data | CI/CD | CloudFormation | Data Lake | Data Modeling | Data Security | Data Warehousing | Databricks | Delta Lake | Distributed Systems | Git | Iceberg | Infrastructure as Code | JUnit | Java | Jenkins | Maven | NoSQL | Oracle | PySpark | SQL | Scala | Spring Boot | Swagger | Swagger API | Terraform | “as-code”
Education
N/A
Related jobs
-
API Integration | Agent systems | Autogen | Autonomous Workflow | Autonomous Workflow OrchestrationFlexible working arrangements | Hybrid work | Inclusive workplace | International team collaboration | Professional developmentMid-level Full TimeIreland13h ago
-
API Gateway | Agentic AI | Automated testing | CI/CD | CachingContinuous learning | Flexible work arrangements | Hybrid work | Professional growth | Remote workSenior-level Full TimeIreland14h ago
-
Analytical Lead, Shopping Partners EUR 96K-98KData Visualization | Data pipeline | Database | Digital Advertising | Google SpreadsheetsBonus | EquitySenior-level Full TimeDublin, Ireland20h ago
-
.NET | AI Act | AI Foundry | Access Control | Audit LoggingBike to work | Career progression | Educational assistance | Employee Pension Matching | Employee assistance programmeSenior-level Full TimeDublin, County Dublin, Ireland20h ago
-
Quantitative Data Engineer EUR 55K-70KApache Spark | Cloud Architecture | DBT | Dagster | Data ArchitectureMid-level Full TimeDublin23h ago
-
Software Engineer III (Big Data) EUR 71K-107KAWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon DynamoDBSenior-level Full TimeDublin, Ireland1d ago
-
Senior Data Analytics & AI Engineer EUR 65K-98KAPIs | AWS | Apache Airflow | CI/CD | DBTBonus plan | Health insurance | Hybrid work | Long-term illness protection | PensionSenior-level Full TimeIE Dublin, Ireland R1d ago
-
Alerting | Auditing | Backend systems | Batch Processing | CI/CDContinuous improvement | Cross-functional collaboration | Engineering excellence culture | Flexibility across Europe | Leadership opportunitiesMid-level Full TimeIreland1d ago
-
Senior Technical Solutions Consultant, Data Engineering EUR 120K-123KApache Flume | Apache Spark | Business Intelligence | Cloud Dataflow | Data EngineeringSenior-level Full TimeDublin, Ireland1d ago
-
Automation | Big Data | CI/CD | Cloud infrastructure | Cloud platformFlexibility to work from anywhere | Leadership ownership of critical systems | Remote-first work environment | Work-life balance cultureExecutive-level Full TimeIreland R1d ago
-
Staff AI/ML Engineer (Robotics) EUR 55K-75KCI/CD | Computer Vision | Control Theory | Decision Making | Decision making under uncertaintySenior-level Full TimeIreland, Limerick2d ago
-
Senior Gen AI Developer USD 32K-32KAPI Integration | AWS | Agent Orchestration | Angular | Distributed SystemsHybrid work | Learning and development opportunities | Office based collaboration 3 days per week | Supportive leadershipSenior-level Full TimeDublin - Frame, Ireland R2d ago
-
Applied AI Lead - Risk EUR 70K-105KCredit Risk | Data Pipelines | Deep learning | Experimentation | Language ProcessingSenior-level Full TimeIRL Dublin, Ireland2d ago
-
Senior-level Full TimeBengaluru, Karnataka, India; London, England, United …2d ago
-
Senior Embedded Systems Design Engineer EUR 57K-76KC# | C++ | CI/CD | Cross-compilation | CybersecurityLearning and development | Mentoring | Wellness programSenior-level Full TimeDublin, IRL, 42d ago
-
Director, Data Engineering EUR 111K-193KAWS | AWS Glue | AWS Lake Formation | Access Control | Amazon ECSExecutive-level Full TimeDublin, Ireland3d ago
-
Senior-level Full TimeIreland - Dublin - Hybrid R3d ago
-
Lead, Engineering EUR 94K-124KAWS | Azure | AzureBlob | BackendDevelopment | CloudStorageHybrid work model | In-office work modelSenior-level Full TimeCork, Ireland3d ago
-
Apache Airflow | BigQuery | Cloud platform | DBT | DataflowAnnual company off site events | Co-working space membership | ESOP equity participation | Flexible schedule | Fully remoteSenior-level Full TimeIreland R3d ago
-
Agile | Apache Kafka | C# | Cloud Computing | KubernetesAttendance at sporting events | Career development | Collaborative team | Continuous learning | MentorshipSenior-level Full TimeDublin, Ireland4d ago
-
Senior Database Administrator EUR 55K-65KAWS | Automation | Azure | Backup and Recovery | CassandraSenior-level Full TimeDublin, Ireland4d ago
-
Applied AI Engineer Graduate EUR 33K-42KAnthropic API | Azure Cloud | Azure ML | Azure OpenAI | CI/CDCareer mentoring | Career success support programme | Travel opportunitiesEntry-level Full TimeCork, Ireland4d ago
-
Embedded Software Engineer, Staff - Cork, Ireland EUR 65K-100KACPI | C# | C++ | CXL | JavaBicycle Purchase Scheme | Education assistance | Employee Run Clubs | Employee stock purchase plan | Immigration supportSenior-level Full TimeCork, Ireland4d ago
-
Head of AI Innovation Lab EUR 93K-128KAI Governance | Algorithms | Artificial Intelligence | BQML | Code QualityContributory pension | Cycle to work | Discounted travel | Discounts | Enhanced maternity payExecutive-level Full TimeIRL - Dublin, Ireland4d ago
-
Senior Machine Learning Engineer EUR 76K-108KAgent systems | Agentic AI | Cloud Computing | Data Analysis | Data StructuresContributory pension | Discounted travel options | Employee discounts | Enhanced maternity pay | Enhanced sick paySenior-level Full TimeIRL - Dublin, Ireland4d ago