Lead Software Engineer (Big Data)
Tasks
- Build extensible data acquisition solutions
- Collaborate with cross-functional product teams
- Deliver streaming applications and pipelines
- Extract transform and distribute data
- Lead engineering teams to deliver consumable products
- Manage data integration and analysis
- Troubleshoot software components for data platforms
Perks/Benefits
Skills/Tech-stack
AWS | AWS Glue | AWS Lambda | Agile | Amazon Athena | Amazon DynamoDB | Amazon EMR | Amazon RDS | Amazon S3 | Apache Airflow | Apache Avro | Apache Kafka | Apache ORC | Apache Parquet | Apache Spark | Big Data | CI/CD | CloudFormation | Data Lake | Data Modeling | Data Security | Data Warehousing | Databricks | Delta Lake | Distributed Systems | Git | Iceberg | Infrastructure as Code | JUnit | Java | Jenkins | Maven | NoSQL | Oracle | PySpark | SQL | Scala | Spring Boot | Swagger | Swagger API | Terraform | “as-code”
Education
N/A
Related jobs
-
Senior-level Full TimeDublin, Ireland1d ago
-
AI Foundry | AWS | AWS GovCloud | Agentic AI | Amazon Bedrock401k matching | Career development | Dental insurance | Disability coverage | Flexible work arrangementsSenior-level Full TimeIreland1d ago
-
Amazon Web Services | Azure | CI/CD | DAX | Data ModelingContinuous learning | Fully remote within Europe | High autonomy and flexibility | In-person team events | International and diverse teamSenior-level Full TimeIreland R1d ago
-
Azure | Azure Data | Azure Data Explorer | CSV | Data ExplorerCross-functional collaboration | Exposure to large scale security telemetry | Professional growth | Remote workMid-level Full TimeIreland R1d ago
-
Data Engineer EUR 71K-106KAgile | Amazon Redshift | Amazon Web Services | Apache Airflow | Apache KafkaCareer development opportunities | Comprehensive benefits | Diversity and inclusion culture | Flexible work arrangements | Hybrid work modelSenior-level Full TimeDublin, Leinster, IRELAND; Letterkenny, Ulster, IRELAND1d ago
-
Quantitative Development - DevOps Engineer EUR 56K-77K*nix | CD pipeline | CI Pipeline | CI/CD | CUDASenior-level Full TimeDublin, Ireland1d ago
-
Data Engineer EUR 43K-61KCrystal Reports | DevOps | ETL | Informatica | LOGIOn-call rotation supportEntry-level Full TimeSun Life Ireland1d ago
-
Werkstudent KI & Data Science (m/w/d) EUR 12K-18KCloud Run | Docker | GCP | Git | JavaAgile work environment | Career growth | Coffee and water flat | Employee discount | Flexible workingEntry-level Part TimeMünster, NRW, Germany2d ago
-
Mid-level Full TimeDublin, Ireland; Ireland2d ago
-
Werkstudent KI & Data Science (m/w/d) EUR 12K-18KAgile | Cloud Run | Cloud platform | Docker | GitCompany bike | Employee discount | Flexible work | Open team culture | Public transport discountEntry-level Part TimeMünster, NRW, Germany2d ago
-
AI Agents | API | AWS | AWS Bedrock | Access ControlAsynchronous collaboration | Distributed international team | Flexible parental leave | Fully remote | Mental health supportSenior-level Full TimeIreland R2d ago
-
Senior Data Engineer-Product Data Quality EUR 66K-85KAWS | Airflow | CI/CD | Cloud Architecture | Data EngineeringCommuter tickets | Cycle to work scheme | Dental insurance | Employee shares program | Ergonomic workstation allowanceSenior-level Full TimeDublin, Ireland2d ago
-
Senior Data Engineer EUR 80K-125KAgile | Airflow | Azure Blob | Azure Blob Storage | Azure DataCareer development | Comprehensive benefits | Hybrid work modelSenior-level Full TimeDublin, Leinster, IRELAND; Letterkenny, Ulster, IRELAND2d ago
-
Machine Learning Engineer EUR 45K-70KAWS Bedrock | AWS Lambda | AWS SageMaker | Apache Airflow | Automated testingIncome protection insurance | Learning initiatives | Life assurance | Pension | Private healthcareMid-level Full TimeDublin, Leinster, Ireland R3d ago
-
Staff Software Engineer (Agentic Engineering) GBP 113K-170KAgentic Workflows | Amazon Web Services | Context Management | Distributed Systems | DockerSenior-level Full TimeUnited Kingdom R3d ago
-
API Development | Automated testing | Backend Development | CI/CD | Cloud infrastructureFoundational ownership | Full-time position | Fully remote work | High autonomyMid-level Full TimeIreland R3d ago
-
Senior AI Engineer PLN 230K-250KAPIs | Agile | Alerting | Azure | Azure DevOpsAccess to learning university | Annual paid leave | Hybrid work model | Remote work flexibility | Volunteering daysSenior-level Full TimeDublin, Co. Dublin, Ireland3d ago
-
Automated Workflows | CI/CD | Cloud Computing | Computer Vision | Data LineageCollaborative environment | Inclusive workplace | Opportunity to work on advanced ML challenges | Professional growth opportunitiesSenior-level Full TimeIreland3d ago
-
Azure | Azure Data | Azure Data Factory | Azure DevOps | BashCollaborative work environment | Exposure to infrastructure as code and automation | Hands on experience with Databricks and Azure | Professional growthMid-level Full TimeIreland3d ago
-
Senior AI/ML Computational Scientist EUR 53K-58KAlerting | Big Data | C++ | Cloud Computing | Computer ArchitectureSenior-level Full TimeDublin, 1 Grand Canal Square, Ireland3d ago
-
AWS | Angular | Cloud Resource Management | Data Analysis | Data PipelinesRemote workEntry-level Full TimeIR, Dublin, Ireland R3d ago
-
Engineering Manager (Agentic Engineering) GBP 94K-141KAWS | Context Management | Distributed Systems | GitHub Actions | GoMid-level Full TimeUnited Kingdom R4d ago
-
Staff Engineer, Compute EUR 100KAWS | Azure | Capacity Planning | Distributed Systems | GoBuddy program | Career development | Employee stock purchase plan | Hybrid work environment | Inclusive workplace cultureSenior-level Full TimeDublin, Ireland; Madrid, Spain; Paris, France R4d ago
-
Staff Data Engineer - GTM GBP 70K-85KApache Airflow | CCPA | Clay | Crawling | DBTComprehensive health insurance | Cycle to work scheme | Dental insurance | Flexible paid time off | Hybrid work policySenior-level Full TimeDublin, Ireland; London, England R4d ago
-
Bash | Cloud infrastructure | Data Ingestion | Data Processing | DockerAsynchronous culture | Flexible environment | Impactful product | Remote-friendlyMid-level Full TimeDublin, Ireland4d ago