Data Engineer
Tasks
- Build entity resolution and record linkage logic
- Create technical documentation and runbooks
- Deliver feature ready datasets for downstream teams
- Design and implement dbt data models with tests
- Develop data quality frameworks with validation
- Implement anonymization and pseudonymization processes
- Optimize Spark processing jobs for performance and cost
- Orchestrate production pipelines with Airflow or AWS Step Functions
- Profile and harmonize source schemas into unified model
- Rebuild and validate data pipelines for reproducibility
Perks/Benefits
Skills/Tech-stack
AWS Glue | AWS S3 | AWS Step Functions | Amazon Athena | Amazon EMR | Amazon Redshift | Anonymization | Apache Airflow | Apache Spark | DBT | Data Governance | Data Lineage | Data Quality | Deduplication | Entity Resolution | Great Expectations | Pseudonymization | Python | Record Linkage | SQL | Step Functions
Education
N/A
Roles
Related jobs
-
Bash | Data Ingestion | Data Pipelines | Distributed Systems | DockerAccess to cutting edge AI and data technologies | Autonomy | Collaborative engineering culture | Distributed first work environment | Fully remoteMid-level Full TimeIreland R18h ago
-
Data Engineer EUR 56K-79KAWS Fargate | AWS Glue | AWS Lambda | Amazon Aurora | Amazon Aurora ServerlessAnnual leave | Career development | Company laptop | Company pension | E-learningSenior-level Full TimeDublin1d ago
-
Agentic AI - Senior Software Engineer EUR 54K-75KAI SDK | AI System Design | Agentic AI | Agents SDK | AutomationSenior-level Full TimeDublin, Ireland1d ago
-
Data Engineer, 3P Geo Data Operations EUR 94K-96KData Analysis | Data Infrastructure | Data Modeling | Data Pipelines | DataflowMid-level Full TimeDublin, Ireland2d ago
-
AI Observability | AWS | Azure | CI/CD | Cloud ArchitectureCareer advancement | Collaborative engineering culture | Exposure to emerging technologies | Fully remote work | Leadership opportunitiesSenior-level Full TimeIreland R3d ago
-
Senior Analytics Engineer (AI & Quality) EUR 44K-57KCloud platform | Data Governance | Data Modeling | Data Quality | GitHubInternational team collaboration | Remote work | Supportive work environmentSenior-level Full TimeDublin, Ireland R3d ago
-
API | Automation platforms | Classification | Event Driven | Event-driven architectureCompany-sponsored health insurance | Employee discounts | Flexible working hours | Home office setup allowance | Learning and development opportunitiesMid-level Full TimeIreland R4d ago
-
Bash | Data Processing | Docker | GCP | Large Scale DataAsynchronous culture | Career growth opportunities | Laid-back atmosphere | Remote friendly distributed setupMid-level Full TimeDublin, Ireland4d ago
-
Bash | Cloud infrastructure | Data Processing | Docker | GCPMid-level Full TimeGalway, Ireland4d ago
-
Senior Data Engineer EUR 70K-81KAWS Glue | Apache Hadoop | Apache NiFi | Apache Spark | AzureEnhanced leave options | Health and wellbeing supports | Hybrid work model | Pension and savings options | Training and coachingSenior-level Full TimeDublin, Ireland4d ago
-
Staff AI Software Engineer EUR 86K-115KAPIs | AWS | Agentic AI | Azure | Cloud NativeContinuous learning | Mentorship | Work-life balanceSenior-level Full TimeIreland, Limerick4d ago
-
Machine Learning Engineer EUR 60K-76KAWS | Azure | Cloud infrastructure | Experiment tracking | GCPDonation support | Generous time off | Healthcare | Occasional travel | Parental leaveMid-level Full TimeRemote - Ireland R4d ago
-
AI Agent | AI agent architectures | API Integration | Agent architectures | AnthropicCareer growth | Events and team activities | Flexible work arrangements | Learning programs | MentorshipMid-level Full TimeIreland4d ago
-
Agentic Workflows | Context learning | Data Engineering | Deep learning | Diffusion ModelsContribution to open source community | On-site hybrid work | Open publication policyMid-level Full TimeDublin, 1 Grand Canal Square, Ireland5d ago
-
Agentic AI - Senior Software Engineer EUR 54K-75KAI SDK | AI orchestration | Agents SDK | Automation | CI/CDSenior-level Full TimeDublin, Ireland5d ago
-
Lead Data Engineer – AI & Foundation Models EUR 49K-69KAccess Control | Apache Spark | Audit Logging | CI/CD | Data GovernanceSenior-level Full TimeDublin, Ireland5d ago
-
Data Analysis | Data Ingestion | Data cleaning | Exploratory Data Analysis | Feature EngineeringFlexible schedule | Part-time hours | Project based work | Remote workMid-level FreelanceIreland - Remote R5d ago
-
Lead AI/ML Engineer EUR 85K-100KAPIs | Agent workflow | Artificial Intelligence | Azure | Continuous ImprovementSenior-level Full TimeDublin, Ireland5d ago
-
APIs | Agent systems | Cloud platform | Data Pipelines | EvaluationEquity | Health insurance | Paid time off | Professional development | Retirement planMid-level Full TimeDublin, Ireland5d ago
-
API Integration | Agent systems | Cloud platform | CrewAI | Evaluation PipelinesMid-level Full TimeDublin, Ireland5d ago
-
Causal Inference | Data Analysis | Decision Trees | Embeddings | Ensemble ModelsCaregiver reimbursement | Employee stock purchase plan | Flexible working hours | Hackathons | Learning groupsSenior-level Full TimeLeinster-Dublin, Ireland R6d ago
-
Senior-level Full TimeParkmore East Business Park, Galway Ireland6d ago
-
Senior-level Full TimeParkmore East Business Park, Galway Ireland6d ago
-
AI Coding Assistants | AI coding | Alerting | BigQuery | CI/CDContinuous improvement culture | Flexible working hours | High autonomy | Learning community access | Long-term ownershipSenior-level Full TimeIreland R6d ago
-
Apache Airflow | BigQuery | Cloud Composer | Cloud Migration | Cloud platformAgile collaborative environment | Flexible working arrangements | Hybrid work option | Professional development support | Remote work optionSenior-level Full TimeIreland6d ago