Data Engineer/Architect AWS Glue-EMR Expert
Tasks
- Apply security and compliance baselines
- Collaborate on knowledge transfer from GUI-based ETL to code-centric approaches
- Define and implement orchestration and scheduling with AWS services
- Design ETL pipelines in AWS Glue and/or EMR
- Implement monitoring, alerts, and operational best practices
- Participate in technical assessments of workflows and dependencies
- Validate data quality and perform performance testing
Perks/Benefits
Skills/Tech-stack
AWS Glue | Amazon EMR | Automation | Cloud Computing | Cost Optimization | Data Catalog | Data Processing | Data Transformations | Data Validation | ETL migration | IDMC | IICS | Metadata tracking | Monitoring | Observability | PowerCenter | PySpark | Python | Security | Spark | Spark SQL | Workflow Orchestration
Related jobs
-
Senior-level Full TimeMadrid, Europe, Spain9h ago
-
AI machine learning | Azure | DAX | Data Modeling | Data QualityDiscounts on training and programs | Flexible benefits | Flexible work hours | Health insurance | Intensive work scheduleMid-level Full TimeBarcelona, Spain R10h ago
-
AWS | Amazon Redshift | Cloud Architecture | Code Versioning | Data LineageSenior-level Full TimeES022 Janssen Madrid, Spain1d ago
-
API | AWS | Automated testing | Azure | BigQueryConferences | Flexible time off | Health insurance | Mentorship | Referral bonusesSenior-level Full TimeSpain R2d ago
-
Senior Data Lead Engineer EUR 46K-73KAWS | BI Semantic Modeling | CDC | CI/CD | ConfluenceHybrid work | International projects | Multicultural team | Permanent employment | Training and continuous career developmentSenior-level Full TimeMálaga, AN, Spain2d ago
-
Data Engineer EUR 39K-40KAI/ML | AWS | Apache Spark | CI/CD | Cloud DataFlexible working hours | Free beers | Free coffee | International team | Professional developmentMid-level Full TimeBarcelona, Catalonia2d ago
-
Data Platform Engineer Specialist EUR 46K-78KAWS | Batch Processing | CI/CD | Data Lakes | Data WarehousingSenior-level Full TimeBarcelona, Spain2d ago
-
Senior Data Enginer AWS EUR 38K-49KAWS CloudFormation | AWS Glue | AWS Lambda | AWS S3 | AWS Step FunctionsBenefits bonus | Health insurance | Life coaching | Life insurance | Nature activitiesSenior-level Full TimeMADRID, Spain R2d ago
-
Lead Data Engineer (m/f/d) EUR 53K-60KAccess Management | DBT | Data Governance | Data Lakehouse | Data ModelingFlexible hybrid working model | Individual development plans | Training opportunitiesSenior-level Full TimeBarcelona, Spain2d ago
-
Senior Software Engineer (Data Engineering) EUR 44K-70KAWS | Apache Airflow | Apache Spark | Docker | GitFlexible hours | Gym allowance | LinkedIn Learning subscription | Meal vouchers | Work from homeSenior-level Full TimeBarcelona, Barcelona3d ago
-
Junior Software Engineer (Data Engineering) EUR 25K-32KAWS | Airflow | Bash | Docker | GitFlexible hours | Gym allowance | LinkedIn Learning subscription | Meal vouchers | Team-building activitiesEntry-level Full TimeBarcelona, Barcelona3d ago
-
CMDB | Cloud Computing | Data Engineering | IT Infrastructure | ITSMCareer progression | Health insurance | Meal card | Remote work | Welcome kitMid-level ContractGermany; Portugal; Belgium; Spain; France; Italy3d ago
-
Arquitectura E Integración Bi Y Big Data EUR 30K-40KAzure | Big Data | Business Intelligence | CI/CD | Cloud ArchitectureContinuous training | Hybrid work model | Life insurance | Pension plan | Private medical insuranceSenior-level Full TimeMADRID, ES4d ago
-
Mid-level Full TimeESP - Madrid - Castellana, Spain4d ago
-
Senior Data Engineer EUR 43K-70KAPIs | AWS | AWS CloudFormation | AWS Glue | AWS LambdaAdditional paid time off | Birthday day off | Company events | English classes | Flexible hoursSenior-level Full TimeMadrid, Spain R5d ago
-
Senior Data Engineer EUR 35K-41KAWS Glue | AWS Lambda | Agile | Amazon Web Services | AtlanDental coverage | Hybrid work | Indefinite employment contract | Medical insurance Adeslas | Partial course reimbursementMid-level Full TimeBarcelona5d ago
-
Data Engineer EUR 69K-86KAI-assisted coding | Agentic Workflows | Airflow | Assisted coding | AtlanAlan Flex benefits | Flexible retribution | Flexible time off | Health insurance | Referral bonusesMid-level Full TimeGreater Madrid Metropolitan Area7d ago
-
Data Engineer EUR 70K-86KBigQuery | Cloud Spanner | Cloud platform | Google Cloud | Google Cloud PlatformClassPass subscription | Flexible time off | Food or nursery benefits | Health insurance coverage | Referral bonusesMid-level Full TimeBarcelona, Spain7d ago
-
Senior Data Engineer EUR 62K-90KAWS | Apache Airflow | CI/CD | DBT | DatabricksDiscount platform | Hybrid work model | Remote work daysSenior-level Full TimeBarcelona, Spain8d ago
-
Data Engineer Consultant EUR 30K-40KADLS | AWS Glue | AWS Redshift | Access Control | Amazon EMRAdditional personal days | Career plan | Continuous feedback | Flexible compensation | Hybrid work modelMid-level Full TimeMadrid, Spain9d ago
-
Senior Data Engineer I EUR 51K-78KABAC | Alerting | Amazon Kinesis | Apache Airflow | Apache BeamCompetitive time off | Digital disconnect days | Employee stock purchase plan | Employee wellbeing programs | Immersive global induction programSenior-level Full TimeValència, VC, Spain9d ago
-
Senior Data Engineer EUR 44K-46KAWS CDK | AWS Glue | AWS Lambda | Agile | Amazon EventBridgeEmployee discounts | Flexible working hours | Free language courses | Fully remote work | Holiday packageSenior-level Full TimeValencia, V, ES, 46002 R9d ago
-
Data Engineer EUR 70K-95KApache Airflow | Apache Kafka | Cloud Pub/Sub | Cloud platform | DBTClassPass subscription | Flexible retribution | Flexible time off | Food or nursery benefit | Health insuranceMid-level Full TimeBarcelona, Spain10d ago
-
Data Engineer (Azure Databricks) EUR 39K-48KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Internal mobility | Mentorship | Professional developmentMid-level Full TimeBilbao, PV, Spain10d ago
-
Data Engineer (Azure Databricks) EUR 39K-48KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsHealth insurance | Internal mobility | Internship opportunities | Mentorship program | Professional development opportunitiesMid-level Full TimeMurcia, MC, Spain10d ago