Big Data Engineer
Tasks
- Build and monitor Azure data platform
- Develop data processing pipelines
- Develop tests
- Diagnose and resolve data infrastructure issues
- Follow change control processes
- Implement programs for functional and non functional requirements
- Ingest transform and process data
- Maintain technical documentation
- Tune and optimize performance
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Azure | Azure DevOps | Bash Scripting | Continuous Delivery | Continuous integration | Data Automation | Data Exploration | Databricks | Design Patterns | Distributed Computing | Flume | Git | Hadoop | Hive | Python | SQL | Scala | Sqoop
Education
Roles
Big Data Engineer | Cloud Engineer | Cloud) | Data Engineer | Engineer
Related jobs
-
AWS | AWS Glue | AWS Lambda | Airflow | Amazon AthenaAsync-friendly culture | Company offsites | Conference support | Flexible working hours | Fully remoteSenior-level Full TimeSpain R6h ago
-
API Gateway | AWS | C# | CI/CD | CloudFrontChildcare allowance | Emotional support | Extra day off monthly | Family support | Gym discountsSenior-level Full TimeBarcelona, Spain9h ago
-
Data Engineer - EY GDS Spain - Hybrid EUR 65K-65KAWS | Apache Airflow | Apache Parquet | Avro | AzureContinuous learning programs | Flexible work-life integration | Hybrid work model | Volunteering opportunities | Well-being programsMid-level Full TimeMalaga, ES, 29590 R18h ago
-
AWS | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkHome office stipend | Inclusive diverse workplace culture | Internal knowledge sharing | Manager coaching | Paid parental leaveSenior-level Full TimeSpain R20h ago
-
Legal Technology & GenAI Applications Engineer EUR 63K-75KAI Governance | AIPilot | Aderant Expert | Aderant Expert Sierra | Apple BusinessMid-level Full TimeMadrid, Spain1d ago
-
AWS | Agile | Azure | CI/CD | DevOpsEnglish classes | Free office food and drinks | Internal training | Paid certifications | Paid time offSenior-level Full TimeZaragoza, Spain R1d ago
-
Apigee | Artificial Intelligence | Bash | BigQuery | Cloud HostingEnglish classes | Free Office Meals and Drinks | Free parking | Paid certifications | Paid vacationMid-level Full TimeMadrid, Spain R1d ago
-
Agentic AI | Copilot Studio | Data Analysis | Data Visualization | DatabricksHybrid work environment | Learning opportunities | MentorshipSenior-level Full TimeMadrid, Spain R1d ago
-
Senior Data Engineer EUR 56K-79KAWS | Agile | Apache Spark | Azure | CI/CDBirthday day off | Dental co payment | Electricity internet allowance | English lessons | Equipment budgetSenior-level Full TimeSpain - Remote R1d ago
-
Data Engineer PFS Admin & Tool (m/f/d) EUR 35K-37KApache Flink | Apache Kafka | Artifactory | CI/CD | DevOpsChildcare support | Extra vacation days | Flexible working hours | Hybrid work model | International mentoring sessionsMid-level Full TimeGranada, AN, Spain3d ago
-
Senior-level Full TimeMadrid, Spain3d ago
-
Data Architect Engineer EUR 36K-42KAWS | Apache Spark | Cloud platform | Continuous integration | ETLCareer development | Permanent contract | Remote workSenior-level Full TimeMadrid, MD, Spain3d ago
-
Data Engineer EUR 40K-45KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Batch ProcessingCareer path | Permanent contractMid-level Full TimeMadrid, MD, Spain3d ago
-
AI Engineer Lead EUR 65K-90KAPIs | AWS | Agentic Workflows | Anthropic | CI/CDDiscount on events and experiences | English lessons | Flexible remuneration tax exemption | Health insurance | Home office friendly setupSenior-level Full TimeMadrid R3d ago
-
AWS | Apache Spark | Azure | CI/CD | Data ModelingContinuous learning plan | Cultural and sports activities | Feedback culture | Flexible compensation plan | Flexible scheduleMid-level Full TimeSevilla, ES R3d ago
-
Data Modeling | Data Pipelines | ETL | Git | NoSQLFlexible schedule | Hybrid work | Learning and development | Medical support | Pro-bono projectsMid-level Full TimeLa Coruña, ES R3d ago
-
AWS | Apache Spark | Azure | Data Modeling | DatabricksContinuous learning and feedback | Cultural and sports activities | Flexible schedule | Health program | Hybrid workMid-level Full TimeZaragoza, ES R3d ago
-
CI/CD | DBT | Data Lineage | Data Modeling | Data QualityContinuous feedback | Cultural and sports activities | Flexible compensation plan | Flexible schedule | Health and wellness programMid-level Full TimeZaragoza, ES R3d ago
-
Computer Vision | Deep learning | GAN | Generative AI | GitCultural activities | Flexible schedule | Hybrid work | Medical program | Pro-bono projectsMid-level Full TimeSevilla, ES R3d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudMid-level Full TimeSeville, Spain3d ago
-
Langchain | MLOps | NumPy | Pandas | Prompt engineeringFlexible schedule | Part-time opportunities | Project based workMid-level FreelanceSpain - Remote R3d ago
-
Machine Learning Developer (Freelance) USD 68K-68KLLMs | Langchain | MLOps | Machine Learning | NumPyFreelance project-based work | Paid per project | Part time flexible workloadMid-level FreelanceSpain - Remote R3d ago
-
AI Engineer (m/f/d) EUR 65K-65KAI Foundry | Asynchronous programming | Audit Logging | Azure | CI/CDCompany bonus scheme | Digital learning programs | Employee discounts | Employee shares program | Flexible workingSenior-level Full TimeBARCELONA, B, ES, 080053d ago
-
Senior-level Full TimeBarcelona, ESP-CT, Spain4d ago
-
Airflow | Alerting | Anomaly Detection | CI/CD | Cloud ComposerHybrid workSenior-level Full TimeMadrid4d ago