Big Data Engineer
Tasks
- Build and monitor Azure data platform
- Develop data processing pipelines
- Develop tests
- Diagnose and resolve data infrastructure issues
- Follow change control processes
- Implement programs for functional and non functional requirements
- Ingest transform and process data
- Maintain technical documentation
- Tune and optimize performance
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Azure | Azure DevOps | Bash Scripting | Continuous Delivery | Continuous integration | Data Automation | Data Exploration | Databricks | Design Patterns | Distributed Computing | Flume | Git | Hadoop | Hive | Python | SQL | Scala | Sqoop
Education
Roles
Big Data Engineer | Cloud Engineer | Cloud) | Data Engineer | Engineer
Related jobs
-
Camera Calibration | Cloud infrastructure | Coordinate mapping | Data Augmentation | Deep learningCoworking space option | Flexible working hours | Fully remote | Home office equipment allowance | No business travel requiredSenior-level Full TimeSpain R7h ago
-
AZURE DATA ENGINNER (Inglés alto) EUR 35K-43KAzure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure LogicEnglish B2 or C1 certification required | Live in Spain | Remote workMid-level Full TimeMadrid, MD, Spain R23h ago
-
Cloud Data Architect EUR 50K-55KAirbyte | Airflow | BigQuery | CI/CD | Cloud ComposerBirthday day off | Flexible compensation | Full time work schedule customization | Growth opportunities | Health discountsSenior-level Full TimeEspaña, Spain1d ago
-
Senior AI Engineer (All Genders) EUR 54K-75KCI/CD | Context engineering | Docker | Embeddings | JavaBike leasing | Hybrid working | Product discount | Subsidised transport | Training and supportSenior-level Full TimeMadrid, Spain1d ago
-
Senior AI Engineer - SDLC (All genders) EUR 54K-75KAmazon Bedrock | Azure OpenAI | CI/CD | Distributed Systems | Docker20 percent product discount | Bike leasing | Hybrid working | Option to work abroad for 20 days | Subsidised transportSenior-level Full TimeMadrid, Spain1d ago
-
API Design | API Testing | AWS Bedrock | Automated testing | Azure OpenAIBike leasing | Discount on products | Hybrid working | Option to work abroad | Subsidised transportSenior-level Full TimeMadrid, Spain1d ago
-
Data Engineer EUR 66K-88KApache Spark | Azure DevOps | CI/CD | Databricks | MixpanelHybrid working | International culture | Professional development | Social events | Team-building activitiesSenior-level Full TimeBarcelona, Spain1d ago
-
Data & AI Solutions Engineer EUR 35K-45KAPI Integration | APIs | Anomaly Detection | Classification | Data ModelingDiscounts | English classes | Flexible working hours | Gympass | Pet friendlyEntry-level Full TimeBarcelona, Spain1d ago
-
Mid-level Full TimeMadrid - Eloy Gonzalo, Spain1d ago
-
Business AI Engineer (Global) EUR 40K-60KCopilot Studio | Cybersecurity | Dashboarding | Data Governance | JavaScriptCollaborative & Inclusive Culture | Flexible hybrid working | Internal mobility | International opportunities | Training opportunitiesMid-level Full Time(HE)Office Madrid J. Camarillo, Spain1d ago
-
Mid-level Full TimeMadrid - Eloy Gonzalo, Spain1d ago
-
Mid AI Engineer EUR 40K-60KAsync Programming | CI/CD | CrewAI | Embeddings | EvaluationFlexible benefits | Fresh fruit | Hybrid work | International team | Meal vouchersMid-level Full TimeBarcelona, Spain1d ago
-
Data Engineer SSIS + Power BI EUR 34K-40KAnalysis Services | Azure | Azure Data | Azure Data Factory | Data FactoryChildcare card | Discount Portal | Flexible compensation plans | Gym membership discounts | Health insuranceMid-level Full TimeMadrid, Spain2d ago
-
Data Engineering Lead EUR 60K-80KAWS | Artificial Intelligence | Azure | Cloud Computing | Data GovernanceAnnual bonus | Health insurance | Knowledge sharing | Learning and development | PensionSenior-level Full TimeRemote, Spain R2d ago
-
Data Manipulation | Distributed Systems | Embeddings | Java | KubernetesCollaborative engineering culture | Direct access to technical leadership | Exposure to cutting edge generative AI technologies | High autonomy and flexibility | High ownership of projectsEntry-level Full TimeSpain R2d ago
-
Big Data Developer EUR 38K-48KAmazon EMR | Azure Databricks | CI/CD | Cloudera | Data PipelinesCareer development | Hybrid work | International projects | Multicultural environment | Training opportunitiesMid-level Full TimeMálaga, AN, Spain2d ago
-
(Senior) Risk Data & Analytics Engineer EUR 54K-77KAutomation | CI/CD | Code review | Data Pipelines | Data ProcessingAdditional day annual leave per year of service | Discounts | Fitness and wellness memberships | Hybrid work model | Language appsSenior-level Full TimeMadrid2d ago
-
AI Engineer - Generative AI - Accessibility EUR 75K-125KAccessibility | Claude | CrewAI | Figma | Generative AIEmotional support | Family support | Flexible remuneration | Free language courses | Gym discountsSenior-level Full TimeMadrid, Spain2d ago
-
Senior Analytics Engineer EUR 70K-90KDBT | Data Governance | Data Quality | Databricks | ETLContinuous professional development | Corporate support and wellbeing | Hybrid work option | Remote work flexibility | Stock optionsSenior-level Full TimeSpain R2d ago
-
Bash | Data Processing | Data pipeline | Docker | GCPAsynchronous culture | Friendly work environment | Remote workMid-level Full TimeValencia, Spain2d ago
-
Bash | Data Ingestion | Data Processing | Docker | GCPAsynchronous culture | Bonus | Competitive salary | Inclusive workplace | Remote-friendlyMid-level Full TimeMalaga, Spain2d ago
-
Analista Mlops (Híbrido Madrid/Málaga) EUR 33K-40KAPI | Apache Spark | CI/CD | ETL | EnglishEmployee benefits club | Good work culture | Hybrid work | Technical team support | Unlimited trainingSenior-level Full TimeMADRID, MADRID R2d ago
-
Sr Engineer – GenAI Quality Assurance EUR 61K-101KAI Foundry | API Testing | AWS | AWS Bedrock | Azure AIHybrid workSenior-level Full TimeES023 Janssen Barcelona, Spain2d ago
-
Data Engineer EUR 25K-38KAgile | Automation | Azure DevOps | Cloud Computing | Cloud StorageFlexible remuneration | Free company shuttle | Gympass service | Health insurance | International remote work programMid-level Full TimeMadrid (Vía de los Poblados), Spain R2d ago
-
Data Scientist Control Manager/Senior Manager EUR 48K-70KAWS Athena | AWS SageMaker | At risk | Backtesting | Climate Scenario FrameworksSenior-level Full TimeCIUDAD BBVA [00018800 BCO. BILBAO VIZCAYA …2d ago