Senior Data Engineer - PySpark/Python
Tasks
- Apply object-oriented design patterns
- Collaborate with data architecture and governance teams
- Design data processing solutions
- Develop PySpark pipelines
- Document data processes
- Ensure data traceability
- Implement data quality rules
- Optimize Spark jobs
- Support data products development and publication
- Transform and manipulate data with SQL
- Troubleshoot data processing issues
Perks/Benefits
- N/A
Skills/Tech-stack
AI Foundry | AI Search | Apache Spark | Azure AI | Azure AI Search | Data Lake | Data Modeling | Data Quality | Databricks | Microsoft Fabric | Object-Oriented | Object-oriented programming | Power BI | PySpark | Python | SQL | Snowflake
Education
N/A
Roles
Related jobs
-
Bash | Data Processing | Docker | GCP | Large Scale DataAsynchronous work culture | Friendly work atmosphere | Impactful mission | Professional growth opportunities | Remote-friendly environmentMid-level Full TimeMadrid, Spain17h ago
-
Data Engineer (GCP) EUR 65K-72KAkka-http | Apache Beam | App Engine | BigQuery | CI/CDFlexible work culture | Global opportunities | Professional development | Vibrant communityEntry-level Full TimeBarcelona17h ago
-
Analytics Engineer GBP 80K-90KAmazon Redshift | CI/CD | DBT | Data Modelling | Data QualityEnglish working language | In-office 3 days per week | Relocation supportMid-level Full TimeLondon R1d ago
-
AI Applications & Data Science Consultant EUR 23K-25KAPIs | Altair | Data pipeline | Docker | DplyrFlexible work schedule | Life insurance | Lunch card | Online language classes | Private medical insuranceEntry-level Full TimeMálaga, AN, Spain1d ago
-
Senior Analytics Engineer EUR 55K-80KAirflow | Alerting | Anomaly Detection | Apache Airflow | Cloud ComposerCareer development | Collaborative culture | Hybrid workSenior-level Full TimeMadrid1d ago
-
Senior Data Engineer EUR 12K-16KApache Airflow | Cloud PubSub | Cloud platform | Containerization | DBTFlexible hours | Ongoing learning | Remote work | Team building retreats | Training and developmentMid-level Full TimeMadrid (Hybrid), Madrid (Remote) R1d ago
-
Data Engineer EUR 48K-60KAWS | Azure Synapse | Azure Synapse Analytics | CI/CD | Cloud DataprocAccess to learning and certifications | Be Well programs | Continuous feedback | Employee coaching | Hybrid workingMid-level Full TimeMadrid HQ (KES51610), Spain1d ago
-
GenAI Engineering Internship EUR 21K-21KAWS Bedrock | Anthropic | Data Migration | Data Processing | DockerMentoring | On-site workEntry-level InternshipMadrid R2d ago
-
Entry-level Full TimeBarcelona2d ago
-
Senior Machine Learning Engineer EUR 78K-90KAgile | CI/CD | Cloud platform | DVC | Data IngestionExtra holidays | Flexible remuneration | Multicultural team | Private medical insurance | Remote positionSenior-level Full TimeMálaga, AN, Spain2d ago
-
AWS | Access Controls | Apache Spark | Data Contracts | Data GovernanceMid-level Full TimeMadrid, Spain2d ago
-
Senior LLM Engineer EUR 55K-72KAWS | Deep learning | DevOps | Docker | GPU ArchitectureCareer growth | Educational budget | Flexible working hours | Hybrid work | Language classesSenior-level Full TimeMadrid, Spain2d ago
-
AWS | Bash | CI/CD | Databricks | DatadogContinuous learning culture | Fully remote | Healthcare coverage | International collaboration opportunities | Paid parental leaveSenior-level Full TimeSpain R2d ago
-
Data Engineer Azure EUR 35K-42KAgile | Azure | Azure Data | Azure Data Lake | Azure Data Lake StorageBonus rewards | Flexible work schedule | Life insurance | Paid training | Private medical insuranceMid-level Full TimeSEVILLA, Spain R2d ago
-
Azure | Azure Functions | Backend APIs | CI/CD | LLMAutonomy | Career development | Health insurance | Team cultureSenior-level TemporaryBarcelona R2d ago
-
Analista Mlops (Híbrido Madrid/Málaga) EUR 33K-40KAPI Development | Apache Spark | CI/CD | Fortify | GitEmployee benefits club | Good working environment | Hybrid work | Unlimited technical trainingSenior-level Full TimeMadrid, Madrid R2d ago
-
Data Engineer Internship (m/f/x) EUR 14K-14KA/B | A/B Testing | Azure | B testing | CI/CDCoaching and Mentorship | Collaborative multinational team | Remote-flexible work environmentEntry-level Full Time InternshipMADRID GENERAL OFFICE, Spain2d ago
-
Agentic AI Engineer EUR 54K-75KAsync Python | CI/CD | Embeddings | Evaluation | Function CallingBonus | Flat organization | Hybrid work | Meal tickets | Private health insuranceSenior-level Full TimeMadrid, Community of Madrid, Spain2d ago
-
AI Solutions Architect EUR 54K-75KAI Agents | AI Security | AI Services | Access Management | AzureCollaborative international team | Flexible working culture | Sport budget | Yearly education budgetSenior-level Full TimeBarcelona, Catalonia, Spain2d ago
-
AI readiness | Agentic Workflows | Artificial Intelligence | Azure Machine Learning | C++Senior-level Full TimeMadrid, M, ES, 280032d ago
-
Senior-level Full TimeBarcelona, ESP-CT, Spain3d ago
-
Senior AI Engineer EUR 40K-60KApp Service | Azure App | Azure App Service | Azure Cosmos | Azure Cosmos DBAdditional paid leave | Birthday day off | Private medical insuranceMid-level Full TimeBarcelona3d ago
-
Camera Calibration | Cloud infrastructure | Coordinate mapping | Data Augmentation | Deep learningCoworking space option | Flexible working hours | Fully remote | Home office equipment allowance | No business travel requiredSenior-level Full TimeSpain R3d ago
-
AWS | Agile | Avro | Azure | Big DataContinuous learning | Health resources | Hybrid work model | Psychological support | Recognition programsSenior-level Full TimeMalaga, ES, 29590 R3d ago
-
Senior AI Engineer EUR 71K-107KAWS | Artificial Intelligence | Azure | Bias Assessment | Cloud infrastructureSenior-level Full TimeSANTA BARBARA 1-PLANTA SEGUNDA, Spain3d ago