Senior Databricks Data Engineer
Tasks
- Automate workflows with Databricks Jobs
- Configure data governance and access control
- Create data quality checks
- Design data ingestion pipelines
- Develop ETL/ELT pipelines
- Implement Delta Lake transformations
- Implement medallion architecture
- Integrate MLflow models
- Manage Delta Lake tables
- Optimize Databricks workloads
Perks/Benefits
Skills/Tech-stack
AWS | Apache Spark | Azure | CI/CD | Data Governance | Data Security | Databricks | Delta Lake | ELT | ETL | GCP | Hadoop | MLflow | Medallion Architecture | PySpark | Python | Scala | Spark SQL | Unity Catalog
Education
N/A
Related jobs
-
Computational Algorithms | Machine Learning | NumPy | Numerical Methods | PandasPart-time freelance | Remote workMid-level FreelanceItaly - Remote R1d ago
-
Computational Algorithms | Machine Learning | NumPy | Numerical Methods | PandasPart-time | Remote freelanceMid-level FreelanceItaly - Remote R1d ago
-
Entry-level Full TimeRoma (P.le Agricoltura), Italy2d ago
-
NumPy | Pandas | Probability | Python | SciPyFlexible project participation | Freelance project-based work | Part-time hours | Stable internet requiredMid-level FreelanceItaly - Remote R2d ago
-
Linux Embedded Engineer EUR 30K-40KBash | C# | C++ | CMake | Cross-compilationFlexible working hours | Onsite work onsite at client location | Remote workEntry-level Full TimeBari, IT2d ago
-
Azure | Computer Vision | FastAPI | Git | Language ModelsAdditional permitted leave | Annual team offsite travel | Equipment provided | Fast promotion | MentorshipEntry-level Full Time InternshipMilan, Metropolitan City of Milan, Italy R4d ago
-
Product Data Engineer EUR 60K-75KAPIs | Alerting | Apache Airflow | BI Dashboards | Cloud platformBirthday day off | Continuous learning platform | Gym and wellness membership | Language courses | Meal vouchersMid-level Full TimeBologna, Emilia-Romagna, Italy R4d ago
-
Data Analysis | Data Manipulation | Data Preprocessing | Exploratory Data Analysis | Feature EngineeringEntry-level Full TimeItaly4d ago
-
Bash | Data Processing | Docker | GCP | Large Scale DataAsynchronous culture | Friendly work environment | Professional growth opportunities | Remote work allowedMid-level Full TimeMilan, Italy5d ago
-
AI Engineering Manager (Full-Stack) - Milano EUR 38K-48KAWS | Agent Framework | Agent Orchestration | Apache Spark | CI/CDMid-level Full TimeMilano - Piazza Tre Torri 2, …5d ago
-
Lead Generative AI Specialist EUR 54K-78KGANs | Generative AI | Language Models | Large Language Models | Machine LearningDisability programs | Flexible working hours | Life insurance | Private medical care | Remote workSenior-level Full TimeIT-FI-FLORENCE-VIA FELICE MATTEUCCI 2, Italy R5d ago
-
Entry-level Full TimeASSAGO, Lombardia(MI), Italy5d ago
-
Experienced - Generative AI Engineer EUR 35K-44KAWS | Artificial Intelligence | Cloud platform | Databricks | Google CloudHybrid workMid-level Full TimeMilano, Roma5d ago
-
AI Agents | AWS | Azure | Cloud Architecture | Cloud platformHybrid work environmentMid-level Full TimeBari5d ago
-
Experienced – Data Engineer – AI&Data EUR 35K-40KAWS | Azure | Cloud platform | Databricks | ELTClient-facing opportunities | Hybrid work environmentMid-level Full TimeMilano, Roma5d ago
-
AI Engineer EUR 35K-48KAWS | Angular | CI/CD | Dash | DjangoFlexible work | Hybrid work | Innovation time | Remote work | Training programsMid-level Full TimeVarese, VA, Italy6d ago
-
Bash | C# | C++ | Coverage.py | DockerFlexible hours | Project-based collaboration | Remote workSenior-level Full TimeItaly - Remote R7d ago
-
LLMs | Langchain | MLOps | Machine Learning | MatplotlibPart-time freelance | Remote workMid-level FreelanceItaly - Remote R7d ago
-
Bash | C# | C++ | Coverage.py | DockerFlexible participation | Opportunity to work on AI projects | Project-based collaboration | Remote workSenior-level Full TimeItaly - Remote R8d ago
-
Senior Machine Learning Engineer EUR 64K-78KBDD | Data orchestration | Design Patterns | Machine Learning | MicroservicesFlexible work arrangements | Gym discounts | Health insurance | Mental health support | Wellbeing programsSenior-level Full TimeMilan11d ago
-
Entry-level Full TimeBarueri, Green Valley, Andromeda, Brazil12d ago
-
Experienced - GenAI & Prompt Engineer - Treviso EUR 29K-39KAI | Data Structures | Language Models | ML | Prompt engineeringMid-level Full TimeTreviso12d ago
-
Data Engineer Associate EUR 45K-60KAI | AWS Glue | AWS Redshift | AWS S3 | AirflowFlexible work arrangements | Hybrid workSenior-level Full TimeSAN DONATO MILANESE (MI), Italy13d ago
-
Senior Data Engineer EUR 40K-60KAPI REST | AWS Glue | AWS Kinesis | AWS Redshift | AWS S3Ample remote work options | Hybrid workSenior-level Full TimeSAN DONATO MILANESE (MI), Italy13d ago
-
AI Algorithms | Agile methodology | Anomaly Detection | C++ | ChemistryFlexible hours | Remote work | Travel opportunitiesSenior-level Full TimeIT-FI-FLORENCE-VIA FELICE MATTEUCCI 2, Italy R13d ago