Senior Databricks Data Engineer
Tasks
- Automate workflows using Databricks Jobs
- Configure data security and access control
- Design data pipelines
- Develop ETL/ELT workflows
- Implement data governance using Unity Catalog
- Implement data partitioning and indexing
- Integrate CI/CD for data quality monitoring
- Integrate machine learning models using MLflow
- Optimize Delta Lake tables
- Perform batch and streaming data ingestion
- Support Power BI data exposure
Perks/Benefits
Skills/Tech-stack
Access Control | Apache Spark | Batch Processing | CI/CD | Data Governance | Data Ingestion | Data Lakehouse | Data Quality | Data Security | Databricks | Delta Lake | ELT | ETL | Hadoop | Indexing | MLflow | Partitioning | Power BI | PySpark | Python | Scala | Spark SQL | Streaming | Unity Catalog
Education
N/A
Related jobs
-
Junior AI Engineer – NextHub Bari EUR 22K-25KData Processing | Data Processing Pipelines | Deep learning | Feature Engineering | Fine TuningHybrid workEntry-level Full TimeBari13h ago
-
Deep AI Native Software Engineering EUR 28K-36KC++ | Computer Vision | Data Pipelines | Data Preprocessing | Data RetrievalEntry-level Full TimeAssago, Via del Mulino 11a, Italy1d ago
-
Data Catalog | Data Governance | Data Lineage | Data Modeling | Data QualityCollegial work environment | Company cafeteria | Company events | Corporate benefits | Health careSenior-level Full TimeBozen (IT), Priorität 11d ago
-
Data Engineer - Real Estate EUR 36K-49KCloud platform | Data Monitoring | Data Quality | Geospatial | Google CloudMid-level Full TimeMilano, Lombardia, Italy1d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudMid-level Full TimeRome, Italy1d ago
-
Customer Data Engineer - Milano EUR 28K-32KAzure | Cloud Computing | Data Modeling | Data Quality | Data integrationDiscounts | Meal vouchers | Supplemental health insurance | Welfare plan | Wellbeing programsNone Full TimeMilano - Via Monte Rosa 91, …2d ago
-
Data Analysis | Data Preprocessing | Deployment Automation | Exploratory Data Analysis | Feature EngineeringTechnical mentoringEntry-level Full TimeItaly2d ago
-
Entry-level Full TimeASSAGO, Lombardia(MI), Italy2d ago
-
AI Robotics and Computer Vision specialist M/F/D EUR 38K-49KC++ | CI/CD | Computer Vision | Containerization | Deep learningDisability programs | Flexible working hours | Life insurance | Private medical care | Tailored financial programsEntry-level Full TimeIT-FI-FLORENCE-VIA FELICE MATTEUCCI 2, Italy3d ago
-
Azure | Business Intelligence | CI/CD | Cloud Data | Cloud Data InfrastructureOccasional travelMid-level Full TimeItaly - Monza - Via G. …3d ago
-
AWS | Automation | Cloudflare | DNS | DatadogGrowth Plan Tailored | Gym discounts | Learning resources | Mental health support | MentorshipSenior-level Full TimeMilan3d ago
-
Cloud Computing | Digital Twin | Edge Computing | Internet of Things | MESCareer development | Hybrid workMid-level Full TimeBari4d ago
-
Data Engineer EUR 40K-50KBig Data | Data Modeling | Data Pipelines | Data Warehousing | Machine LearningSenior-level Full TimeMilan, IT, 201455d ago
-
Auto Scaling | CI/CD | CUDA | Container Orchestration | Distributed SystemsEnglish language support | On-call support | Remote workSenior-level Full TimeUkraine R5d ago
-
Azure | Data Modeling | Data Warehouse | Deep learning | ELTEnglish proficiency B2 | Hybrid workMid-level Full TimeBari5d ago
-
AWS | Artificial Intelligence | Azure | Cloud platform | Data ArchitectureEnglish language support | Hybrid work | Training opportunitiesMid-level Full TimeBari5d ago
-
Senior Data Engineer EUR 51K-66KAccess Control | Amazon Redshift | Apache Airflow | Apache Flink | Apache SparkAdditional leave for child sickness | Enhanced parental leave | Flexible working hours | Hybrid working | Internal mobilitySenior-level Full TimeMilan, Italy5d ago
-
Data Platform & AI Engineer EUR 30K-71KAgentic Workflows | Apache Spark | Cloud Computing | DBT | Data EngineeringEntry-level Full TimeTorino, Via Nizza 262 int. 57/59, …6d ago
-
Data Science & AI Specialist EUR 36K-36KArtificial Intelligence | Azure Machine Learning | CI/CD | Computer Vision | Deep learningCanteen or meal vouchers | Flexible working hours | Hybrid work options | Meal vouchers | Welfare planSenior-level Full TimeFrosinone, Frosinone, Italy6d ago
-
Senior Analyst - AI Engineering EUR 33K-64KAWS | Agile | Azure | CI/CD | Cloud platformAnnual bonus | Caregiver leave | Health insurance | Parental leave | Vacation daysSenior-level Full TimeIT002 Milano, Italy6d ago
-
Technical Product Owner - Lead Data AI Engineer EUR 42K-87KAWS | Agile | Azure | CI/CD | Data EngineeringBereavement leave | Caregiver leave | Health insurance options | Parental leave | Recognition awardsSenior-level Full TimeIT002 Milano, Italy6d ago
-
Technical Product Owner - Lead AI Engineer EUR 42K-87KAI Agents | AWS | Agile | Azure | CI/CDBereavement leave | Caregiver leave | Health insurance | Parental leave | Recognition awardsSenior-level Full TimeIT002 Milano, Italy6d ago
-
Entry-level Full TimeASSAGO, Lombardia(MI), Italy6d ago
-
Junior Industrial AI Engineer – NextHub Bari EUR 22K-25KAWS IoT | AWS IoT Core | Azure IoT | Cloud Computing | Digital TwinHybrid work | Training opportunitiesEntry-level Full TimeBari6d ago
-
Manager Up – Data Scientist EUR 33K-49KAWS | Azure | Computer Vision | GCP | Generative AIClient-facing role | Hybrid work modeMid-level Full TimeMilano6d ago