Senior Data Engineer
Tasks
- Automate operational processes
- Build and optimize data pipelines
- Collaborate with stakeholders on requirements
- Ensure data governance and reliability
- Ensure data quality and lineage
- Implement CI CD pipelines for Databricks
- Implement Delta Lake data processing
- Ingest and transform batch and streaming data
- Orchestrate cloud native data workflows
- Tune and troubleshoot Spark jobs
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Glue | Amazon Kinesis | Apache Kafka | Apache Spark | Azure | Azure Data | Azure Data Factory | Azure Event | Azure Event Hubs | CI/CD | Data Factory | DataOps | Databricks | Dataflow | Delta Lake | Delta Lake ACID | Docker | ELT | ETL | Event Hubs | GCP | Git | Kubernetes | MLflow | Machine Learning | PySpark | Python | SQL | Unity Catalog
Education
N/A
Roles
Related jobs
-
LLMs | Langchain | MLOps | NumPy | PandasFreelance engagements | Part-time availability | Project based workMid-level FreelanceItaly - Remote R16h ago
-
Artificial Intelligence | C# | C++ | Cloud Platforms | JavaHybrid work | Remote workMid-level Full TimeItaly1d ago
-
Azure Data Platform Support (Remote) - SRE I EUR 25K-40KAnalysis Services | Azure Analysis | Azure Analysis Services | Azure Customer Insights | Azure DataBuddy onboarding | Coaching | Conference attendance | Employee welfare programs | Equipment providedMid-level Full TimeRome, Italy R1d ago
-
Bash | Coverage.py | Dagger | Dagger CI | DockerFlexible hours | Project-based collaboration | Remote work | Supportive communitySenior-level Full TimeItaly - Remote R1d ago
-
Deep learning | Langchain | MLOps | Machine Learning | NumPyPart-time projects | Project based workMid-level FreelanceItaly - Remote R1d ago
-
ASPICE | AUTOSAR | AUTOSAR Classic | Android | Autosar AdaptiveSenior-level ContractEurope, Italy3d ago
-
Product Data Engineer EUR 60K-75KAPI Integration | Alerting | Apache Airflow | Cloud platform | Dashboards100 percent remote work | Birthday day off | Continuous learning and professional development | Gym and wellness membership | Language coursesMid-level Full TimeBologna, Emilia-Romagna, Italy R4d ago
-
Python AI Developer (hybrid) EUR 28K-40KAI Agents | API Integration | Data cleaning | Deep learning | DockerFreelance collaboration | Hybrid work | Remote work flexible scheduleEntry-level Full TimeFlorence, Tuscany, Italy4d ago
-
Industry X - Senior Gen-AI Developer EUR 48K-50KAWS | Azure | CI/CD | Cloud Native | Cloud OperationsSenior-level Full TimeRoma, Via Sciangai 53, Italy4d ago
-
Data & Analytics Engineer EUR 38K-48KBusiness Intelligence | CI/CD | Data Lake | Databricks | ELTFlexible schedule | Hybrid work | Personalised development programme | Remote work support | Short working weekMid-level Full TimePADOVA VIA SAN MARCO, Italy4d ago
-
Embedded Real Time Software Engineer EUR 25K-32KC# | C++ | ISO IEC IEEE 12207 2017 | ISO/IEC | ISO/IEC/IEEE 12207Continuous training | Hybrid working | Work-life balanceEntry-level Full TimeIT - Genova - Puccini, Italy5d ago
-
Junior Cloud Data & AI Architect EUR 26K-38KAlgorithms | BigQuery | Cloud Run | Cloud platform | ContainerizationExtra leave days | Health insurance | Parental leave support | Remote work | Ticket restaurantEntry-level Full TimeMilano, Lombardia, Italy6d ago
-
Junior - Data Engineering NextHub Bari EUR 30K-35KETL | Hadoop | Microsoft SQL | Microsoft SQL Server | MongoDBHybrid work | Professional developmentEntry-level Full TimeBari6d ago
-
A/B | A/B Testing | B testing | Context Management | DashboardsAutonomy | Flexible work location | Fully remote | Healthcare coverage | Home office setup allowanceSenior-level Full TimeItaly R6d ago
-
Senior Databricks Data Engineer EUR 36K-45KAWS | Apache Spark | Azure | CI/CD | Data GovernanceSmart workingSenior-level Full TimeRoma, Lazio, Italy7d ago
-
Mid-level TemporaryMILANO, LOMBARDIA, Italy7d ago
-
Senior Digital Analytics EUR 40K-50KAdobe Analytics | Adobe Experience | Adobe Experience Manager | Adobe Experience Platform | Adobe LaunchCheckups | Flexible work hours | Health insurance | Paid travel to client sites | Parental supportSenior-level Full TimeMilano, Lombardia, Italy7d ago
-
Senior Data Science Consultant EUR 47K-62KAI Agents | Cloud Computing | Data Modeling | Data integration | Generative AIAdvanced training and development | Hybrid work | Mental and physical well-being initiatives | Work-life balanceSenior-level Full TimeMilano, IT7d ago
-
CYS_Data Engineer_TP EUR 48K-62KApache Airflow | Apache Flink | Apache Flink SQL | Apache Iceberg | Apache KafkaHybrid working | Security clearance eligibility | Short domestic travel | Technical mentoringSenior-level Full TimeIT - Genova - Fiumara, Italy7d ago
-
Linux Embedded Engineer EUR 30K-40KBash | C# | C++ | CMake | Cross-compilationFlexible working hours | Onsite work onsite at client location | Remote workEntry-level Full TimeBari, IT8d ago
-
Linux Embedded Engineer (ROS) EUR 30K-32KBash | C# | C++ | CMake | Cross-compilationFlexible working hours | Onsite work support | Remote workEntry-level Full TimeBari, IT8d ago
-
Azure | Computer Vision | FastAPI | Git | Language ModelsAdditional permitted leave | Annual team offsite travel | Equipment provided | Fast promotion | MentorshipEntry-level Full Time InternshipMilan, Metropolitan City of Milan, Italy R10d ago
-
Product Data Engineer EUR 60K-75KAPIs | Alerting | Apache Airflow | BI Dashboards | Cloud platformBirthday day off | Continuous learning platform | Gym and wellness membership | Language courses | Meal vouchersMid-level Full TimeBologna, Emilia-Romagna, Italy R11d ago
-
Data Analysis | Data Manipulation | Data Preprocessing | Exploratory Data Analysis | Feature EngineeringEntry-level Full TimeItaly11d ago
-
Bash | Data Processing | Docker | GCP | Large Scale DataAsynchronous culture | Friendly work environment | Professional growth opportunities | Remote work allowedMid-level Full TimeMilan, Italy11d ago