Senior Data Engineer
Tasks
- Apply DevOps and DataOps best practices
- Build embedding pipelines and RAG pipelines
- Collaborate with Data Architect Data Science and BI
- Design data pipelines
- Develop and optimize ETL/ELT pipelines
- Implement batch and streaming Spark jobs
- Implement data modeling and data quality checks
- Implement feature engineering and feature store
- Integrate heterogeneous data sources
- Orchestrate data workflows
- Prepare data for machine learning and AI
- Set up CI CD for data pipelines
- Use Infrastructure as Code with Terraform
- Write production grade Python and Java code
Perks/Benefits
Skills/Tech-stack
AWS Glue | AWS IAM | AWS Kinesis | AWS Lambda | AWS S3 | Amazon Athena | Amazon EMR | Amazon Redshift | Amazon SQS | Apache Airflow | Apache Kafka | Apache Spark | CI/CD | Data Lineage | Data Modeling | Data Quality | Databricks | Databricks SQL | Databricks Workflows | Delta Lake | Delta Live Tables | Delta Live) | Design Patterns | Docker | Embedding pipelines | FastAPI | Feature Engineering | Generative AI | Git | GitHub Actions | GitLab CI | Gradle | Integration Testing | Java | Jenkins | Kubernetes | Machine Learning | Maven | PostgreSQL | PySpark | Python | RAG | Retrieval-Augmented Generation | SOLID | SQL | Spring Boot | Structured Streaming | Terraform | Unit Testing | Vector Store
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Auto Scaling | Blue-Green Deployment | Blue/green | CI/CD | CUDAFlexible remote work | Fully remote | Growth opportunities | High ownership and influence | Meaningful technical impactSenior-level Full TimeItaly R21h ago
-
Cloud Computing | Data Catalog | Data Governance | Data Lineage | Data ModelingMid-level Full TimeBozen (IT), Priorität 11d ago
-
AWS | Cloud platform | Data Ingestion | Data Pipelines | Data VisualizationDiscounts and Conventions | Free TV access | Gym access | Health insurance | Hybrid workingSenior-level Full TimeMilan Monte Penice, Italy1d ago
-
Data Engineer EUR 30K-40KAWS Glue | AWS S3 | Amazon Redshift | Apache Airflow | Apache SparkHybrid work scheduleMid-level Full TimeSAN DONATO MILANESE (MI), Italy1d ago
-
Platform Engineer II - Build EUR 80K-105KArgo CD | Buildkite | CI/CD | Containerization | DebuggingCross-functional collaboration | Performance reviews | Professional developmentMid-level Full TimeMilan1d ago
-
Junior AI Engineer – NextHub Bari EUR 22K-25KData Processing | Data Processing Pipelines | Deep learning | Feature Engineering | Fine TuningHybrid workEntry-level Full TimeBari1d ago
-
Deep AI Native Software Engineering EUR 28K-36KC++ | Computer Vision | Data Pipelines | Data Preprocessing | Data RetrievalEntry-level Full TimeAssago, Via del Mulino 11a, Italy2d ago
-
AWS Cloud Data Engineer/Architect EUR 40K-50KAWS | Apache Spark | Big Data | Business Intelligence | Cloud platformFlexible benefits | Flexible working hours | Remote work flexibility | Work-life balanceSenior-level Full TimeBari, IT2d ago
-
Senior Databricks Data Engineer EUR 40K-55KAccess Control | Apache Spark | Batch Processing | CI/CD | Data GovernanceNational and international travel opportunities | Smart-working optionSenior-level Full TimeRoma, Lazio, Italy2d ago
-
Data Catalog | Data Governance | Data Lineage | Data Modeling | Data QualityCollegial work environment | Company cafeteria | Company events | Corporate benefits | Health careSenior-level Full TimeBozen (IT), Priorität 12d ago
-
Data Engineer - Real Estate EUR 36K-49KCloud platform | Data Monitoring | Data Quality | Geospatial | Google CloudMid-level Full TimeMilano, Lombardia, Italy3d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudMid-level Full TimeRome, Italy3d ago
-
Customer Data Engineer - Milano EUR 28K-32KAzure | Cloud Computing | Data Modeling | Data Quality | Data integrationDiscounts | Meal vouchers | Supplemental health insurance | Welfare plan | Wellbeing programsNone Full TimeMilano - Via Monte Rosa 91, …3d ago
-
Data Analysis | Data Preprocessing | Deployment Automation | Exploratory Data Analysis | Feature EngineeringTechnical mentoringEntry-level Full TimeItaly3d ago
-
Entry-level Full TimeASSAGO, Lombardia(MI), Italy3d ago
-
AI Robotics and Computer Vision specialist M/F/D EUR 38K-49KC++ | CI/CD | Computer Vision | Containerization | Deep learningDisability programs | Flexible working hours | Life insurance | Private medical care | Tailored financial programsEntry-level Full TimeIT-FI-FLORENCE-VIA FELICE MATTEUCCI 2, Italy4d ago
-
Azure | Business Intelligence | CI/CD | Cloud Data | Cloud Data InfrastructureOccasional travelMid-level Full TimeItaly - Monza - Via G. …4d ago
-
AWS | Automation | Cloudflare | DNS | DatadogGrowth Plan Tailored | Gym discounts | Learning resources | Mental health support | MentorshipSenior-level Full TimeMilan5d ago
-
Cloud Computing | Digital Twin | Edge Computing | Internet of Things | MESCareer development | Hybrid workMid-level Full TimeBari5d ago
-
Data Engineer EUR 40K-50KBig Data | Data Modeling | Data Pipelines | Data Warehousing | Machine LearningSenior-level Full TimeMilan, IT, 201456d ago
-
Auto Scaling | CI/CD | CUDA | Container Orchestration | Distributed SystemsEnglish language support | On-call support | Remote workSenior-level Full TimeUkraine R6d ago
-
Azure | Data Modeling | Data Warehouse | Deep learning | ELTEnglish proficiency B2 | Hybrid workMid-level Full TimeBari6d ago
-
AWS | Artificial Intelligence | Azure | Cloud platform | Data ArchitectureEnglish language support | Hybrid work | Training opportunitiesMid-level Full TimeBari6d ago
-
Senior Data Engineer EUR 51K-66KAccess Control | Amazon Redshift | Apache Airflow | Apache Flink | Apache SparkAdditional leave for child sickness | Enhanced parental leave | Flexible working hours | Hybrid working | Internal mobilitySenior-level Full TimeMilan, Italy7d ago
-
Data Platform & AI Engineer EUR 30K-71KAgentic Workflows | Apache Spark | Cloud Computing | DBT | Data EngineeringEntry-level Full TimeTorino, Via Nizza 262 int. 57/59, …7d ago