Senior Data Engineer
Tasks
- Apply DataOps testing and quality practices
- Author SQL queries for data models
- Build ETL and ELT pipelines
- Design batch micro batch and streaming data architectures
- Develop Spark or Hadoop applications
- Develop data warehousing solutions
- Implement distributed data processing
- Manage infrastructure with Terraform
- Orchestrate data workflows with Airflow
Perks/Benefits
Skills/Tech-stack
Airbyte | Apache Airflow | Apache Hadoop | Apache Spark | Batch Architecture | BigQuery | CDC | Change Data Capture | Cloud Composer | DBT | Data Capture | Data Processing | DataOps | Distributed data | Distributed data processing | ELT | ETL | Infrastructure as Code | Java | Micro batch Architecture | Micro-batch | Python | Relational databases | SQL | Scala | Snowflake | Streaming Architecture | Terraform | “as-code”
Education
N/A
Roles
Related jobs
-
Lead AI Engineer PLN 309K-309KA/B | A/B Testing | AWS | Agentic Systems | AgileCompany car | Employer supported pension plan | Extra paid holidays | Flexible benefits | Home-office allowanceSenior-level Full TimeWarszawa, Mazowieckie, PL R2h ago
-
Senior Agentic AI Engineer GBP 80K-100KAgentic AI | BrightScript | C plus plus | Evaluation | Function CallingFinancial wellness resources | Flexible remote work Fridays | Hybrid work arrangement | Mental health supportSenior-level Full TimeCambridge, United Kingdom R6h ago
-
Senior Data Engineer (F/H) - Niort EUR 47K-55KApache Airflow | Apache Kafka | Cost Optimization | DBT | Data GovernanceHybrid work model | Training and certificationsSenior-level Full TimeNantes R15h ago
-
GenAI Engineer (F/H) - Niort EUR 47K-48KAPIs | Agent Orchestration | Cloud Native | Cloud platform | Data SecurityCommunity events | Hybrid work | Internal meetups | Telework 2 to 3 days per week | TrainingEntry-level Full TimeNiort R15h ago
-
AI Engineer (f/m/d) EUR 70K-75KAWS EKS | Agent Builder | Agent platform | Airflow | Amazon SageMakerEquipment provided | Internal and external training | International career opportunities | Remote work 2 days per week | Technical training and certificationsSenior-level Full TimeParis, Paris, France R19h ago
-
Data Engineer GBP 80K-105KAWS | Airflow | Data Architecture | Data Ingestion | Data TransformationCycle to work scheme | Enhanced parental leave | Holidays | Hybrid working | Learning and development budgetSenior-level Full TimeLondon, United Kingdom R19h ago
-
Tech Lead Power BI (H/F) EUR 50K-70KCloud platform | DAX | Data Modeling | Data Visualization | Google CloudEmployee stock ownership | Health insurance 80 percent | Maternity leave part time 4 5 with pay for 6 months | Paid vacation bonus | Reduced public transport costSenior-level Full TimeLille, Hauts-de-France, France R19h ago
-
Mid-level Full TimeGermany, Berlin - Remote R20h ago
-
Mid-level Full TimeFrance, Paris R20h ago
-
API Testing | AWS | Allure | Angular | AngularJSMid-level Full TimeEurope, Middle East, and Africa R20h ago
-
Airflow | Amazon S3 | Amazon Web Services | Apache Arrow | Apache IcebergHealth insurance support | Professional development support | Remote work | Sports compensationSenior-level Full TimeBarcelona, CT, Spain R21h ago
-
Apache Spark | Data Governance | Data Modeling | Data Monitoring | Data QualityAdditional paid leave | Employee stock options | Learning budget | Paid volunteering | Performance bonusesSenior-level Full TimeSwitzerland R21h ago
-
Apache Spark | Data Governance | Data Modeling | Data Monitoring | Data QualityAdditional paid leave | Employee stock options | Learning and development budget | Location Autonomy | Paid volunteeringSenior-level Full TimeFrance R21h ago
-
Apache Flink | Apache Kafka | Apache Spark | Data Governance | Data ModelingAdditional paid leave | Employee stock options | Opportunity to work remotely while traveling | Paid volunteering opportunities | Performance bonusesSenior-level Full TimeGermany R21h ago
-
Apache Flink | Apache Spark | Databricks | ELT | ETLAdditional paid leave | Employee stock options | Learning and development budget | Paid volunteering opportunities | Performance bonusesSenior-level Full TimeSpain R21h ago
-
Senior Data Engineer PLN 246K-385KABAC | AWS CloudFormation | Airflow | Amazon Web Services | Apache SparkCareer advancement and international mobility | Growth framework | Internal workshops and learning initiatives | Learning and development | Maternity and paternity leave supportSenior-level Full TimePoland - Remote R22h ago
-
Software Engineer (Inference Platform) GBP 80K-127KAlerting | Asynchronous programming | CI/CD | Continuous Deployment | Continuous integrationHybrid workingMid-level Full TimeLondon R22h ago
-
ABAC | AWS | Apache Airflow | Apache Spark | AzureEnglish language classes compensation | Growth framework | Home office support | Internal workshops and learning initiatives | Legal consultationsSenior-level Full TimeUkraine - Remote R22h ago
-
Senior Data Engineer CAD 115K-160KABAC | AWS | Airflow | Apache Spark | AzureChallenging projects | Company events | Cool colleagues | Education program | Free beveragesSenior-level Full TimeNorth Macedonia - Remote R22h ago
-
A/B | A/B Testing | AI Agents | B testing | Data PipelinesAnnual company retreats | Fully remote | Home office stipend | Learning and development budget | Medical coverageSenior-level Full TimeAustria R1d ago
-
A/B | A/B Testing | AI Agents | B testing | Evaluation FrameworksAnnual company retreats | Family support benefits | Fully remote | Home office setup stipend | Learning and development budgetSenior-level Full TimeNetherlands R1d ago
-
Consultant.e AI Engineer EUR 50K-60KAI Foundry | APIs | Apache Spark | Azure AI | Azure AI FoundryHybrid work | RTT | Restaurant ticket | TrainingSenior-level Full TimeNiort, Deux-Sèvres, Nouvelle-Aquitaine, FR R1d ago
-
Consultant.e AI Engineer EUR 50K-60KAI Foundry | Apache Spark | Azure | Azure AI | Azure AI FoundryCareer growth | Human-sized company | Hybrid work | Individualized coaching | Meal cardSenior-level Full TimeNantes, Loire-Atlantique, Pays de la Loire, … R1d ago
-
Consultant.e AI Engineer EUR 60K-70KAI Foundry | API Development | Azure AI | Azure AI Foundry | Azure CognitiveHybrid work | Meal card | RTT | Training opportunitiesSenior-level Full TimeParis, Paris, Île-de-France, FR R1d ago
-
AI RMF | C++ | Container Security | Data exfiltration | FedRAMPFinancial benefits | Flexible work arrangements | Health benefits | Remote work | Well-being benefitsSenior-level Full TimePoland R1d ago