Data Engineer
Tasks
- Architect Delta Lake table schemas
- Build near real time pipelines
- Collaborate with product and QA
- Create data enrichment workflows
- Design data pipelines
- Develop unit tests
- Ensure pipeline reliability
- Handle schema evolution
- Implement partitioning and liquid clustering
- Optimize pipeline cost efficiency
- Write structured PySpark jobs
Perks/Benefits
- Benefits package tailored to location
- Flexible working arrangements
- Home office support
- Learning and development allowance
- Remote-friendly
Skills/Tech-stack
AWS Kinesis | AWS Lambda | AWS S3 | AWS SQS | AWS Step Functions | Amazon ECS | Change Data Capture | Change Data Feed | Data Capture | Data feed | Databricks | Delta Change Data Feed | Delta Lake | Delta Sharing | Git | GitHub | GitHub Actions | Jest | Jira | Liquid clustering | MySQL | Partitioning | PySpark | Pytest | Python | Schema evolution | Serverless | Step Functions
Education
Roles
Related jobs
-
ML Engineer H/F EUR 42K-47KAWS Glue | AWS Lambda | AWS S3 | AWS SageMaker | AirflowMeetups | Mobile phone | Professional communities | Sport-Events | Sustainable mobility allowanceMid-level Full TimeParis, IDF, France9h ago
-
Mid-level Full TimeLa Garenne Colombes, FR, 9225011h ago
-
Stage Innovation : Ingénieur Intelligence Artificielle NLP / Traitement de données audio EUR 14K-14KAudio Processing | Data analytics | FFT | Language Models | Language ProcessingMeal tickets | Transportation coverageEntry-level Full Time InternshipToulouse, Occitanie, France12h ago
-
Data Analysis | Deep learning | Generative AI | Hugging Face | Image ProcessingPotential full-time offer | Restaurant tickets | Transportation coverage | Work on innovation projectsEntry-level Full Time InternshipToulouse, Occitanie, France12h ago
-
C++ | Computer Vision | Convolutional Neural Network | Deep learning | Image ProcessingMeal tickets | Transport coverageEntry-level Full Time InternshipToulouse, Occitanie, France12h ago
-
Apache Airflow | Artificial Intelligence | Business Intelligence | CRM | Customer DataCollaborative culture | Continuous learning | Exposure to cutting edge AI and data engineering | Flexible work location | Globally distributed teamSenior-level Full TimeFrance15h ago
-
Apps Script | Data Automation | Data Transformation | Excel | Google AppsCareer mentoring | Employee share plan | Flexible work arrangements | Paid training | Partially reimbursed vacationsEntry-level Full TimeAix-en-Provence, FR R18h ago
-
Accelerator - Data & AI Engineering (Paris) EUR 64K-85KAIOps | AWS | Airflow | CI/CD | DBTHealth insurance | Hybrid work | Internal mobility opportunities | Paid leave | Professional developmentSenior-level Full TimeParis, France20h ago
-
AWS | Cloud platform | Data Ingestion | Data Pipelines | Data VisualizationDiscounts and Conventions | Free TV access | Gym access | Health insurance | Hybrid workingSenior-level Full TimeMilan Monte Penice, Italy20h ago
-
Testia SAS - Ingénieur / Data Scientist – Détection de Défauts par Ultrasons - CDD - (H/F) – Toulouse EUR 26K-26KAdversarial Networks | Data Augmentation | Deep learning | Generative Adversarial Networks | Machine LearningFlexible working arrangementsEntry-level Full TimeToulouse - Gaye, France20h ago
-
Data Engineer Databricks - H/F EUR 52K-55KAirbyte | Airflow | Apache Spark | Asset bundles | Auto LoaderAgile working environment | Autonomy | Hybrid workMid-level Full TimeBoulogne-Billancourt, France1d ago
-
Data Engineer Snowflake (AWS) - H/F EUR 46K-52KAWS | Airbyte | Apache Airflow | Apache Kafka | CI/CDAgile team environment | Hybrid work | Supportive managementMid-level Full TimeBoulogne-Billancourt, France1d ago
-
Senior Data Engineer Snowflake F/H EUR 46K-57KAWS | Apache Airflow | Azure | CI/CD | DBTAgile/Scrum environment | Continuous learning | Professional development | Team collaborationSenior-level Full TimeLyon, Auvergne-Rhône-Alpes, France1d ago
-
Senior-level Full TimeParis, France1d ago
-
AI Engineer – Consultant·e confirmé·e / senior EUR 55K-60KAzure | Bash | Cloud platform | Generative AI | Google CloudCareer development | Certification budget | Coach support | Holiday bonus | Meal ticketsSenior-level Full TimeParis, France1d ago
-
Mid-level Full TimeSophia-Antipolis, France1d ago
-
Mid-level Full TimeSophia-Antipolis, France1d ago
-
Ingénieur Big Data H/F EUR 50K-52KAnsible | Artifactory | Cloud Observability | Cloud platform | DockerAutonomy | Career development opportunities | Teamwork cultureSenior-level Full TimeMontpellier, Occitanie, France1d ago
-
API Design | Agent systems | Automated testing | Bash | CI/CDContinuous learning | Flexible schedule | Global Time Zone Flexibility | Professional network growth | RecognitionSenior-level Contract FreelanceFrance R1d ago
-
Data Engineer - Dataiku Expert H/F/NB EUR 55K-70KAWS | Apache Spark | Azure | Cloud platform | Data GovernanceSenior-level Full TimeBordeaux, France1d ago
-
Data Engineer - Dataiku Expert H/F/NB EUR 55K-70KAWS | Apache Spark | Azure | Cloud Computing | Cloud platformSenior-level Full TimeBordeaux, France1d ago
-
AWS | Asynchronous programming | Data Preprocessing | Databases | FastAPIAsynchronous work environment | Autonomy | Company-provided hardware | Remote-first | Work-life balanceMid-level Full TimeFrance1d ago
-
C plus plus | C# | CAD | Computational Geometry | Delaunay MeshingFinancial benefits | Health insurance | Wellness benefitsSenior-level Full TimeMontigny le Bretonneux, France2d ago
-
AWS | Amazon Redshift | BigQuery | DBT | Data ModelingCompany offsites | Home-office equipment | Inclusive culture | Paid time off | Pension contributionSenior-level Full TimeFrance2d ago
-
Bash | Cloud infrastructure | Data Ingestion | Data Processing | DockerAsynchronous culture | Friendly team | Laid-back atmosphere | Remote-friendly environmentMid-level Full TimeParis, France2d ago