Senior Data Engineer | Apache NiFi
Tasks
- Analyze and resolve data pipeline issues
- Automate workflow monitoring with Bash and Python
- Design data pipelines using Apache NiFi
- Develop real time data integration using APIs
- Ensure data quality, security, and governance
- Implement CI CD pipelines for data pipeline deployments
- Improve ETL and ELT processes
- Integrate structured and unstructured data from multiple sources
- Manage NiFi architecture in Kubernetes
- Optimize and troubleshoot NiFi workflows
- Use NiFi Registry and Toolkit for version control and deployments
Perks/Benefits
Skills/Tech-stack
APIs | AWS | Amazon Redshift | Apache Kafka | Apache NiFi | Apache Spark | Azure | Azure Synapse | Azure Synapse Analytics | Bash | CI/CD | Docker | Git | Google BigQuery | Google Cloud | HDFS | Hadoop | Java | Jenkins | Kubernetes | MongoDB | MySQL | PostgreSQL | Python | SQL | Synapse Analytics
Education
N/A
Roles
Related jobs
-
Airbyte | Anomaly Detection | DBT | Data Governance | Data LineageAnnual company offsites | Co-working support | Employee equity options | Flexible working | Home office stipendSenior-level Full TimeFrance R11h ago
-
AWS Lambda | AWS Secrets | AWS Secrets Manager | Airflow | Amazon CloudWatchCollaborative team culture | Continuous learning and professional development | Flexible working hours | Fully remote across Europe | Ownership driven engineering cultureMid-level Full TimeFrance R12h ago
-
API Integration | API Keys | Apache Airflow | Authentication | Automated testingAutonomy | Continuous improvement | Exposure to production greenfield platform | Flexible collaboration hours | Fully remote work Europe UKSenior-level Full TimeFrance R1d ago
-
Machine Learning Engineer (W/M/D) EUR 50K-65KAWS SageMaker | Artificial Intelligence | Azure Machine Learning | CI/CD | DVCAdditional paid days off | Flexible work environment | Free yoga lessons | Health insurance | Home office equipment supportMid-level Full TimeParis, IDF, France R1d ago
-
Experienced Data Engineer - Streaming Platform EUR 60K-80KAWS Kinesis | Alerting | Apache Beam | Apache Flink | Apache KafkaChild day care | Gym membership | Lunch voucher | Premium healthcare coverage | Relocation supportMid-level Full TimeParis R1d ago
-
Data Engineer GCP (F/H) EUR 50K-55KAPI Development | Agile | BigQuery | CI/CD | Cloud BuildCareer growth | Remote work | Training platform accessMid-level Full TimeParis, Île-de-France, France R1d ago
-
Data Engineer AWS (F/H) EUR 30K-42KAWS Glue | AWS Lambda | Amazon Athena | Amazon S3 | Apache AirflowEnglish training | Health insurance | Meal vouchers | Mobility allowance | Paid time offSenior-level Full TimeLa Garenne-Colombes, Île-de-France, France R1d ago
-
Data Engineer AWS Senior (F/H) EUR 30K-42KAPI Gateway | AWS Lambda | Amazon API | Amazon API Gateway | Amazon CognitoAfterworks community techlead | CE benefits | Cooptation bonus | English courses | Health insuranceSenior-level Full TimeLa Défense, Île-de-France, France R1d ago
-
Data Engineer EUR 50K-55KAgile | Apache Spark | Hadoop | Kafka | MongoDBCooptation bonus | E-learning courses | English training | Health insurance | Mobility allowanceMid-level Full TimeSophia-Antipolis, Provence-Alpes-Côte d'Azur, France R1d ago
-
Data Engineer Cloud (F/H) EUR 30K-42KAWS Lambda | AWS RDS | AWS Step Functions | Agile | Amazon Web ServicesCooptation bonus | Employee benefits | English Training Access | Health insurance | Meal ticketsSenior-level Full TimeLa Défense, Île-de-France, France R1d ago
-
Data Engineer GCP Senior (F/H) EUR 30K-42KBash | Cloud platform | Docker | GCP | GitAfterworks community techlead | Cooptation bonus | E-learning access | Employee benefits program | English coursesSenior-level Full TimeLa Défense, Île-de-France, France R1d ago
-
Data Engineer H/F EUR 52K-57KArtifactory | Cloudera | ELK | Git | GrafanaE-learning access | English courses | Health insurance covered 65 percent | Mobility bonus | Referral bonusExecutive-level Full TimeParis, Île-de-France, France R1d ago
-
Cloud Computing | Data pipeline | Debugging | ETL | Google ColabCareer growth | Continuous learning | Flexible work hours | Fully remote | International collaborationMid-level Full TimeFrance R1d ago
-
Alternance - Mlops - (F/H/X) EUR 16K-20KAWS | Deep learning | Docker | GitLab | MLflowCSE access after 3 months | Canal+ subscription | Conference and event access | Meal benefits | Paid volunteer daysEntry-level ApprenticeshipPuteaux, FR R1d ago
-
C# | MATLAB | NumPy | Pandas | PythonPart-time project work | Remote project participationSenior-level Full TimeFrance - Remote R1d ago
-
Senior Solutions Engineer - Qatar & S.Africa Fly-in GBP 70K-100KAI Agents | AWS | Apache Spark | Apache Spark architecture | Artificial IntelligenceHybrid work schedule | Travel for customer visits and events | Workshops seminars and community buildingSenior-level Full TimeLondon, United Kingdom; Paris, France R1d ago
-
Data Engineer Azure – Digital Factory (H/F) EUR 42K-47KAlerting | Azure | Azure Container | Azure Container Instances | Azure DataLong-term mission | Onboarding program | Prime vacances | Referral bonus | Technical communitiesEntry-level Full TimeNeuilly-sur-Seine, IDF, France R2d ago
-
Consultant.e Data Engineer AWS H/F EUR 42K-49KACID | AWS | Agile | Airflow | BASEAWS account | Flexible telework | Laptop reimbursement | Udemy Business | Wellness subscriptionEntry-level Full TimeLevallois-Perret, IDF, France R2d ago
-
Ingénieur·e Data (H/F) EUR 50K-60KAWS | Apache Airflow | Apache Hadoop | Cloud Computing | Data GovernanceAgile environment | Career growth | Collaborative team | Remote work | Skills developmentSenior-level Full TimeLILLE, France R2d ago
-
Amazon Redshift | CI/CD | DBT | Data Cleansing | Data ModelingCareer development opportunities | Charitable contributions | Family health insurance | Fitness reimbursement | Private pension contributionsMid-level Full TimeFrance R2d ago
-
GenAI Engineer EUR 15K-15KArchitecture | FastAPI | FinOps | Google Cloud | LLMAfterworks | Company vacation bonus | DevFest | Employee profit-sharing | MacBook ProEntry-level Full TimeToulouse R2d ago
-
Data Engineer - Aerospatial - Toulouse EUR 47K-60KAmazon Web Services | Apache Hadoop | Apache Spark | Cloud platform | Data pipelineEmployee representative council | Health insurance | Meal vouchers | Mentorship | Profit-sharing bonusSenior-level Full TimeColomiers, Occitanie, France R3d ago
-
AWS Glue | AWS Lambda | Airflow | Amazon Athena | Amazon ECSAsync-friendly culture | Company offsites | Conference support | Flexible working hours | Fully remoteSenior-level Full TimeFrance R3d ago
-
Data Engineer confirmé(e) - Assurance - Lille EUR 45K-48KAmazon Web Services | Apache Kafka | CI/CD | Data Governance | Data ProcessingEmployee engagement bonus | Employee representative council | Health insurance | Meal vouchers | Referral bonusMid-level Full TimeVilleneuve-d'Ascq, Hauts-de-France, France R3d ago
-
Senior-level Full TimeVitrolles, Provence-Alpes-Côte d'Azur, France R3d ago