Senior Data Engineer
Tasks
- Build and monitor ETL pipelines
- Collaborate with analysts data scientists and software engineers
- Configure Azure Data services
- Design ETL pipelines
- Ensure data governance
- Ensure data performance best practices
- Ensure data quality
- Implement scalable data processing workflows
- Operate Azure Data Factory
- Operate Databricks
- Translate business needs into secure data products
Perks/Benefits
Skills/Tech-stack
Apache Spark | Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Functions | Bash | Data Factory | Data Lake Storage | Databricks | Docker | ETL | Git | Kubernetes | Linux | NumPy | Pandas | PySpark | Python | SQL
Education
N/A
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R13d ago
-
Senior Data Engineer – Data Quality & Observability |1789 MXN 911K-1300KAlerting | Amazon Aurora | Amazon Aurora PostgreSQL | Amazon Redshift | Aurora PostgreSQLCross-functional collaboration | Fully remote | Opportunity for ownershipSenior-level Full TimeChihuahua, Mexico R4h ago
-
Senior AI Engineer (m/f/d) EUR 36K-45K.NET | AI Search | AIOps | API Integration | AngularChildcare support | Coursera access | Experience days | Flexible hours | Free specialist access for health wellbeingSenior-level Full TimeGranada, AN, Spain R7h ago
-
AWS SageMaker | Airflow | Amazon EC2 | Amazon EKS | Computer VisionContinuous learning and development | Flexible schedule | Fully remote | Mentorship opportunitiesMid-level Full TimeIndia R12h ago
-
Anthropic | Benchmarking | CI/CD | Docker | FastAPIAutonomy | Fully remote | PJ contract structureSenior-level Full TimeBrazil R13h ago
-
API documentation | Airflow | Amazon Web Services | Apache Beam | Apache SparkBirthday day off | Dental insurance | Educational support programs | Fitness and wellness partnerships | Fully remote workMid-level Full TimeBrazil R13h ago
-
Senior Machine Learning Engineer AUD 148K-210KAccess Control | Agent systems | CI/CD | Capabilities Based Access Control | Error RecoveryHealth and wellness benefits | Hybrid work schedule | Remote work flexibilitySenior-level Full TimeAustralia - Melbourne - Hybrid R18h ago
-
Staff Machine Learning Engineer AUD 140K-185KAWS | Amazon ECS | Amazon ElastiCache | Amazon S3 | Audit LoggingSenior-level Full TimeAustralia - Melbourne - Hybrid R18h ago
-
Senior Machine Learning Engineer AUD 148K-210KACID | Distributed Systems | Durable Execution | Event Sourcing | Fault ToleranceHybrid work | Remote work flexibilitySenior-level Full TimeAustralia - Melbourne - Hybrid R18h ago
-
API Development | Autogen | C# | C++ | Cloud PlatformsLong-term engagement | Paid Holidays | Remote work | Training and professional growthMid-level Full TimeIndia Gate, New Delhi, India - … R18h ago
-
Software Engineer AI/ML USD 112K-150KA/B | A/B Testing | AWS | Anomaly Detection | Automated testingDental insurance | Employee assistance program | Health and wellness programs | Health insurance | Retirement benefitsMid-level Full TimeEvendale, United States R18h ago
-
Senior Backend Engineer, AI Engineering: Chat GBP 91K-115KGraphQL | Langchain | Langgraph | Performance Tuning | PostgreSQLEquity compensation | Flexible paid time off | Growth and development fund | Parental leave | Remote workSenior-level Full TimeRemote, United Kingdom R18h ago
-
AI workflows | API Integration | Big Data | Big Data Technologies | Cloud ComputingFlexible work environment | Hybrid work | Professional development opportunities | Supportive leadershipSenior-level Full TimeMumbai - Hiranandani, India R18h ago
-
Lead Machine Learning Engineer CAD 156K-251KAWS | Azure | CI/CD | Cloud Computing | Cloud platformAutonomy | Career development support | Learning and development programs | Mentorship and coachingSenior-level Full TimeToronto, Canada R19h ago
-
Lead Machine Learning Engineer USD 172K-276KAmazon Web Services | Azure | CI/CD | Cloud platform | DatabricksLearning and development programs | Mentorship and coachingSenior-level Full TimeChicago, Illinois, USA R19h ago
-
Alternance Data Analytics & AI (H/F) EUR 41K-55KArtificial Intelligence | Big Data | Data Science | Data analytics | Machine LearningActionnariat salarié | Mutuelle familiale avantageuse | Programme Share for You | Restaurant d'entreprise | Télétravail 2 jours par semaineEntry-level Apprenticeship Part TimeEurope, France, Ile de France, CERGY-PONTOISE R20h ago
-
Solution Engineer USD 165K-216KAnalytics | Cloud Computing | Data Lake | Data Warehousing | Data fabricSenior-level Full TimeUS-FL-Remote R20h ago
-
Alerting | Audit Logging | Authentication | Debugging | EvaluationComprehensive benefits package | Equity | PTO | Remote-first cultureMid-level Full TimeManizales, Colombia R21h ago
-
Senior Data Engineer USD 126K-180KAmazon Kinesis | Apache Airflow | Apache Beam | Apache Flink | Apache Spark401k match | Bonus | Equity grant | Flexible time off | Health plansSenior-level Full TimeNew York, New York; Miami, Florida; … R21h ago
-
Applied AI Engineer USD 135K-175KAWS | Agent systems | Agentic Workflows | Data Privacy | Data privacy frameworksFlexible PTO | Fully remote team | Monthly cell and internet stipend | OneTeam Culture | Parental leaveSenior-level Full TimeRemote R21h ago
-
Senior Analytics Engineer USD 126K-180KAutomation | BI reporting | DBT | Data Modeling | Data Quality401k with company matching | Bonus | Equity grant | Flexible time off | Health plansSenior-level Full TimeNew York, New York; Miami, Florida; … R21h ago
-
Mid-level Full TimeArgentina, Remote R21h ago
-
Mid-level Full TimeBogota, Colombia R21h ago
-
AI Engineer II - Marketing USD 39K-72KAPI Development | AWS | Backend Development | CI/CD | DockerRemote workMid-level Full TimeMexico, Remote R21h ago
-
AI Engineer II - Marketing USD 39K-72KAWS | CI/CD | Docker | Entity recognition | Feature EngineeringFull-time employment | Remote workMid-level Full TimeBrazil, Remote R21h ago