Senior Data Engineer
Tasks
- Build maintainable modular data models and reusable pipelines
- Collaborate with Analytics Engineering Data Science and stakeholders
- Design migrate and maintain Apache Airflow workflows
- Design, build, test, and deploy scalable data pipelines
- Implement monitoring for failures schema drift and data quality anomalies
- Improve documentation monitoring and reliability through postmortems
- Monitor workflow SLAs freshness quality and performance
- Optimize warehouse performance and control BigQuery cost
- Own data platform initiatives end to end
- Participate in on call rotations and resolve data incidents
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Automated testing | BigQuery | CI/CD | Cause analysis | DBT | Data Modeling | Data Observability | Data Pipeline Monitoring | Data Quality | Data Warehousing | Data orchestration | Data pipeline | ETL | Incident Response | Indexing | Kubernetes | Partitioning | Pipeline monitoring | Root Cause Analysis | Root cause | SQL | Schema drift
Education
N/A
Roles
Related jobs
-
NLP Engineer (Remote) INR 2000K-3000KAsynchronous programming | BERT | Batch Processing | Data Preprocessing | ETLMid-level Full TimeGurgaon, India R8h ago
-
API Integration | Azure | CI/CD | Databricks | DevOpsContract position | Remote workSenior-level ContractRemote R9h ago
-
Senior-level Full TimeHybrid, Hyderabad, Telangana, India R10h ago
-
APIs | Data Analysis | Data Modeling | Data Visualization | JavaScriptFlexible working hours | Fully remote | Independent contractorMid-level Full TimePhilippines - Remote R22h ago
-
Senior Data Engineer EUR 50K-70KAWS S3 | Amazon Web Services | Apache Airflow | Apache Spark | Azure DatabricksAnnual team trip | Flexible working hours | Health insurance | Laptop and peripherals | Open holidaysSenior-level Full TimePorto, Porto District, Portugal - Remote R22h ago
-
Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | Capacity PlanningKnowledge transfer opportunities | Remote workSenior-level Full TimeEgypt - Remote R22h ago
-
Senior Data Engineer INR 600K-1500KAgile | Analysis Services | Archimate | Azure Analysis | Azure Analysis ServicesSenior-level Full TimeIndia-Hyderabad-Remote R22h ago
-
Batch Processing | Data Lake | Data Lakehouse | Data Warehouse | Data pipelineMid-level Full TimeHybrid, Canada R22h ago
-
Machine Learning Engineer- AI USD 136K-225KAWS | Agentic AI | As-a-Service | Autogen | Cause analysis401k employer match | Comprehensive medical, dental, and vision | Paid parental leave | Paid time offMid-level Full TimeBoston, United States R22h ago
-
Analysis Services | Azure | Azure Data | Azure Data Factory | Azure DevOps401k match | Flexible work environment | Medical, dental & vision coverage | PTO program | Professional developmentSenior-level Full TimeMinnesota R1d ago
-
Azure Data | Azure Data Factory | CI/CD | Data Factory | High Availability401k match | Career growth | Collaborative work culture | Dental insurance | Flexible work environmentMid-level Full TimeColorado R1d ago
-
Analysis Services | Azure | Azure Data | Azure Data Factory | CI/CD401 k company match | Collaborative work culture | Flexible work environment | Medical, dental, and vision coverage | PTO programSenior-level Full TimeFlorida R1d ago
-
Azure | Azure Data | Azure Data Factory | CI/CD | Data Factory401k company match | Medical, dental, and vision coverage | PTO | Remote work | Tuition reimbursementMid-level Full TimeCalifornia R1d ago
-
Alerting | Azure DevOps | Bash | CI/CD | DBTFlexible working hours | Fully remote | Learning and developmentMid-level Full TimeBrazil - Remote R1d ago
-
DevOps Engineer USD 110K-135KAWS | AWS SSM | Ansible | Bash | CI/CD401k matching | Dental insurance | Medical insurance | Paid time off | Vision insuranceMid-level Full TimeUnited States R1d ago
-
Amazon Redshift | Data Pipelines | Data Warehousing | Django | ETLSenior-level Full TimeGermany R1d ago
-
Experienced Data Engineer - Streaming Platform EUR 60K-80KAmazon Kinesis | Apache Flink | Apache Kafka | Apache Pulsar | AvroChild day care facilities | Gym membership | Meal voucher | Premium healthcare coverage | Relocation supportMid-level Full TimeParis R1d ago
-
Data Engineer CAD 145K-162KApache Flink | Apache Kafka | Apache Spark | Apache Superset | Cloud platformAWS related benefits | Career path development | Paid national holidays | Paid time off | Professional education resourcesSenior-level Full TimeRemote R1d ago
-
Senior Software Engineer (Golang/Python) USD 124K-203KAPIs | AWS | CI/CD | Distributed Systems | DockerFlexible collaboration | Remote workSenior-level Contract Full TimeLatin America R1d ago
-
Data Engineer USD 95K-178KAWS | AWS Cloud | AWS Cloud Development Kit | AWS cloud development | Amazon QuickSightSenior-level Full TimeRemote R1d ago
-
AWS | Algorithm Design | Amazon Web Services | Distributed Systems | Django100 percent remote | Equipment program | Flexible scheduling | Open time-off policy | Paid time offMid-level Full TimeRemote job R1d ago
-
Data Analytics Engineer II USD 77K-179KAmazon Redshift | BI tools | Cause analysis | Cohort Analysis | Columnar Data WarehouseChild and eldercare resources | Education assistance | Flexible work anywhere | Health insurance | Mental health resourcesMid-level Full TimeRemote, United States R1d ago
-
Data Engineer CAD 88K-130KAWS Glue | AWS Glue Studio | AWS Lambda | AWS Step Functions | Amazon CloudWatchCollaborative & Inclusive Culture | Dress for your day environment | Education funding | Employee stock ownership plan | Flexible work arrangementsMid-level Full TimeCanada - Remote R1d ago
-
C# | Combinatorics | Graph theory | MATLAB | NumPyEnglish CV required | Flexible project workload | Part-time availability | Project-based assignmentsSenior-level FreelanceFrance - Remote R1d ago
-
Combinatorics | Graph theory | MATLAB | NumPy | Number theoryEnglish CV required | Flexible part-time schedule | Project based workSenior-level FreelanceUnited Kingdom - Remote R1d ago