Senior Data Engineer
Tasks
- Build maintainable modular data models using reusable patterns
- Collaborate with Analytics Engineering Data Science and product partners across ingestion transformation modeling and serving
- Design build test deploy scalable data pipelines that power analytics and decision making
- Design migrate and maintain workflows in Apache Airflow
- Implement monitoring for pipeline failures schema drift and data quality anomalies
- Maintain documentation and improve monitoring and reliability through postmortems
- Monitor workflow SLAs for freshness quality and performance and resolve failures
- Optimize warehouse performance and cost using partitioning indexing and efficient data modeling
- Own data platform initiatives end to end from design to production deployment and operational support
- Participate in on call rotations and perform incident response and root cause analysis
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Automated testing | BigQuery | CI/CD | DBT | Data Modeling | Data Pipeline Monitoring | Data Quality | Data orchestration | Data pipeline | Datadog | Incident Response | Indexing | Kubernetes | Partitioning | Pipeline monitoring | SQL | Schema drift | Warehouse optimization
Education
N/A
Roles
Related jobs
-
Data Engineer - Costa Rica USD 86K-107KAWS | AWS Lambda | Azure | Data Lakes | Data WarehouseBereavement leave | Dental insurance | Disability insurance | Employee assistance program | Employee discount programMid-level Full TimeCosta Rica R3h ago
-
AWS | CI/CD | Data Governance | Data Lakehouse | Data ModelingHybrid work model | International team | Remote work option | Training programSenior-level ContractVilnius, Lithuania (Remote) R3h ago
-
Data Engineer USD 130K-145KApache Spark | CI/CD | Cloud platform | Containerization | Data GovernancePublic trust clearance support | Remote workSenior-level Full TimeWork from home, VA, United States R4h ago
-
Data Engineer / BI Developer (Power BI, Domo) PHP 420K-480KData Modeling | Data Quality | Data Warehousing | Data pipeline | DomoFully remote | Remote work from PhilippinesMid-level ContractAnywhere in the Philippines, Philippines R6h ago
-
Apache Spark | Data Architecture | Data Engineering | Data Optimization | Data ProcessingRemote workEntry-level Full TimeRemote R6h ago
-
Data Engineer (Cloud) GBP 52K-52KApache Airflow | Apache Spark | Azure | CI/CD | Data GovernanceHybrid workingMid-level Full TimeGB-ENG-LAN-Preston R7h ago
-
AI Engineer GBP 52K-54KAI Search | Azure AI | Azure AI Search | CI/CD | DatabricksHybrid work arrangementsSenior-level Full TimeGB-ENG-LAN-Preston R7h ago
-
AI Testing | Agentic AI | Azure Repos | CI/CD | Conversational AIHybrid workSenior-level Contract Full TimeGlasgow, Scotland, United Kingdom R8h ago
-
Azure | CI/CD | Cloudera | DataStage | DatabricksCareer development opportunities | Employee benefits council | Employee bonus | Employee referral bonus | Health insuranceSenior-level Full TimeNantes, Pays de la Loire, France R10h ago
-
Lead Data Engineer EUR 54K-78KAgile | Apache NiFi | Cloud platform | DBT | Data EngineeringHybrid workSenior-level Full TimeFinland R11h ago
-
QA Engineer (SQL, Python & Pyspark) AUD 110K-112KAgile | Bamboo | Bitbucket | CI/CD | DatabricksDiversity and inclusion workplace | Educational benefits | Financial benefits | Flexible work arrangements | Health and wellbeing benefitsMid-level Full TimeSydney, NSW, Australia R12h ago
-
Associate Principal Engineer, Data Science INR 1500K-2000KANOVA | CI/CD | Cloud Architecture | Deep learning | GCPMid-level Full TimeRemote, India R12h ago
-
Associate Principal Engineer, Data Science INR 1500K-2000KANOVA | AWS | Azure | CI/CD | Cloud ArchitectureMid-level Full TimeRemote, India R13h ago
-
Business Intelligence Engineer - Power BI INR 712K-1200KAgile | DAX | Data Modeling | Data Quality | Data WarehousingFlexible hybrid schedule | Health insurance | Life insurance | Paid time off | Personal/family care leaveMid-level Full TimeHyderabad, India R14h ago
-
Mid-level Full TimeRemote, United States R16h ago
-
Senior/Staff Data Analyst USD 180K-210KAnomaly Detection | Automated reporting | DBT | Dashboarding | Data Modeling401k | Disability coverage | Flexible time off | Health coverage | Home office supportSenior-level Full TimeRemote R17h ago
-
Principle Data Engineer USD 220K-235KAWS | Airflow | BigQuery | Capacity Planning | Compliance401k | Equity | Essential equipment | Flexible PTO | Fully remoteSenior-level Full TimeCleveland, OH R20h ago
-
AI Support Engineer II JPY 8000K-8000KAI Platform | AI and ML | AI platform support | AWS | Agentic WorkflowsDental insurance | Flexible time off program | Global Employee Assistance Program EAP | Medical insurance | Paid HolidaysMid-level Full TimeRemote Japan R20h ago
-
Mid-level Full TimePune - Tower 6, India R20h ago
-
Data Engineer GBP 45K-52KAmazon Web Services | Apache Spark | CloudWatch | Data Modeling | DatabricksAnnual bonus | Annual leave | Early Finish Friday | Electric vehicle scheme | Employee assistance programmeMid-level Full TimeOxford/ Hybrid, GB, OX4 4DQ R20h ago
-
Associate, Data Engineer (Test Automation) INR 1524K-2156KAPI Testing | AWS | Azure | CI/CD | Cause analysisComprehensive healthcare | Flexible time off | Hybrid work model | Retirement plan | Support for working parentsMid-level Full TimeBL4 - KNG Tower 1, Indiqube … R20h ago
-
Apache Airflow | AtScale | BigQuery | CI/CD | Cloud DataSenior-level Full TimeGEORGIA - VIRTUAL - GA01, United … R20h ago
-
Airflow | BigQuery | CI/CD | Data Modeling | Data WarehousingRemoteMid-level Full TimeGEORGIA - VIRTUAL - GA01, United … R20h ago
-
Engenheiro(a) de dados Sênior BRL 54K-72KAWS | Apache Airflow | Apache Spark | Code review | Data CatalogSenior-level Full TimeRemote R21h ago
-
Member of Technical Staff (Data): World Models SGD 165K-214KAccess Control | Annotations | Apache Spark | Backward Compatibility | Data CatalogSenior-level Full TimeUS, Singapore, Remote R22h ago