Data Engineering Manager
Tasks
- Align batch and real time data patterns
- Build ETL and ELT pipelines
- Collaborate with data product management on SLAs and KPIs
- Conduct architectural reviews
- Define engineering KPIs for reliability latency and throughput
- Design scalable batch and streaming data platforms
- Develop streaming data pipelines
- Drive platform strategy and technical direction
- Establish engineering standards and code quality practices
- Implement partitioning strategies
- Improve query performance
- Integrate streaming systems with APIs and microservices
- Lead data engineering teams
- Manage orchestration and schema evolution
- Mentor engineers in distributed systems and production reliability
- Optimize data modeling standards
- Optimize storage for analytics workloads
- Plan sprints and sequence roadmaps
Perks/Benefits
Skills/Tech-stack
Cloud Native | Cloud Native Architecture | Data Lakes | Data Modeling | Data Warehouses | Data orchestration | Distributed Systems | ELT | ETL | Event Driven | Event-driven architecture | Kafka | Lakehouse | Partitioning | Schema evolution | Storage Optimization | Streaming Data
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Operations Analytics Manager USD 140K-170KBusiness Analytics | Capacity Planning | Data Engineering | Data Governance | Data Modeling401k retirement savings | Equity in high growth startup | Healthcare FSA/HSA subsidy | Medical, dental, and vision coverage | Paid HolidaysMid-level Full TimeRemote, United States R9h ago
-
Product Manager, Robotics & Physical AI USD 140K-176KCalibration | Coordinate systems | Data Annotation | Data Capture | Data PipelinesRegular travel | Remote workMid-level Full TimeRemote, US R10h ago
-
Physical AI Robotics Product Manager USD 140K-176KAgile | Calibration | Computer Vision | Coordinate frames | Data QualityHands on impact in early market | Regular travel to data collection sites | Remote work optionMid-level Full TimeRemote, US R10h ago
-
Director, Data Engineer USD 174K-290KAmazon S3 | Apache Airflow | Apache Spark | DBT | Dagster401k match | Commuter benefits | Dental insurance | Disability insurance | Electric car chargingExecutive-level Full TimeMountain View, USA13h ago
-
AWS | Analytics | Architecture Design | Azure | Cloud ArchitectureSenior-level Full TimeRemote - California; Remote - Colorado; … R15h ago
-
Senior Manager, Head of Data & AI USD 140K-170KAI Governance | AI RMF | Access Management | Analytics | Apache SparkHybrid workSenior-level Full TimeLake Mary, FL, US15h ago
-
Sr. Engineering Manager, Inference USD 188K-303KAPI Design | API Tracing | Autoscaling | Cloud infrastructure | Compliance401k employer match | Casual work environment | Catered lunch | Company paid life insurance | Employee stock purchase programSenior-level Full TimeLivingston, NJ / New York, NY … R16h ago
-
Staff Product Manager, Embedded USD 280K-350KAPI | API Design | API Integration | Data Modeling | Developer experienceHybrid work | Remote work up to four weeks per yearSenior-level Full TimeNew York, New York, United States R17h ago
-
Staff Product Manager, Embedded USD 280K-350KAPI Design | API Integration | Data Modeling | Developer experience | Distributed SystemsHybrid work environment | Remote work up to four weeks per yearSenior-level Full TimeSeattle, Washington, United States R17h ago
-
Staff Product Manager, Embedded USD 280K-350KAPI Design | Architecture | Data Modeling | Developer experience | Distributed SystemsHybrid work | In office coordination days per week | Remote work up to four weeks per yearSenior-level Full TimeSan Francisco, California, United States R17h ago
-
Principal, Data Analyst/BI Engineer USD 108K-145KAWS | BigQuery | Cloud platform | Data Governance | Data Modeling401k matching | Dental coverage | Healthcare coverage | Paid Holidays | Paid time offSenior-level Full TimeUnited States R17h ago
-
Data Analyst, Product USD 96K-192KA/B | A/B Testing | Airflow | Analytics | B testingOngoing application acceptance | Remote workSenior-level Full TimeUnited States22h ago
-
Senior Staff Data Science Manager, Ads Metrics USD 262K-364KArtificial Intelligence | Data Modeling | Data Quality | Machine Learning | PythonSenior-level Full TimeMountain View, CA, USA23h ago
-
Manager, Consumer Performance Analytics USD 98K-130KAirflow | Alteryx | Attribution | Campaign analytics | Data ModelingMid-level Full TimePortland, OR, US R1d ago
-
Senior-level Full TimeUSA1d ago
-
Senior Software Engineer, Data Engineering Platform USD 186K-218KAPI Design | Bitcoin | Blockchain Protocols | Distributed Systems | Ethereum401k | Medical, dental, vision benefits | Quarterly in person working sessions | Remote-first work environmentSenior-level Full TimeRemote - USA R1d ago
-
AWS | Airflow | Azure | BigQuery | Cloud Native401k contribution | Comprehensive benefits package | Equity stock purchase | Incentive and recognition programsSenior-level Full TimeMinneapolis, Minnesota, UNITED STATES; REMOTE R1d ago
-
API Integration | Azure | Cloud Architecture | Data analytics | DatabricksConnectivity reimbursement | Equipment provided | Remote workMid-level Full TimeUSA - OR (Remote), United States R1d ago
-
Manager Content Data Engineering USD 136K-217KCanonical Data | Canonical Data Model | Data Model | Data Modeling | Data QualityFlexible hours | Sabbatical | Shared parental leave | Study assistance | Wellbeing initiativesMid-level Full TimeHome based-North Carolina, United States R1d ago
-
AWS | AWS Glue | Ansible | Apache Iceberg | Apache Spark401k match | Dental insurance | Flexible time off | Medical insurance | Mindfulness programsExecutive-level Full TimeSunnyvale, CA1d ago
-
Anomaly Detection | Change Management | Data Governance | Data Modeling | Data QualityRemote workSenior-level Full TimeRemote, United States R1d ago
-
Agile | Amazon Web Services | Atoti | Backlog Refinement | Cloud PlatformsBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersExecutive-level Full TimeJersey City, NJ, United States1d ago
-
Senior Manager, Data Platform & Autonomy Infrastructure USD 250K-300KAutonomy | Cloud infrastructure | Data Ingestion | Data Modeling | Data ProcessingDental insurance | Equity compensation | Medical insurance | Paid time off | Performance bonusSenior-level Full TimeSouth San Francisco, California, USA1d ago
-
Project Manager USD 170K-175KAgile project management | Big Data | CI/CD | Data Modeling | Data QualityTelecommuting allowedMid-level Full TimeNew York, United States R1d ago
-
AI | Amazon Aurora | Amazon S3 | Apache Hadoop | Apache SparkSenior-level Full TimeSeattle1d ago