Data Engineering Manager
Tasks
- Align batch and real time data patterns
- Build ETL and ELT pipelines
- Collaborate with data product management on SLAs and KPIs
- Conduct architectural reviews
- Define engineering KPIs for reliability latency and throughput
- Design scalable batch and streaming data platforms
- Develop streaming data pipelines
- Drive platform strategy and technical direction
- Establish engineering standards and code quality practices
- Implement partitioning strategies
- Improve query performance
- Integrate streaming systems with APIs and microservices
- Lead data engineering teams
- Manage orchestration and schema evolution
- Mentor engineers in distributed systems and production reliability
- Optimize data modeling standards
- Optimize storage for analytics workloads
- Plan sprints and sequence roadmaps
Perks/Benefits
Skills/Tech-stack
Cloud Native | Cloud Native Architecture | Data Lakes | Data Modeling | Data Warehouses | Data orchestration | Distributed Systems | ELT | ETL | Event Driven | Event-driven architecture | Kafka | Lakehouse | Partitioning | Schema evolution | Storage Optimization | Streaming Data
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Apache Spark | Azure | Azure Data | Azure Data Lake | Azure Data Lake StorageHands-on project experience | Mentorship from engineers | Onsite work 5 days per week | Team collaborationEntry-level Full TimeIrvine, CA, US1d ago
-
Apache Spark | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsLearning opportunities | Mentorship | On site work 5 days per week | Team collaborationEntry-level Full TimeIrvine, CA, US1d ago
-
Director Data Engineering USD 178K-255KARM | Agile | Amazon Web Services | Azure Data | Azure Data Factory401k match | Company paid life insurance | Employee assistance program | Health, dental, and vision insurance | Paid time offExecutive-level Full TimeLeawood, KS, US1d ago
-
On-device ML Engineering Manager (Tools & Services) USD 183K-296KBackend Development | Benchmarking | C++ | Compilers | Core MLMid-level Full TimeSeattle1d ago
-
AI & Data Analytics Opportunities USD 125K-195KA/B | A/B Testing | API Integration | Access Management | B testing401k matching | Accidental death and dismemberment insurance | Child and elder care days | Company holidays | Dental insuranceMid-level Full TimeNeedham, MA, United States1d ago
-
Director, Data Engineering USD 195K-220KAgile | Airflow | Amazon Web Services | Analysis Services | Apache Hive401k match | Bonus opportunity | Dental insurance | Direct Deposit | Employee assistance programExecutive-level Full TimePennsauken, NJ 08109 | 39.950866919 | … R1d ago
-
Sr. Manager, Technical Delivery USD 177K-232KArtificial Intelligence | Bash | Data Transformation | Data Warehousing | Data analyticsCareer growth opportunities | Mentorship and coaching | Travel up to 25 percentSenior-level Full TimeUS-IL-Chicago-MSO1d ago
-
Manager, Business Analytics USD 140K-202KBusiness Intelligence | Dashboarding | Data Mining | Data Modeling | Data Quality401k | Dental insurance | Health insurance | Long-term incentive program | Paid time offSenior-level Full TimeNorth Chicago, IL, United States1d ago
-
Senior Manager, Data Engineering USD 104K-123KAgile | Azure DevOps | Business Intelligence | CI/CD | Cause analysisSenior-level Full TimeN/A, N/A, United States R1d ago
-
Senior Manager, Data Science - Styling Algorithms USD 200K-246KA/B | A/B Testing | Agentic AI | Artificial Intelligence | B testingAnnual bonus | Dental insurance | Equity grants | Health insurance | Restricted stock unitsSenior-level Full TimeRemote USA R1d ago
-
AVP, Business Intelligence & Analytics USD 125K-150KAnalytics | Business Intelligence | Dashboard Development | Data Analysis | Data GovernanceExecutive-level Full TimeBoston1d ago
-
API | Access Control | Agile | Apache Iceberg | Apache SparkExecutive-level Full TimeDallas, TX, United States1d ago
-
Director, Data Engineering (Google Cloud Platform) USD 180K-220KAgent platform | Apache Beam | BigQuery | BigQuery ML | CI/CDFinancial benefits | Income protection benefits | Medical/Dental/Vision insurance | Paid time off | Tax-advantaged health care accountsExecutive-level Full TimeAustin, TX1d ago
-
Access Control | Access Management | Data Access Management | Data Catalog | Data ComplianceMid-level Full TimePrinceton, New Jersey1d ago
-
Senior-level Full TimeMiami, United States R2d ago
-
Senior-level Full TimeFlorida, United States2d ago
-
Manager of Operations Performance & Analytics USD 71K-83KBudgeting | Business Intelligence | Cause analysis | Dashboards | Data AnalysisMid-level Full TimeTAMPA, FL, United States2d ago
-
Data Engineering Consultant USD 401KAWS | Apache Airflow | Azure | Azure Data | Azure Data Factory401k Retirement Plan Employer Match | Dental insurance | Disability coverage | Flexible holiday schedule | Health insuranceMid-level Full TimeBedminster, United States2d ago
-
Technical Program Manager, Cloud Databases USD 192K-278KAlloyDB | Cloud Bigtable | Cloud SQL | Cloud Spanner | Database enginesSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA2d ago
-
Budget Management | Clinical data | Clinical data standards | Contract Management | Data ModelingHealth coverage | Paid parental leave | Paid time off | Professional development | Retirement planSenior-level Full TimeCincinnati, OH, US, 45221 R2d ago
-
Technology 2027 Intern - Data Engineering USD 52K-89KData Analysis | Data Architecture | Data Pipelines | Data integration | Database systemsOn site work collaborationEntry-level Full Time InternshipAustin, TX, United States2d ago
-
Manager, Data Engineering USD 200K-335KApache Airflow | Apache NiFi | Apache Spark | BigQuery | Cloud platformSenior-level Full TimeUS - San Francisco R2d ago
-
Data Engineering Lead USD 174K-220KAmazon Redshift | BI reporting | DBT | Data Modeling | Data Monitoring401k | Health coverage | Hybrid work environment | Paid parental leave | Paid time offSenior-level Full TimeNew York R2d ago
-
Enterprise Data Architect Internship USD 40K-60KApplication Programming | Application Programming Interfaces | Artificial Intelligence | Cloud Computing | Data CatalogCompany-sponsored events | Hybrid work schedule | Intern socials | Mental health advocate services | MentorshipEntry-level InternshipColumbus, IN, United States2d ago
-
Agile | Artificial Intelligence | Backlog Management | Continuous Improvement | Data EngineeringCompany sponsored medical insurance | Company-sponsored dental insurance | Company-sponsored life insurance | Company-sponsored vision insurance | Paid time offSenior-level Full TimeUS - NC - Raleigh, United …2d ago