Senior Manager, Data Engineering
Tasks
- Build Spark Structured Streaming pipelines
- Configure exactly once sinks
- Control pipeline and dataset cost
- Define data quality SLOs
- Design lakehouse ingestion to serving pipeline
- Implement watermarking and checkpoint recovery
- Manage Apache Iceberg table lifecycle
- Optimize query performance with Trino
- Own data ingestion framework
- Run 24x7 on call incident response
- Set dbt modeling standards
Perks/Benefits
- Continuous learning
- Hybrid work
- Leadership development
- Professional certifications
- Quarterly perks program
- Time off
Skills/Tech-stack
AWS | Apache Iceberg | Apache Spark | Argo | CI/CD | Checkpoint Restart | Checkpointing | DBT | Data Contracts | Data Lineage | Data Quality | Debezium | Exactly once | GitOps | Jenkins | Kafka | Kafka Streams | Kubernetes | PySpark | SLO | Spark Structured Streaming | Structured Streaming | Terraform | Terraform Opentofu | Trino | Watermarking
Education
N/A
Related jobs
-
AWS QuickSight | DBT | Data Analysis | Data Modeling | Data Quality401k benefits | Baby bonding leave | Commuter benefits | Dental insurance | Disability insuranceMid-level Full TimeUS Remote R14h ago
-
Technical Delivery Lead USD 157K-235KAutomated testing | CI/CD | Cloud automation | CloudWatch | Dynatrace401k employer match | AD D coverage | Dental insurance | Disability coverage | Employer-paid retirement planSenior-level Full TimeRemote, United States R15h ago
-
AWS | Ansible | Automation | BAM | Bioinformatics401k match | Commuter benefits | Employee referral program | Fertility care benefits | Free employee genetic testingSenior-level Full TimeUS Remote R16h ago
-
Sr Manager, Data Engineering USD 135K-170KAgile | Amazon Web Services | Azure | Cloud Computing | Cost OptimizationSenior-level Full TimeClearwater, FL, United States17h ago
-
Data & Analytics Engineering Manager USD 185K-200KA/B | A/B Testing | AI tools | Agile | Alert triageSenior-level Full TimeNew York, NY R21h ago
-
UIGTM Analytics Executive Director USD 200K-301KBusiness Intelligence | Customer Data | Customer Data Management | Dashboarding | Data GovernanceFinancial benefits | Health and wellness benefitsExecutive-level Full TimeUS (non-CA) Off-Site Office, US (non-CA) …21h ago
-
AWS | Automated testing | Big Data | Cloud Native | Code reviewSenior-level Full TimePlano, TX, United States22h ago
-
Senior-level Full TimeFAIRFAX, VA, United States1d ago
-
Sr. Databricks Consultant - Secret Clearance USD 175K-250KAWS S3 | Agile | Amazon Kinesis | Apache Kafka | Apache SparkSenior-level Full TimeWork from home, VA, United States1d ago
-
Lead AI Engineer-Machine Learning USD 100K-115KAWS | Agile | Azure | CI/CD | Computer Vision401k match | Dental insurance | Disability insurance | Growth opportunities | HolidaysSenior-level Full TimeParsippany, NJ, United States1d ago
-
Enterprise Analytics Lead USD 119K-222KABAP | Access Control | Analysis Services | Analytics Cloud | Azure SynapseExtra day off every other week | Flexible 9/80 schedule | In office with flexible scheduleSenior-level Full TimePortsmouth, NH, United States1d ago
-
Data Governance & Enablement Manager USD 115K-153KAI Governance | AWS | Advanced Analytics | Alation | Audit managementMid-level Full TimeMiami Lakes, FL, United States1d ago
-
AI Architect Lead (Hybrid-within BankUnited's footprint) USD 148K-205KAI Foundry | AWS | AWS Bedrock | Artificial Intelligence | AutogenSenior-level Full TimeMiami Lakes, FL, United States1d ago
-
Applied Machine Learning Manager - Application Fraud USD 200K-250KAWS | Applied statistics | Code review | Data labeling | Elasticsearch401k match | Company in person events | Employer-paid health insurance | Flexible paid time off | Home office stipendSenior-level Full TimeUnited States R1d ago
-
Senior-level Full TimeRochester, NY, US1d ago
-
AI Governance | AWS | Agentic AI | Artificial Intelligence | Cloud Architecture401k plan | Bonus opportunities | Dental insurance | Life insurance | Long-Term Disability coverageSenior-level Full TimeChicago, Accenture Tower, Corp, United States1d ago
-
Business Intelligence | Data Quality | Data integration | PowerBI | SQL401k match | Dental insurance | Educational assistance | Health insurance | Paid time offSenior-level Full TimeOne PNC Plaza (PA370), United States1d ago
-
Data Architecture/Data Fabric Senior Manager - Utilities USD 132K-338KAPI Architecture | Azure Synapse | Cloud Data | Cloud Data Platforms | Data Architecture401k plan | Bonus opportunities | Dental insurance | Life insurance | Long-term disabilitySenior-level Full TimeChicago, Accenture Tower, Corp, United States1d ago
-
Data Architecture/Data Fabric Manager - Utilities USD 94K-293KAPI | Active metadata | Azure Synapse | BigQuery | Cloud Data401k plan | Dental insurance | Life insurance | Long-term disability | Medical insuranceSenior-level Full TimeSeattle, 1191 2nd Avenue, Corp, United …1d ago
-
AI Governance | AWS | Azure | C# | C++Senior-level Full TimeNew York, NY, United States1d ago
-
AWS | Azure | C# | C++ | Cloud ComputingSenior-level Full TimeNew York, NY, United States1d ago
-
Lead Machine Learning Engineer USD 197K-225KAWS | Apache Spark | Azure | Bias Variance | Cloud platformSenior-level Full TimeMcLean, VA, United States1d ago
-
Lead Machine Learning Engineer USD 197K-225KAWS | Apache Spark | Bias Variance | Cloud Computing | Cloud platformSenior-level Full TimeMcLean, VA, United States1d ago
-
Manager, Data Scientist, Data Solutions and Modeling USD 179K-204KAI Agent | AWS | Apache Spark | Conda | Data analyticsMid-level Full TimeChicago, IL, United States1d ago
-
Sr. Manager, Business Analytics and Automation USD 120K-265KAdvanced Analytics | Agentic AI | Artificial Intelligence | Automation | Business IntelligenceContinuing education | Family support | Flexible time off | Healthcare | Learning and developmentSenior-level Full Time507 RESTON VA, United States1d ago