Director of Engineering, Lakehouse Platform
Boston, Massachusetts, United States
USD 230K-278K (estimate) Executive-level Full Time
Tasks
- Apply AI to data quality and schema inference
- Build systemic production fixes
- Coach engineers with mentorship and feedback
- Contribute to AI platform strategy
- Contribute to AI-assisted development practices
- Define integration contracts and shared execution roadmaps
- Define lakehouse developer platform and developer experience
- Design storage and catalog architecture
- Develop spark query engine and execution strategy
- Drive sprint execution and quarterly delivery commitments
- Drive technical and operational strategy
- Establish data durability and protocol compatibility
- Hire and develop senior engineers
- Implement observability instrumentation
- Lead incident response and root cause analysis
- Lead infrastructure foundations
- Lead open table formats and governance evolution
- Manage platform data pipelines and releases
- Own lakehouse platform architecture
- Perform build vs buy evaluation
- Set engineering standards for testing and release safety
- Support anomaly detection and platform observability
- Write code and ship internal tools
Perks/Benefits
- 401k
- Employer Paid Benefits
- Flexible working arrangements
- LTD/STD
- Life insurance
- Stock options
- Unlimited paid time off
Skills/Tech-stack
AI Assisted Development | API contracts | AWS | Anomaly Detection | Apache Flink | Apache Iceberg | Apache Kafka | Apache Spark | Auditability | Azure | Cause analysis | Cloud Native | Containerization | Data Catalog | Data Engineering | Data Governance | Data Pipelines | Data Quality | Data durability | Databricks | Delta Lake | Distributed Systems | GCP | Incident Response | Infrastructure as Code | Metadata catalog | Observability | Open Table Formats | Open table | Partitioning strategies | Root Cause Analysis | Root cause | Schema inference | Streaming | Table formats | Terraform | Versioning | “as-code”
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R25d ago
-
AWS | Agentic AI | Agile | Azure | Business IntelligenceDiscretionary incentive program | Hybrid work model | Mentorship | Professional developmentSenior-level Full TimeAustin, Texas, United States; Dallas, Texas, …3h ago
-
AWS | Artificial Intelligence | Cloud platform | Data Architecture | Data GovernanceTravel 10 to 15 percentSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Washington, District …3h ago
-
Product Management, Director - AI Platforms and Infra USD 249K-323KData Pipelines | Developer experience | Experimentation | Feature Engineering | Machine LearningTeam leadership developmentExecutive-level Full TimeMenlo Park, CA5h ago
-
Product Manager, Responsible AI Infra USD 163K-237KAI Evaluation | Artificial Intelligence | Automated compliance | Compliance | Data GovernanceMid-level Full TimeMountain View, CA, USA5h ago
-
Data Processing | Data orchestration | Data pipeline | Data pipeline management | Dataset ManagementExecutive-level Full TimeSan Jose, CA, USA5h ago
-
Bigtable | C++ | Colossus | Data Processing | Data StorageSenior-level Full TimeMountain View, CA, USA5h ago
-
Senior Data Science Manager USD 160K-200KCausal Inference | Coded Quality | Data Pipelines | Data Visualization | Experiment designSenior-level Full TimeCupertino14h ago
-
Customer Analytics Manager USD 107K-154KBigQuery | Cross-sell | Cross-sell modeling | Customer Health | Customer health scoringMid-level Full TimeRemote - USA R16h ago
-
DevOps Manager USD 152K-210KAmazon Web Services | Ansible | Azure | Cloud platform | Continuous DeploymentMedical benefits | Retirement benefits | Social impact initiatives | Volunteering opportunitiesMid-level Full TimeDallas Office, United States17h ago
-
Sr Engineering Program Manager, AIML Foundation Models USD 165K-293KCo-design | Cross-Functional Collaboration | Cross-functional | Data Pipelines | Distributed TrainingSenior-level Full TimeCupertino19h ago
-
API Design | Data Modeling | Distributed Systems | Low Latency | Low-Latency SystemsHybrid workMid-level Full TimeHQ-San Francisco19h ago
-
Senior Director, Decision Analytics USD 200K-275KAI Automation | ARR | BI Visualization | CAC Payback | Change ManagementDental insurance | Disability insurance | Flexible paid time off | Health insurance | Life insuranceSenior-level Full TimeRemote US R20h ago
-
Financial Data and Analytics Manager USD 95K-142KArtificial Intelligence | Big Data | Big Data Integration | CRM | Data EngineeringHealthcare coverage | Retirement planMid-level Full TimeColumbia, Maryland, United States22h ago
-
AWS | Access Management | Active Active Resilience | Active/Active | AgileExecutive-level Full TimeJersey City, NJ, United States22h ago
-
Executive-level Full TimeUnited States22h ago
-
AI Ready | AI-Ready Data | Business Analytics | Cause analysis | DashboardingMid-level Full TimeLewisville, TX, US23h ago
-
Director, AI & Machine Learning USD 220K-240KAgent systems | Agentic AI | Artificial Intelligence | Conversational AI | Data GovernanceExecutive-level Full TimeFlower Mound, TX, US1d ago
-
Mgr, Product Dev & Analytics USD 69K-75KAzure | Data Modeling | Databricks | Machine Learning | Model ValidationMid-level Full TimeAtlanta, GA, United States R1d ago
-
Director, Analytics & AI Solutions USD 160K-205KAdvanced Analytics | Analytics Strategy | Artificial Intelligence | BI platforms | Data Ecosystem401k | Dental insurance | Discounts | Health insurance | Hybrid scheduleExecutive-level Full TimeUniversal City, CA, United States R1d ago
-
Manager of Data Engineering & Analytics USD 85K-95KAgile | Analytics | Business Intelligence | Cloud Platforms | Data ArchitectureFully remote | Health benefits | Paid time off | Professional development | Retirement planMid-level Full TimeUnited States R1d ago
-
Director, Data & Analytics – Sales & Marketing USD 135K-185KBusiness Analytics | Business Intelligence | Cause analysis | Customer Segmentation | Data GovernanceExecutive-level Full TimeDunwoody, GA, United States1d ago
-
Director, Machine Learning - Search & Recommendation USD 211K-340KAPI Design | Data Integrity | Data Pipelines | Distributed Systems | Experimentation401k matching | Comprehensive medical coverage | Employee stock purchase plan | Paid parental leave | Unlimited PTOExecutive-level Full TimeAustin, Texas, United States; Chicago; Palo …1d ago
-
Senior Manager, Risk Strategy Data Scientist USD 136K-181KAnomaly Detection | Automl | Data Visualization | Deep learning | Excel401k | Dental insurance | Disability insurance | Employee assistance program | Employee recognition programsSenior-level Full TimeUnited States1d ago
-
AI and Analytics Delivery Project Manager USD 131K-218KAWS | Cloud Architecture | Data Analysis | Data Modeling | DatabricksHybrid work | Up to 10 percent travelSenior-level Full TimeGilbert, Arizona, United States; Lake Mary, …1d ago