Director of Engineering, Lakehouse Platform
Boston, Massachusetts, United States
USD 230K-278K (estimate) Executive-level Full Time
Tasks
- Apply AI to data quality and schema inference
- Build systemic production fixes
- Coach engineers with mentorship and feedback
- Contribute to AI platform strategy
- Contribute to AI-assisted development practices
- Define integration contracts and shared execution roadmaps
- Define lakehouse developer platform and developer experience
- Design storage and catalog architecture
- Develop spark query engine and execution strategy
- Drive sprint execution and quarterly delivery commitments
- Drive technical and operational strategy
- Establish data durability and protocol compatibility
- Hire and develop senior engineers
- Implement observability instrumentation
- Lead incident response and root cause analysis
- Lead infrastructure foundations
- Lead open table formats and governance evolution
- Manage platform data pipelines and releases
- Own lakehouse platform architecture
- Perform build vs buy evaluation
- Set engineering standards for testing and release safety
- Support anomaly detection and platform observability
- Write code and ship internal tools
Perks/Benefits
- 401k
- Employer Paid Benefits
- Flexible working arrangements
- LTD/STD
- Life insurance
- Stock options
- Unlimited paid time off
Skills/Tech-stack
AI Assisted Development | API contracts | AWS | Anomaly Detection | Apache Flink | Apache Iceberg | Apache Kafka | Apache Spark | Auditability | Azure | Cause analysis | Cloud Native | Containerization | Data Catalog | Data Engineering | Data Governance | Data Pipelines | Data Quality | Data durability | Databricks | Delta Lake | Distributed Systems | GCP | Incident Response | Infrastructure as Code | Metadata catalog | Observability | Open Table Formats | Open table | Partitioning strategies | Root Cause Analysis | Root cause | Schema inference | Streaming | Table formats | Terraform | Versioning | “as-code”
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Director, AI Engineering & Innovation USD 168K-232KAPI Integration | AWS | Agentic Workflows | Artificial Intelligence | Azure401k match | Dental insurance | Health-related benefits | Holiday pay | Medical insuranceExecutive-level Full TimeLos Angeles, CA, USA11h ago
-
AI Assisted Development | Backend architecture | C++ | Cybersecurity | Distributed SystemsCareer growth opportunities | Flexible work hours | Hybrid work | Team eventsExecutive-level Full TimeAustin, Texas, United States14h ago
-
Access Control | Artificial Intelligence | B2B SaaS | Data Governance | Data SecurityRemote workMid-level Full Timeremote, United States R19h ago
-
AI/ML | AI/ML evaluation | Artificial Intelligence | Cloud infrastructure | Cross-Functional CollaborationDental coverage | Health benefits | Hybrid work | Inclusive culture | Leadership developmentSenior-level Full TimeCanada19h ago
-
Digital Execution Lead, Digital Delivery for Construction Execution, Google Data Centers USD 163K-237KApache Airflow | Automated Monitoring | BigQuery | CI/CD | DBTSenior-level Full TimeSunnyvale, CA, USA; Atlanta, GA, USA21h ago
-
AI readiness | Data Governance | Data Management | Data Modeling | Data meshSenior-level Full TimeSan Jose, CA, USA21h ago
-
Technical Program Manager, Antigravity (Data), DeepMind USD 217K-237KAccess Control | Data Engineering | Data Governance | Data Infrastructure | Data pipelineMid-level Full TimeMountain View, CA, USA21h ago
-
Inference Optimization Manager USD 229K-286KCloud infrastructure | Distributed Systems | GPU Kernel | GPU kernel programming | Inference engine401k matching | Flexible paid time off | Health insurance | Remote work options | Team onsite eventsMid-level Full TimeUnited States / Canada1d ago
-
Executive Director Product Solutions Manager - Chief Data Analytics Office Fusion Platform USD 236K-285KAPI Design | API documentation | Agentic AI | Artificial Intelligence | Audit trailsBackup childcare | Equal opportunity employment | Financial coaching | Health care coverage | Mental health supportExecutive-level Full TimeNew York, NY, United States1d ago
-
Distinguished Machine Learning Engineer - Safety USD 399K-457KComputer Vision | Data Architecture | Data Processing | Distributed Systems | Language ModelsEquity compensation | Onsite work schedule | Workplace inclusion cultureSenior-level Full TimeSan Mateo, CA, United States R1d ago
-
Director - Pharmacometrics AI Lead USD 190K-300KArtificial Intelligence | Biostatistics | Clinical Development | Cloud Computing | Data Engineering401k | Comprehensive healthcare benefits | Dental insurance | Paid Holidays | Paid sick daysSenior-level Full TimeUSA - New Jersey - Rahway, …1d ago
-
Associate Director, Data Analytics USD 84K-235KAWS | Access Control | Airflow | Alerting | Automated testingRemote work | Work from homeMid-level Full TimeWayne, PA, United States of America1d ago
-
Director, Data Science USD 161K-343KAI workflow | AI workflow automation | Data Governance | Data Management | Data MigrationEmployee learning programs | Volunteering opportunitiesExecutive-level Full TimeUS152580 New York (US152580) One Vanderbilt, …1d ago
-
Senior Analytics Manager - AI Model & Prompt Engineering USD 172K-258KA/B | A/B Testing | AI Evaluation | APIs | AWS401k | Career development | Employee assistance program | Flexible spending accounts | Health savings accountSenior-level Full TimeChicago, Illinois, United States1d ago
-
Financial Crimes Model Analytics Manager USD 92K-120KAnti-Money Laundering | Counter Terrorism Financing | Counter-terrorism | Data Analysis | Data Management401k plan | Life insurance | Paid Holidays | Paid sick leave | Paid vacationMid-level Full TimeCharlotte NC - 214 North Tryon …1d ago
-
Manager, Data Scientist - Credit Review USD 179K-225KAWS | Apache Spark | Classification | Clustering | CondaMid-level Full TimeMcLean, VA, United States1d ago
-
Generative AI - Group Manager - Senior Vice President USD 176K-265KAI compliance | AI guardrails | AWQ | AWS | Autogen401k | Accident and disability insurance | Life insurance | Medical, dental & vision coverage | Paid HolidaysSenior-level Full Time480 WASHINGTON BOULEVARD JERSEY CITY, United …1d ago
-
Manager, Data Engineering USD 160K-190KAirflow | BigQuery | CI/CD | Cloud Composer | Cloud Functions401k match | Dental insurance | Health insurance | Paid time off | Vision insuranceMid-level Full TimePSC003, United States1d ago
-
Manager, Statistical Analysis - W&H USD 155K-170KAI | Data Analysis | Data Automation | Data Quality | Data quality controlFully remote | Professional developmentMid-level Full TimeLos Angeles, United States R1d ago
-
Senior Manager of Data, AI Engineering USD 180K-200KAPIs | Cloud Platforms | Data Architecture | Data Pipelines | Databricks401k | Adoption leave | Employer Paid Long-term Disability | Employer Paid Short-term Disability | Health insuranceSenior-level Full TimeChicago, Illinois, United States1d ago
-
Associate Business Operations Analyst USD 90K-134KArtificial Intelligence | Automation | Business Analysis | Communication | DBTEmployee assistance program | Healthcare insurance | Life insurance | Paid Company Holidays | Pension/retirement matchingMid-level Full TimeU.S. Remote R1d ago
-
Director, Data Platform USD 170K-225KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageHybrid work | Remote 2 days per week | Supportive collaborative environment | Travel to client sitesExecutive-level Full TimeAtlanta; Boston; Charlotte; Chicago; Dallas; Los … R1d ago
-
Manager, EPM & Analytics Applications USD 89K-120KAgile | Analytics | Budgeting | Data Conversion | Data GovernanceMid-level Full TimeCanada1d ago
-
Director, Analytics USD 172K-250KAI integration | AWS | Amazon QuickSight | DBT | DashboardingEmployee development programs | Remote-friendlyExecutive-level Full TimeRemote (USA) R1d ago
-
Associate Analytics Director USD 110K-120KAnalytics Strategy | Dashboarding | Data Analysis | Data Governance | Data QualityCollaborative work environment | Employee resource groups | Flexible benefits | Home-office allowance | Identity theft protectionMid-level Full TimeNew York, NY1d ago