Director, Staff Data Engineer
New York - 150 E 42nd, United States
USD 113K-160K Senior-level Full Time
Tasks
- Architect and build enterprise data platform components
- Build and optimize Lakeflow declarative pipelines
- Collaborate on shared infrastructure for AI workloads
- Define Unity Catalog policies
- Design data federation solutions
- Develop ingestion pipelines with Lakeflow Connect
- Escalate complex data engineering challenges
- Implement data governance frameworks
- Lead development of multi client Databricks environments
- Lead technical hiring assessments and onboarding
- Manage data lineage and security
- Manage technical debt and modernization efforts
- Mentor and develop data engineering teams
Perks/Benefits
- 401k
- Dental insurance
- Flexible paid time off
- Life insurance
- Long-term disability insurance
- Medical insurance
- Paid Holidays
- Paid parental leave
- Paid sick leave
- Short-term Disability Insurance
- Vision insurance
Skills/Tech-stack
ABAC | ADLS | Access Control | Attribute-Based Access Control | Attribute-based access | Azure | Azure Data | Azure Data Factory | Azure DevOps | Azure Networking | Data Factory | Data Governance | Data Lineage | Data Modeling | Data Vault | Databricks | Declarative Pipelines | Dimensional Modeling | Lakeflow Connect | Lakeflow Declarative Pipelines | Lakehouse Architecture | Medallion Architecture | Power BI | PySpark | Serverless computing | Unity Catalog
Education
N/A
Related jobs
-
Machine Learning Engineer USD 111K-180KAutomation | Business Intelligence | Cloud Computing | Dashboard Development | Data PipelinesMid-level Full TimeAlexandria, VA, United States3h ago
-
Machine Learning Engineer USD 93K-149KAutomation | Business Intelligence | Cloud services | Data Modeling | Data Pipelines401k matching | Dental insurance | Flexible spending account | Health insurance | Paid HolidaysMid-level Full TimeAlexandria, VA, United States5h ago
-
Senior Quantitative Developer USD 140K-150KAmazon Web Services | CI/CD | Continuous Deployment | Continuous Integration and Continuous Deployment | Continuous integrationHybrid work scheduleSenior-level Full Time245 Summer St, Boston MA, United …12h ago
-
Manager, BI + Analytics Engineer USD 150K-180KApache Airflow | BigQuery | DBT | Dashboards | Data ModelingMid-level Full TimeSan Francisco, CA12h ago
-
Manager, BI + Analytics Engineer USD 150K-180KApache Airflow | BigQuery | DBT | Dashboarding | Data ModelingMid-level Full TimeNew York, NY12h ago
-
Director, Data Engineering, Platform & Governance USD 235K-250KAPI Development | AWS | Airflow | Analytics engineering | Artificial Intelligence401k match | Employee assistance program | Medical/Dental/Vision | Mind health support | Paid parental leaveExecutive-level Full TimeInglewood, CA13h ago
-
Software Engineer, Routing - Autonomy & Robotics USD 137K-285KAWS | Algorithms | Azure | C++ | Data Structures401k employer matching | Basic life insurance | Commuter benefits | Disability insurance | Medical/Dental/Vision insuranceMid-level Full TimeSan Francisco, CA13h ago
-
Data Engineer II, Data Products USD 129K-173KAccess Control | Automated testing | CCPA | CI/CD | DBTDental insurance | Employee discounts | Employee recognition rewards | Employee referral bonus | Medical insuranceMid-level Full TimeHouston, Texas, United States14h ago
-
Sr. Data Engineer USD 97K-160KAWS | Amazon Kinesis | Amazon Redshift | Amundsen | Apache AirflowEmployee discounts | Employee recognition and rewards program | Employee referral bonuses | Paid time off | Paid volunteer timeSenior-level Full TimeHouston, Texas, United States14h ago
-
Staff Analytics Engineer — Data Warehouse USD 240K-275KAnonymization | Apache Airflow | Astronomer | Cosmos | Cost OptimizationHealth insurance | Startup equitySenior-level Full TimeSan Francisco15h ago
-
Data Analytics Engineer I USD 100K-110KApache Airflow | Apache Spark | BigQuery | Cloud Run | Cloud platform401k | Dental insurance | Fitness fund | Health insurance | Learning and development fundMid-level Full TimeRemote - USA R15h ago
-
Senior-level Full TimeChantilly, VA15h ago
-
Senior AI Developer USD 106K-150K.NET | AI Foundry | AI Services | Angular | AzureHybrid work options | No sponsorship for work authorization | Paid time off | Relocation assistance not availableSenior-level Full TimeDallas, TX, United States16h ago
-
Data Engineering Manager, Core Experience & Incentives USD 183K-232KAmazon Redshift | Amundsen | Apache Airflow | Apache Flink | Apache KafkaAnnual equity refresh grants | Equity grant | Remote work friendlySenior-level Full TimeUnited States - Remote R16h ago
-
Software Engineer, Data Infrastructure USD 153K-376KAI systems | Access Control | Apache Airflow | Apache Flink | Apache KafkaCell phone reimbursement | Company recharge days | Generous PTO | Learning and development stipend | Mental health and wellness benefitsMid-level Full TimeSan Francisco, CA • New York, … R16h ago
-
Corporate Data Engineering Specialist USD 120K-181KAzure | CI/CD | Data Engineering | Data Factory | Data GovernanceEmployee stock ownership plan | Hybrid work flexibility | Professional development | Training and mentoring | Tuition reimbursementMid-level Full TimeRaleigh, North Carolina, United States; Tampa, …16h ago
-
Finance Analytics Engineer USD 76K-95KAcceptance Testing | Dashboards | Data Modeling | Data Pipelines | Data Quality401k match | Bereavement leave | Employee assistance program | Employee discount program | Health dental vision careSenior-level Full TimeRemote - Nationwide, United States R18h ago
-
AI Engineer (Hybrid) USD 130K-270KAmazon Web Services | Cloud Computing | Data Analysis | Data Modeling | Data Quality401k contribution | AD&D insurance | Health Savings Account contribution | Hybrid work | Life insuranceSenior-level Full TimeAnnapolis Junction, MD R18h ago
-
Senior-level Full TimeRemote US R19h ago
-
Data Engineer (remote) USD 110K-130KAWS | Airflow | Azure | Cloud infrastructure | Data Governance401k match | Employee assistance program | Employee stock purchase plan | Flexible schedule | Flexible spending accountMid-level Full TimeWork From Home, United States R19h ago
-
Principal Software Engineer, Data Platforms USD 170K-210KAPI Design | Automated testing | CI/CD | Data Governance | Data Lineage401k | Dental insurance | Employee discounts | Fully remote | Medical insuranceExecutive-level Full TimeOrlando, FL, United States R19h ago
-
Power BI Developer USD 90K-156KDAX | Data Modeling | Data Transformation | Data integration | Drill-Down401k retirement plan | Health insurance | Life insurance | Paid Holidays | Paid time offMid-level Full TimeIndianapolis, IN20h ago
-
Mid-level Full TimeChicopee, Massachusetts, United States20h ago
-
Agile | Analytics | Clean room | Cloud | Confluence401k match | Career development support | Dental insurance | Education reimbursement | Health insuranceSenior-level Full TimeNew York, New York20h ago
-
Responsible AI Data Scientist USD 160K-175KAlgorithmic Fairness | Audit trails | Bias detection | Data Lineage | Data VisualizationBonuses | Hybrid work | Remote flexibility | Supportive collaborative environmentMid-level Full TimeChicago; New York R20h ago