Director, Staff Data Engineer
New York - 150 E 42nd, United States
USD 113K-160K Senior-level Full Time
Tasks
- Architect and build enterprise data platform components
- Build and optimize Lakeflow declarative pipelines
- Collaborate on shared infrastructure for AI workloads
- Define Unity Catalog policies
- Design data federation solutions
- Develop ingestion pipelines with Lakeflow Connect
- Escalate complex data engineering challenges
- Implement data governance frameworks
- Lead development of multi client Databricks environments
- Lead technical hiring assessments and onboarding
- Manage data lineage and security
- Manage technical debt and modernization efforts
- Mentor and develop data engineering teams
Perks/Benefits
- 401k
- Dental insurance
- Flexible paid time off
- Life insurance
- Long-term disability insurance
- Medical insurance
- Paid Holidays
- Paid parental leave
- Paid sick leave
- Short-term Disability Insurance
- Vision insurance
Skills/Tech-stack
ABAC | ADLS | Access Control | Attribute-Based Access Control | Attribute-based access | Azure | Azure Data | Azure Data Factory | Azure DevOps | Azure Networking | Data Factory | Data Governance | Data Lineage | Data Modeling | Data Vault | Databricks | Declarative Pipelines | Dimensional Modeling | Lakeflow Connect | Lakeflow Declarative Pipelines | Lakehouse Architecture | Medallion Architecture | Power BI | PySpark | Serverless computing | Unity Catalog
Education
N/A
Related jobs
-
Principle Data Engineer USD 220K-235KAWS | Airflow | BigQuery | Capacity Planning | Compliance401k | Equity | Essential equipment | Flexible PTO | Fully remoteSenior-level Full TimeCleveland, OH R6h ago
-
Software Engineer, Data Platform USD 105K-132KAPI | AWS | CI/CD | Code review | DBT401k | Baby bonding leave | Commuter benefits | Disability insurance | Employee referral programSenior-level Full TimeUS Remote R9h ago
-
Senior Data Engineer USD 24KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon S3401k match | Annual profit-sharing | Flexible time off | Health insurance | Health savings accountSenior-level Full TimeSt. Louis, MO10h ago
-
Finance Analytics Engineer USD 185K-221KAnomaly Detection | Apache Airflow | Business Intelligence | Data Modeling | Data MonitoringEquity compensation | Health benefitsMid-level Full TimeSan Mateo, CA, United States R10h ago
-
Data Engineer II USD 101K-153KAmazon RDS | Amazon Redshift | Apache Spark | DBT | Data GovernanceComprehensive health plans | Parental leave | Professional development stipend | Remote workMid-level Full TimeRemote - US R11h ago
-
AWS | AWS CUR | Cloud Cost Management | Cost Management | DBT401k match | Flexible time off | Health savings account | MacBook laptop | Profit sharingMid-level Full TimeSt. Louis, MO11h ago
-
Full-Stack Analytics Engineer II USD 95K-118KAirflow | BigQuery | CI/CD | DBT | Dagster401k match | Dental insurance | Educational reimbursement | Flexible schedule | Health insuranceMid-level Full TimeWashington DC R12h ago
-
A/B | A/B Testing | AWS | Adversarial Testing | Amazon SQSHybrid work | W2 employmentSenior-level Contract Full TimeIrvine, CA, United States R12h ago
-
Senior Machine Learning Engineer, Roblox Assistant USD 196K-243KData Processing | Distributed data | Distributed data processing | Fine Tuning | Language ModelSenior-level Full TimeSan Mateo, CA, United States R14h ago
-
Dir, Data Governance & Observability USD 165K-200KAPI Design | Alerting | Automated testing | CI/CD | Data ContractsExecutive-level Full TimeNew York, NEW YORK, United States15h ago
-
Senior Data Engineer USD 100K-160KAI Services | API Integration | AWS CloudWatch | AWS Glue | AWS IAMEmployee assistance program | Hybrid work flexibility | Paid time off | Relocation assistance not available | Retirement savings planSenior-level Full TimeHouston, TX, United States15h ago
-
Data Engineer USD 100K-128KData Governance | Data Modeling | Data Security | Databricks | ELT401k match | Adoption Assistance | Community volunteer opportunities | Continuing education support | Dental insuranceMid-level Full TimeSouth Sioux City, NE, United States R16h ago
-
Staff Business Systems Engineer, Data Center Systems USD 188K-275KAPI | Asset Lifecycle | Asset Lifecycle Management | Auditability | CMDB401k match | Catered lunch | Childcare support | Disability insurance | Employee stock purchase programSenior-level Full TimeSunnyvale, CA16h ago
-
Senior kdb+ Architect (Greenfield Project) USD 170K-227KAWS | Azure | Data Modeling | GCP | KDB+Healthcare and wellbeing | Leadership development | Paid training | Referral bonuses | Social eventsSenior-level Full TimeNew York, NY, United States17h ago
-
Senior AI Software Engineer – LLM Applications (Azure) USD 119K-177K.NET | AI Foundry | Agentic AI | Agile | AngularDental insurance | Employee assistance program | Employee stock purchase plan | Flexible work options | Hybrid work flexibilitySenior-level Full TimeDallas, TX, United States18h ago
-
Software Engineer - AI Agent Memory Infrastructure USD 156K-316KConflict Resolution | Data Compression | Data Ingestion | Data Modeling | Data StorageMid-level Full TimeSan Jose, California, United States18h ago
-
Data Scientist - Platform Infrastructure USD 127K-189KData Governance | Data Modeling | Data Pipelines | Data Quality | ETLMid-level Full TimeLos Angeles, California, United States18h ago
-
Data Engineer, Global Business and Operations USD 130K-187KBigQuery | Data Governance | Data Marts | Data Modeling | Data PipelinesMid-level Full TimeNew York, NY, USA19h ago
-
Data Engineer USD 110K-110KAutomated testing | Data Architecture | Data Modeling | Data Security | Data VisualizationMid-level Full TimeAnnapolis, MD, US21h ago
-
Director, Business Intelligence & Enterprise Analytics USD 260K-318KAI machine learning | Analytics | Business Intelligence | Data Architecture | Data ScienceExecutive-level Full TimeFoster City, CA1d ago
-
Data Engineer - Mid-Level USD 130K-160KAirflow | Automated Deployment | Automated testing | CI/CD | Control workflows401k matching | Dental insurance | Health insurance | Lunch and snacks provided | Maternity & paternity leaveMid-level Full TimeEl Segundo, California, United States1d ago
-
Senior-level Full TimeRemote - United States R1d ago
-
Senior Data Engineer - Logistics USD 38K-38KBig Data | Cloud Computing | Cloud Cost Optimization | Column-Level Security | Cost Optimization401k plan | Dental insurance | Health insurance | Life insurance | Paid time offSenior-level Full TimeSpringdale, AR Terminal Office - Springdale, …1d ago
-
Data Engineer USD 127K-170KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsCareer advancement | Flexible work environment | Professional development | Recognition | Work-life balanceSenior-level Full TimeTampa, FL, USA, United States1d ago
-
Big Data | Cloud Cost Optimization | Cost Optimization | Data Architecture | Data Governance401k plan | Dental insurance | Health insurance | Life insurance | Paid time offMid-level Full TimeSpringdale, AR Terminal Office - Springdale, …1d ago