Director, Staff Data Engineer
New York - 150 E 42nd, United States
USD 113K-160K Senior-level Full Time
Tasks
- Architect and build enterprise data platform components
- Build and optimize Lakeflow declarative pipelines
- Collaborate on shared infrastructure for AI workloads
- Define Unity Catalog policies
- Design data federation solutions
- Develop ingestion pipelines with Lakeflow Connect
- Escalate complex data engineering challenges
- Implement data governance frameworks
- Lead development of multi client Databricks environments
- Lead technical hiring assessments and onboarding
- Manage data lineage and security
- Manage technical debt and modernization efforts
- Mentor and develop data engineering teams
Perks/Benefits
- 401k
- Dental insurance
- Flexible paid time off
- Life insurance
- Long-term disability insurance
- Medical insurance
- Paid Holidays
- Paid parental leave
- Paid sick leave
- Short-term Disability Insurance
- Vision insurance
Skills/Tech-stack
ABAC | ADLS | Access Control | Attribute-Based Access Control | Attribute-based access | Azure | Azure Data | Azure Data Factory | Azure DevOps | Azure Networking | Data Factory | Data Governance | Data Lineage | Data Modeling | Data Vault | Databricks | Declarative Pipelines | Dimensional Modeling | Lakeflow Connect | Lakeflow Declarative Pipelines | Lakehouse Architecture | Medallion Architecture | Power BI | PySpark | Serverless computing | Unity Catalog
Education
N/A
Related jobs
-
Finance Analytics Engineer USD 185K-221KAnomaly Detection | Apache Airflow | Business Intelligence | Data Modeling | Data MonitoringEquity compensation | Health benefitsMid-level Full TimeSan Mateo, CA, United States R10h ago
-
AWS | AWS CUR | Cloud Cost Management | Cost Management | DBT401k match | Flexible time off | Health savings account | MacBook laptop | Profit sharingMid-level Full TimeSt. Louis, MO11h ago
-
Full-Stack Analytics Engineer II USD 95K-118KAirflow | BigQuery | CI/CD | DBT | Dagster401k match | Dental insurance | Educational reimbursement | Flexible schedule | Health insuranceMid-level Full TimeWashington DC R11h ago
-
A/B | A/B Testing | AWS | Adversarial Testing | Amazon SQSHybrid work | W2 employmentSenior-level Contract Full TimeIrvine, CA, United States R11h ago
-
Dir, Data Governance & Observability USD 165K-200KAPI Design | Alerting | Automated testing | CI/CD | Data ContractsExecutive-level Full TimeNew York, NEW YORK, United States14h ago
-
Senior Data Engineer USD 100K-160KAI Services | API Integration | AWS CloudWatch | AWS Glue | AWS IAMEmployee assistance program | Hybrid work flexibility | Paid time off | Relocation assistance not available | Retirement savings planSenior-level Full TimeHouston, TX, United States15h ago
-
Data Engineer USD 100K-128KData Governance | Data Modeling | Data Security | Databricks | ELT401k match | Adoption Assistance | Community volunteer opportunities | Continuing education support | Dental insuranceMid-level Full TimeSouth Sioux City, NE, United States R15h ago
-
Senior kdb+ Architect (Greenfield Project) USD 170K-227KAWS | Azure | Data Modeling | GCP | KDB+Healthcare and wellbeing | Leadership development | Paid training | Referral bonuses | Social eventsSenior-level Full TimeNew York, NY, United States16h ago
-
Senior AI Software Engineer – LLM Applications (Azure) USD 119K-177K.NET | AI Foundry | Agentic AI | Agile | AngularDental insurance | Employee assistance program | Employee stock purchase plan | Flexible work options | Hybrid work flexibilitySenior-level Full TimeDallas, TX, United States17h ago
-
Software Engineer - AI Agent Memory Infrastructure USD 156K-316KConflict Resolution | Data Compression | Data Ingestion | Data Modeling | Data StorageMid-level Full TimeSan Jose, California, United States17h ago
-
Data Scientist - Platform Infrastructure USD 127K-189KData Governance | Data Modeling | Data Pipelines | Data Quality | ETLMid-level Full TimeLos Angeles, California, United States18h ago
-
Data Engineer, Global Business and Operations USD 130K-187KBigQuery | Data Governance | Data Marts | Data Modeling | Data PipelinesMid-level Full TimeNew York, NY, USA19h ago
-
Data Engineer USD 110K-110KAutomated testing | Data Architecture | Data Modeling | Data Security | Data VisualizationMid-level Full TimeAnnapolis, MD, US21h ago
-
Director, Business Intelligence & Enterprise Analytics USD 260K-318KAI machine learning | Analytics | Business Intelligence | Data Architecture | Data ScienceExecutive-level Full TimeFoster City, CA1d ago
-
Data Engineer - Mid-Level USD 130K-160KAirflow | Automated Deployment | Automated testing | CI/CD | Control workflows401k matching | Dental insurance | Health insurance | Lunch and snacks provided | Maternity & paternity leaveMid-level Full TimeEl Segundo, California, United States1d ago
-
Senior-level Full TimeRemote - United States R1d ago
-
Senior Data Engineer - Logistics USD 38K-38KBig Data | Cloud Computing | Cloud Cost Optimization | Column-Level Security | Cost Optimization401k plan | Dental insurance | Health insurance | Life insurance | Paid time offSenior-level Full TimeSpringdale, AR Terminal Office - Springdale, …1d ago
-
Data Engineer USD 127K-170KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsCareer advancement | Flexible work environment | Professional development | Recognition | Work-life balanceSenior-level Full TimeTampa, FL, USA, United States1d ago
-
Big Data | Cloud Cost Optimization | Cost Optimization | Data Architecture | Data Governance401k plan | Dental insurance | Health insurance | Life insurance | Paid time offMid-level Full TimeSpringdale, AR Terminal Office - Springdale, …1d ago
-
AWS | Amazon Redshift | Amazon S3 | Apache Airflow | Bitbucket401k match | Dental insurance | Employee assistance program | Flexible work/life support | Health insuranceSenior-level Full TimeBOSTON, United States1d ago
-
Data Reliability Engineer/Software Engineer USD 110K-177KAmazon S3 | BigQuery | CI/CD | Cause analysis | Data Catalog401k match | Flexible spending account | Health savings account | Paid parental leave | Paid time off and holidaysMid-level Full TimeLowell, United States R1d ago
-
Data Analytics & Insights Managed Service - Enhancment Data Engineer - Senior Associate USD 77K-202KAWS | Agile | Azure Data | Azure Data Factory | BI reportingSenior-level Full TimeHouston - 1000 Louisiana Street, United …1d ago
-
AI Models | Business Intelligence | Cause analysis | Data Architecture | Data GovernanceSenior-level Full TimeHouston - 1000 Louisiana Street, United …1d ago
-
Principal Commercial Data Engineer USD 126K-168KAnomaly monitoring | Apache Spark | Data Lineage | Data Observability | Data Quality401k | Discounts on travel and entertainment | Free employee meals | Free parking | Healthcare benefitsSenior-level Full TimeHome Office - US, NV, United …1d ago
-
Mid-level Full TimeUSA, MD, Annapolis Junction (308 Sentinel …1d ago