Head of Data Engineering
New York, NY - PARK, United States
USD 300K-350K Executive-level Full Time
Tasks
- Build data ingress and egress patterns
- Build vector database infrastructure for LLM workloads
- Create embedding generation and RAG pipelines
- Create multi year data engineering strategy and roadmap
- Define data quality frameworks for pipelines
- Deploy data catalog and enable self service analytics
- Design modern scalable data platform
- Design streaming architectures
- Establish data engineering function
- Implement change data capture and incremental processing
- Implement orchestration with Prefect or Airflow
- Implement unified data lake and governance
- Modernize Azure Data Factory pipelines
- Own data platform cost optimization
- Recruit mentor and develop data engineers
- Set up monitoring alerting and observability
Perks/Benefits
- 401k match
- Commuter benefits
- Comprehensive medical, dental, and vision
- Disability insurance
- Education sponsorship program
- Employee assistance program
- Financial wellness
- Flexible savings accounts
- Health savings account
- Life insurance
- Mental health app
- Mindfulness and Wellbeing App
- New parent leave
Skills/Tech-stack
Amazon Kinesis | Apache Airflow | Apache Spark | Azure | Azure Data | Azure Data Factory | Azure Event | Azure Event Hubs | Azure Storage | Azure Synapse | Azure Synapse Analytics | CDC | Change Data Capture | DAG | Data Capture | Data Catalog | Data Factory | Data Governance | Data Lineage | Data Quality | Databricks | Delta Lake | Directed Acyclic Graphs | ELT | ETL | Embedding Generation | Event Driven | Event Hubs | Event-driven architecture | Kafka | Metadata Management | Observability | Prefect | Python | RAG | Retrieval-Augmented Generation | SQL | Scala | Similarity Search | Streaming Data | Synapse Analytics | Unity Catalog | Vector Database | Vector indexing
Education
N/A
Roles
Data Engineer | Data Engineering | Engineer | Engineering | Head | Head of Data | Head of Data Engineering | Principal | Principal Data Engineer
Regions
Countries
States
Cities
Related jobs
-
Senior AI Engineer USD 130K-245KAnomaly Detection | CI/CD | Classification | DataRobot | DatabricksSenior-level Full TimeMorristown, NJ, United States15h ago
-
Adobe Campaign | Automated testing | Azure | Azure Data | Azure Data FactorySenior-level ContractSan Francisco, United States19h ago
-
Senior Software Engineer, Database Acceleration USD 244K-427KApache Flink | Apache Spark | Big Data | Cloud Native | Data LakeSenior-level Full TimeSeattle, Washington, United States20h ago
-
ANSYS | CAD | Git | NVIDIA Omniverse | PipEntry-level InternshipPennsylvania, Canonsburg20h ago
-
ANSYS Mechanical | Ansys Twin Builder | C++ | Control Systems | DrakeFinancial benefits | Health benefits | Internship program | Remote work | Wellness benefitsEntry-level InternshipCalifornia, US (California) Off-Site20h ago
-
Software Engineer, Data License Monitoring & Resiliency USD 160K-240KAIOps | Anomaly Detection | C# | C++ | Capacity Planning401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceMid-level Full TimeNew York20h ago
-
Senior Software Engineer - Data & Analytics Federation USD 160K-240KApache Arrow | Asynchronous frameworks | C++ | Distributed Systems | Linux401k match | Dental insurance | Life insurance | Medical insurance | Paid HolidaysSenior-level Full TimeNew York20h ago
-
Site Reliability Engineer - Compute Platform USD 187K-280KApache Doris | Apache Spark | Capacity Planning | ClickHouse | Cloud infrastructureSenior-level Full TimeSeattle, Washington, United States20h ago
-
API Design | Agentic Workflows | C plus plus | Code review | Context ManagementSenior-level Full TimeRedmond, WA21h ago
-
Business Engineer, Business AI USD 147K-203KAgent Orchestration | Agentic AI | Agile | Bias Mitigation | Context engineeringCross-functional collaboration | Mentorship | Travel opportunitySenior-level Full TimeMenlo Park, CA | Seattle, WA …21h ago
-
Data Engineer, Product Analytics USD 192K-235KCompliance | Data Privacy | Data Quality | Data Security | Data WarehousingSenior-level Full TimeMenlo Park, CA21h ago
-
Data Engineer USD 185K-196KData Modeling | Data Warehousing | Dimensional Modeling | ETL | Object-OrientedMid-level Full TimeMenlo Park, CA21h ago
-
Data Engineer USD 183K-203KAnomaly Detection | Data Drift | Data Quality | Data Visualization | Feature DriftEntry-level Full TimeMenlo Park, CA21h ago
-
Data Engineer USD 185K-196KC++ | Data Migration | Data Modeling | Data Warehousing | Dimensional dataMid-level Full TimeMenlo Park, CA21h ago
-
Software Engineer, Compiling, Quantum AI USD 147K-211KC++ | Classical coding theory | Coding theory | Compiler architecture | Compiler designMid-level Full TimeLos Angeles, CA, USA; Mountain View, …21h ago
-
C++ | Data Processing | Debugging | Information Retrieval | Language ModelsSenior-level Full TimeMountain View, CA, USA21h ago
-
Algorithms | C++ | Capacity Planning | Code Reviews | Data StructuresSenior-level Full TimeSeattle, WA, USA21h ago
-
Strategy and Operations Principal, Data Science USD 177K-257KCross-functional | Cross-functional Program Management | Data Analysis | Data Governance | Data VisualizationSenior-level Full TimeMountain View, CA, USA; New York, …21h ago
-
Senior Software Engineer, Google Cloud AI USD 174K-252KArtificial Intelligence | C++ | Data Structures | Data Structures and Algorithms | Design and ArchitectureSenior-level Full TimeSunnyvale, CA, USA21h ago
-
Staff Software Engineer, AI Interactions (iOS), XR USD 207K-300KAPI Integration | Application development | Code Quality | Compute Optimization | Generative AISenior-level Full TimeSan Jose, CA, USA21h ago
-
AI Engineer/ Forward Deployed Engineer USD 115K-160KAPI Integration | Artificial Intelligence | Cloud Platforms | Cloud platform | Containerization401k matching | Basic life insurance | Dental insurance | Disability coverage | Medical insuranceMid-level Full TimeNew York, NY, US1d ago
-
Lead SAP Data Engineer - IT USD 105K-152KCDS Views | Data Governance | Data Lineage | Data Modeling | Data PipelinesAdoption Assistance | Education assistance | Health and life insurance | Paid Holidays | Paid time offSenior-level Full TimeLibertyville, IL, US, 60048-37811d ago
-
A/B | A/B Testing | B testing | C++ | Content Understanding401k match | Commuter benefits | Disability insurance | Life insurance | Medical/Dental/Vision insuranceSenior-level Full TimeSunnyvale, CA1d ago
-
Forward Deployed AI Engineer/Data Scientist USD 78K-195KA/B | A/B Testing | B testing | Chatbot Platforms | Clustering401k matching | Basic life insurance | Employee stock purchase plan | Health, dental, vision coverage | Long-term disabilityMid-level Full TimeUnited States (Remote) R1d ago
-
Senior Manager, AI Engineering USD 232K-290KAI Agents | APIs | AWS | Artificial Intelligence | Cloud Native401k matching | Dental insurance | Health insurance | PTO | Paid leaveSenior-level Full TimeSan Francisco, California1d ago