Lead Data Engineer (New York)
Tasks
- Architect cloud data platforms
- Automate deployments with CI/CD
- Build AI ML infrastructure for feature stores and vector databases
- Collaborate with data scientists and stakeholders
- Conduct architecture reviews
- Deploy containerized data applications
- Design AI enhanced data pipelines
- Drive data platform modernization
- Ensure automated testing and code quality
- Ensure data quality, reliability, and governance
- Establish branching strategies
- Implement NoSQL document modeling
- Implement real-time inference pipelines
- Implement relational data models
- Integrate AI agents into data workflows
- Lead data pipeline design
- Mentor data engineers
- Perform security scanning
Perks/Benefits
- Employee resource groups
- Global parental leave
- Healthcare benefits
- Hybrid work environment
- Matched donation programs
- Mentorship programs
- Paid volunteer days
- Retirement planning
- Training and development
- Tuition reimbursement
Skills/Tech-stack
AWS EKS | AWS EMR | AWS Glue | AWS Lambda | AWS RDS | AWS S3 | Agentic AI | Agile | Amazon EKS | Amazon Kinesis | Amazon RDS | Amazon Web Services | Apache Airflow | ArgoCD | Autogen | Automated testing | CI/CD | Cloud Computing | Code Quality | Confluence | Continuous integration | Data Engineering | Data Pipelines | Databricks | Docker | Feature Stores | GitHub | GitHub Actions | GitOps | Java | Jira | Kubernetes | LLMs | Langchain | Llamaindex | MCP | Model Context Protocol | MongoDB | MongoDB sharding | PostgreSQL | Prompt engineering | RAG | Replication | Security Scanning | Snowflake | Spring Boot | Vector Databases | Web Services
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer | Principal | Principal Data Engineer
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R19d ago
-
Senior Data Engineer (Remote) USD 120K-150KData Architecture | Data Lake | Data Modeling | Data Quality | Data RefreshEqual opportunity employer | Remote workSenior-level Full TimeUnited States R2h ago
-
AI Software Engineer USD 107K-195KAWS CloudFormation | AWS Lambda | Amazon Web Services | CI/CD | Cloud Computing401k match | Dental insurance | Holiday pay | Medical insurance | Paid time offSenior-level Full TimeChantilly, VA, United States3h ago
-
AI and Data Science Engineer III USD 131K-218KAgile | Amazon Web Services | Anomaly Detection | CI/CD | Causal analysisMentorship | Travel opportunitiesSenior-level Full TimeArlington/Rosslyn, Virginia, United States5h ago
-
Model Operations Engineer USD 107K-179KALiBi | AWS SageMaker | Amazon Lambda | Apache Airflow | AzureHealth insurance | Holiday pay | Learning and development | Life insurance | Long-term disabilitySenior-level Full TimeUSA-VA-Ashburn5h ago
-
Data Engineer, Senior (TS/SCI Clearance) USD 115K-194KApache Spark | Data Migration | Data Visualization | Data Warehousing | Data analyticsSenior-level Full TimeHuntsville, United States5h ago
-
Lead Machine Learning Engineer (Multiple Positions) USD 275K-450KAlgorithm Optimization | Code review | Data Pipelines | Deep learning | Infrastructure OptimizationSenior-level Full TimeSan Jose, California, United States6h ago
-
Machine Learning Engineer (Multiple Positions) USD 174K-316KData Pipelines | Deep learning | Linux | Machine Learning | Model ServingMid-level Full TimeSan Jose, California, United States6h ago
-
Cloud Native | Containerization | Distributed Systems | GPU Acceleration | KubernetesCareer growth | Collaborative engineering environment | Global opportunities | Open Source contributionEntry-level Full TimeSan Jose, California, United States6h ago
-
LLM AIOps Development Engineer Graduate (Data Center Networking) - 2026 Start (BS/ MS) USD 122K-256KAPI Integration | Anomaly Detection | Cause analysis | Continuous Monitoring | Data StreamingEntry-level Full TimeSan Jose, California, United States6h ago
-
AI | Big Data | CPU | Cloud Native | Container RuntimeSenior-level Full TimeSan Jose, California, United States6h ago
-
Cloud Native | Cloud-native computing | Containerization | Distributed Systems | GPU AccelerationCareer growth | Collaborative team environment | Open source contributionsEntry-level Full TimeSeattle, Washington, United States6h ago
-
Production Engineer - Applied Machine Learning USD 156K-387KAlerting | Auto Scaling | Auto rollback | Auto-healing | CI/CDEntry-level Full TimeSan Jose, California, United States6h ago
-
Backup and Restore | Blob Storage | Cause analysis | Debugging | Distributed SystemsAgile environment | Collaborative team | On-call rotationSenior-level Full TimeSan Jose, California, United States6h ago
-
Apache Flink | Automation | Blameless postmortems | Capacity Planning | DeploymentDevelopment workshops | Hands-on experience | Internship | Social eventsEntry-level InternshipSeattle, Washington, United States6h ago
-
Apache Flink | Automation | Capacity Planning | Cloud Computing | Distributed SystemsDevelopment workshops | Social eventsEntry-level InternshipSan Jose, California, United States6h ago
-
Software Development Engineer - Cloud Native Databases USD 156K-316KBackup and Restore | Blob Storage | Crash diagnostics | Database Schema | Database schema managementCollaborative work environment | Intellectual curiosity | On-call rotationMid-level Full TimeSan Jose, California, United States6h ago
-
Containerd | Docker | Go | Kubernetes | LinuxSenior-level Full TimeSeattle, Washington, United States6h ago
-
Site Reliability Engineer - Data (Seattle) USD 177K-341KApache Flink | Blameless postmortems | Capacity Planning | Incident Response | KubernetesMid-level Full TimeSeattle, Washington, United States6h ago
-
Software Engineer - AI Compute Infrastructure USD 156K-387KCloud Native | Cluster management | Distributed Systems | GPU Acceleration | KubernetesSenior-level Full TimeSan Jose, California, United States6h ago
-
Site Reliability Engineer - Data USD 136K-359KApache Flink | Automation | Capacity Planning | Cloud infrastructure | Incident ManagementMid-level Full TimeSan Jose, California, United States6h ago
-
Data Engineer, Analytics (Ranking, AI) USD 182K-204KAgent Orchestration | C# | C++ | Dashboards | Data GovernanceCareer growth opportunitiesSenior-level Full TimeSunnyvale, CA | Bellevue, WA | …7h ago
-
Senior Software Engineer, AI/ML, Ads and Commerce USD 174K-252KCloud platform | Data Pipelines | Data Processing | Debugging | Distributed SystemsSenior-level Full TimeMountain View, CA, USA7h ago
-
Algorithms | C plus plus | Cloud Computing | Compute Technologies | Continuous DeploymentSenior-level Full TimeMountain View, CA, USA7h ago
-
Software Engineer USD 149K-211KAlgorithms | C# | C++ | Code Reviews | Data ProcessingHybrid scheduleMid-level Full TimeSunnyvale, CA, USA R7h ago