Lead Data Engineer (New York)
Tasks
- Architect cloud data platforms
- Automate deployments with CI/CD
- Build AI ML infrastructure for feature stores and vector databases
- Collaborate with data scientists and stakeholders
- Conduct architecture reviews
- Deploy containerized data applications
- Design AI enhanced data pipelines
- Drive data platform modernization
- Ensure automated testing and code quality
- Ensure data quality, reliability, and governance
- Establish branching strategies
- Implement NoSQL document modeling
- Implement real-time inference pipelines
- Implement relational data models
- Integrate AI agents into data workflows
- Lead data pipeline design
- Mentor data engineers
- Perform security scanning
Perks/Benefits
- Employee resource groups
- Global parental leave
- Healthcare benefits
- Hybrid work environment
- Matched donation programs
- Mentorship programs
- Paid volunteer days
- Retirement planning
- Training and development
- Tuition reimbursement
Skills/Tech-stack
AWS EKS | AWS EMR | AWS Glue | AWS Lambda | AWS RDS | AWS S3 | Agentic AI | Agile | Amazon EKS | Amazon Kinesis | Amazon RDS | Amazon Web Services | Apache Airflow | ArgoCD | Autogen | Automated testing | CI/CD | Cloud Computing | Code Quality | Confluence | Continuous integration | Data Engineering | Data Pipelines | Databricks | Docker | Feature Stores | GitHub | GitHub Actions | GitOps | Java | Jira | Kubernetes | LLMs | Langchain | Llamaindex | MCP | Model Context Protocol | MongoDB | MongoDB sharding | PostgreSQL | Prompt engineering | RAG | Replication | Security Scanning | Snowflake | Spring Boot | Vector Databases | Web Services
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer | Principal | Principal Data Engineer
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R11d ago
-
Staff Software Engineer, Data USD 117K-171KAPIs | AWS | CI/CD | Data Engineering | Data ObservabilityBonus/incentive programs | Dental | Health care | Paid time off | RetirementSenior-level Full TimeCreve Coeur, Missouri, US6h ago
-
Senior / Principal Infrastructure Engineer - ML Platform USD 278K-345KAWS | CI/CD | Cloud infrastructure | Cloud platform | Cluster managementEquity compensation | Onsite schedule Tuesday Wednesday ThursdaySenior-level Full TimeSan Mateo, CA, United States R10h ago
-
Senior / Principal Data Scientist - Discovery USD 307K-373KApache Airflow | Apache Spark | Causal Inference | Deep learning | ExperimentationEqual employment opportunities | Equity compensation | Health benefits | Onsite collaboration daysSenior-level Full TimeSan Mateo, CA, United States R11h ago
-
Senior-level Full TimeCosta Mesa, California, United States13h ago
-
Software Engineer - Business Analytics USD 100K-125KAPI Integration | Cloud Computing | Data Modeling | Data Visualization | Database401k matching | Equity package | Global Entry | Health and wellness stipend | Health, dental, vision insuranceEntry-level Full TimeSan Diego13h ago
-
Senior Software Engineer - Backend & Machine Learning USD 180K-250KAWS | Amazon Web Services | Argo | Blue-Green Deployment | Blue/greenSenior-level Full TimeNew York, New York, United States14h ago
-
Embedded Software Engineer USD 150K-190KC# | CPP | Continuous Delivery | Continuous Improvement | Continuous integration401k plan | Dental insurance | Employee assistance program | Employer match | Health insuranceMid-level Full TimeIrvine, CA14h ago
-
Senior-level Full TimeUS-WA-Bellevue15h ago
-
Senior-level Full TimeMansfield, MA (Remote) R15h ago
-
Staff Software Engineer, Applied AI USD 200K-240KDataset curation | Evaluation | FastAPI | LLM | Langchain401k | Co-working space reimbursement | Equity incentive | Flexible vacation policy | HSA contributionSenior-level Full TimeU.S. (Remote) R16h ago
-
Software Engineer - Training/Inference (C++) USD 180K-440KAuto Scaling | C++ | CI/CD | CUDA | Code generation401k plan | Dental insurance | Disability insurance | Discounts | Health insuranceSenior-level Full TimePalo Alto, CA17h ago
-
AWS | Airflow | Apache Flink | Apache Spark | CrawlingCareer growth | Competitive pay | Remote workMid-level Full TimeColumbia - Maryland17h ago
-
Airflow | Amazon Neptune | Apache Cassandra | Apache Flink | Apache SparkRemote work | US time zones supportMid-level Full TimeColumbia - Maryland17h ago
-
Senior ML Ops Engineer USD 210K-300KAWS | Airflow | Amazon SageMaker | Aurora | Bedrock401k matching | Catered meals | Dental and vision coverage | Desk setup stipend | Paid health coverageSenior-level Full TimeNYC Office18h ago
-
Lead Data Scientist (5421) USD 103K-171KArtificial Intelligence | Business Intelligence | Data Engineering | Data Modeling | Data QualityHealth insurance | Paid leave | RetirementSenior-level Full TimeFort Washington, MD18h ago
-
AI Integration Engineer USD 125K-188KAWS | AWS Lambda | Algorithms | Amazon S3 | Artificial Intelligence401k matching | Commuter benefits | Dental insurance | Free snacks | Health insuranceMid-level Full TimeWashington D.C.19h ago
-
Staff Software Engineer, Data Platform (FedRamp) USD 194K-267KApache Beam | Apache Flink | Apache Hadoop | Apache Spark | Data Observability401k | Dental insurance | Flexible spending account | Health insurance | Paid leaveSenior-level Full TimeSan Francisco, California19h ago
-
Manager, Data Analytics USD 158K-224KA/B | A/B Testing | Amazon Redshift | Amazon S3 | AmplitudeEquity | Healthcare coverage | LifeTime Membership | Parental leave | Retirement savings matchMid-level Full TimeSanta Monica, California, United States R19h ago
-
Data Engineer USD 125K-188KAWS | Apache Spark | Data Governance | Data Modeling | Data Validation401k company match | Commuter transportation benefit | Dental insurance | Free snacks | Medical insuranceEntry-level Full TimeWashington D.C.19h ago
-
Entry-level Full TimeHurlburt Field, FL19h ago
-
GTM AI Engineer USD 105K-130KAPI Integrations | Application development | Data Requirements | LLM Application Development | LLM application401k match | Equity | Flexible time off | Hybrid work modelMid-level Full TimeRaleigh, NC R19h ago
-
API | AWS Glue | Amazon Redshift | Amazon Web Services | Apache AirflowFully remote | On call production supportMid-level Full TimeOrlando, FL, United States R20h ago
-
Principal AI Engineer, Special Programs USD 220K-350KAPI Development | API Orchestration | AWS | Agentic Systems | Azure401k retirement plan | Disability insurance | Employee stock purchase plan | Life insurance | Medical, dental & vision coverageSenior-level Full TimeWashington, DC20h ago
-
Principal AI Engineer, Special Programs USD 220K-350KAI Governance | AI Safety | API Development | API Orchestration | AWS401k | Dental insurance | Employee stock purchase plan | Life insurance | Long-term disability insuranceSenior-level Full TimePalo Alto, CA20h ago