Lead Data Engineer
Tasks
- Architect and deploy scalable batch and streaming data pipelines
- Build and operationalize RAG and semantic search workflows
- Build and optimize data ingestion pipelines for structured and unstructured data
- Containerize and deploy LLM services for production
- Develop Python code and microservices and APIs
- Ensure security quality reliability explainability and maintainability
- Establish MLOps and LLMOps CI CD and observability
- Implement vector databases and multi agent agentic workflows
- Integrate data products into AI agents and business applications
- Optimize database storage and compute cost and performance
- Perform root cause analysis and incident remediation
Perks/Benefits
- Disability and life insurance
- Employee assistance program
- Fertility and family forming benefits
- Flexible spending account
- Healthcare concierge
- Healthcare savings account
- Hybrid work environment
- Open leave policy
- Paid Holidays
- Paid family leave
Skills/Tech-stack
APIs | AWS | Agentic AI | Azure | Batch data | BigQuery | CI/CD | Containerization | Data Modeling | Distributed Computing | Docker | GCP | LLMOps | MLOps | Microservices | Observability | Python | RAG | Semantic Search | Streaming Data | Vector Databases
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
C# | C++ | Computer Graphics | Computer Vision | Data PipelinesEquity compensation | Health benefits | Onsite work schedule Tuesday Wednesday ThursdaySenior-level Full TimeSan Mateo, CA, United States R8h ago
-
Senior Machine Learning Engineer, Content Platform USD 141K-360KApache Spark | Cloud Computing | Generative AI | Language Models | Large Language ModelsDisability benefits | Equity awards | Financial wellness support | Health insurance | Life insuranceSenior-level Full TimeSan Jose, California R10h ago
-
Staff Machine Learning Engineer, Ad Serving USD 195K-510KA/B | A/B Testing | B testing | Continuous Improvement | Feature EngineeringCommuter benefits | Disability benefits | Financial wellness support | Health insurance | Life insuranceSenior-level Full TimeNew York, New York R10h ago
-
Staff Machine Learning Engineer, Ad Serving USD 195K-435KDistributed Systems | Experimentation | Feature Engineering | Java | Machine LearningDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeBoston, Massachusetts R10h ago
-
AI Agents | AI monitoring | API Integration | Amazon Web Services | Anthropic401k retirement plan | Medical, dental, and vision benefits | Paid Holidays | Paid time off | Variable pay/incentivesSenior-level Full TimeUnited States R11h ago
-
Senior Manager, Commercial Analytics (Immunology - HLH) USD 140K-175KClaims data | Competitive Intelligence | Dashboard Design | Data Mart | Data VisualizationCompetitive 401k match | Conference attendance | Generous time-off policy | Hybrid remote work | Medical, dental, and vision coverageSenior-level Full TimeWaltham, MA, United States R11h ago
-
Team Lead, AI Engineering USD 157K-254KAI Search | AKS | Agent workflows | Async Programming | AuthenticationRemote work hybrid flexibilitySenior-level Full TimeUSA - Atlanta, GA; USA - … R14h ago
-
Sr. Analytics Engineer USD 160K-185KAirflow | CI/CD | DBT | Dagster | Data ModelingCross-functional collaboration | High autonomy | US Pacific overlapSenior-level Full TimeRemote - US R15h ago
-
AWS | Cloud infrastructure | Compute | Data Curation | Distributed Systems401k match | Daily lunches and snacks | Health insurance covered | Hybrid work schedule | Learning and development stipendSenior-level Full TimeRedwood City R16h ago
-
Sr. Software Engineer - Azure Storage USD 119K-234KAutomation | Azure | C# | C++ | Cloud StorageRemote workSenior-level Full TimeUnited States R16h ago
-
Sr. Forward Deployed Engineer (FDE) - Public Sector USD 182K-250KAI APIs | AWS | Apache Spark | CI/CD | Cloud platformCustomer-facing role | Hybrid work | Secret clearance required | Travel 20 to 25 percentSenior-level Full TimeAlabama; Arkansas; Florida; New York; Tennessee R16h ago
-
Staff Robotics Engineer USD 190K-235KAI Agents | AI Libraries | C++ | Critical Systems | FDIRComprehensive employee benefits | Equity | On call rotation for continuous campaignsSenior-level Full TimeRichmond, CA R17h ago
-
Senior Data Engineer USD 130K-170KAmazon Kinesis | Amazon Redshift | Apache Airflow | BigQuery | DBT401k match | Education stipend | Flexible time off | Health insurance | IKEA discountsSenior-level Full TimeSan Francisco, California, United States R17h ago
-
Sr. Staff Machine Learning Systems Engineer USD 240K-265KAdversarial Testing | Calibration | Data Engineering | Data Ingestion | Data Pipelines401k employer matching | Company holidays | Comprehensive health benefits | Employee stock purchase program | Offsite team retreatsSenior-level Full TimeUS Remote R17h ago
-
Staff Backend AI Engineer, Remote USD 164K-219KAWS | AWS Cloud | AWS Cloud Development Kit | AWS Lambda | AWS cloud development401k matching | Dental insurance | Flexible time off | Medical insurance | Paid HolidaysSenior-level Full TimeUnited States, UNITED STATES, United States R18h ago
-
Junior AI Engineer (Open to remote) USD 110K-135KAPIs | Agent SDK | Agentic coding | Arize | Google ADK401k | Commuter benefits | Dental insurance | Educational assistance | Medical insuranceExecutive-level Full TimeNew York, United States R18h ago
-
Senior-level Full TimeCalifornia; Remote - California; San Francisco, … R18h ago
-
Principal Machine Learning Engineer, Geometric Vision USD 407K-460K3D Computer Vision | 3D representations | Auto-labeling | C++ | CalibrationSenior-level Full TimeSunnyvale R19h ago
-
Apache Airflow | BigQuery | Cloud KMS | Cloud logging | Continuous Delivery401k match | Dental insurance | Disability insurance | Employee assistance program | Health insuranceSenior-level Full TimeMcLean, Virginia; Mountain View, California, United … R19h ago
-
AI/ML Engineer USD 100K-150KAPI Design | Asynchronous programming | Claude Code | Cloud platform | Cursor401k | Employee assistance program | Health spending account | Life insurance | Long-term disabilityMid-level ContractDearborn, Michigan, USA R19h ago
-
Machine Learning Engineer, Detection and Tracking USD 160K-210KByteTrack | DETR | Data Augmentation | DeepSORT | Faster R-CNNFlexible paid time off | Hybrid work | Medical insurance | Paid Holidays | Remote workMid-level Full TimeWashington, DC R19h ago
-
ARINC 429 | ARINC 653 | ARP4754 | Bamboo | Bitbucket401k match | Disability coverage | Educational assistance | Employee assistance program | Flexible spending accountsSenior-level Full TimePhoenix, AZ, United States R19h ago
-
Senior Analytics Engineer II CAD 148K-203KAirbyte | Airflow | Alerting | Amazon Redshift | AutomationHealth and dental benefits | Learning and development opportunities | Unlimited paid time off | Work from anywhereSenior-level Full TimeRemote - US & Canada R20h ago
-
Sr. Forward Deployed Engineer (FDE) - Public Sector USD 182K-250KAI APIs | AWS | Apache Spark | Architecture Design | AzureHybrid work | Travel 20 to 25 percentSenior-level Full TimeRemote - Virginia; Remote - Washington … R20h ago
-
Applied AI Architect, Public Sector (National Security) USD 275K-315KCloud Architecture | Data Science | Enterprise Systems Integration | Enterprise systems | LLM EvaluationFlexible working hours | Generous vacation | Optional equity donation matching | Parental leave | Visa sponsorshipSenior-level Full TimeWashington, DC R21h ago