Lead AI Engineer, Data Solutions
California - San Francisco, United States
USD 172K-285K Senior-level Full Time
Tasks
- Build Python services and APIs for agent workflows
- Build and deploy ML models
- Build offline and online evaluation frameworks
- Build pipelines for agent trace datasets
- Create evaluation datasets golden traces and regression test sets
- Design AI agents with LLM reasoning tool usage and ML decisioning
- Design feedback loops for agent improvement
- Design scalable data pipelines for batch and near real time
- Drive continuous improvement via prompting policies model selection and fine tuning
- Enable continuous retraining and evaluation
- Ensure data quality, consistency, and reliability
- Ensure reliability, observability, and performance
- Integrate models and agents into business workflows
- Orchestrate multi step reasoning and structured outputs
- Run A B experiments and track quality revenue impact and latency
- Track engagement conversion quality metrics
- Transform raw interaction data into features labels and datasets
- Use production signals for continuous optimization
Perks/Benefits
- 401k
- Employee stock purchasing program
- Life and disability insurance
- Medical/Dental/Vision insurance
- Mental health support
- Paid parental leave
- Time off programs
Skills/Tech-stack
A/B | A/B Testing | API Development | Airflow | B testing | Backend systems | Batch Processing | BigQuery | Classification | Dagster | Data Lineage | Data Pipelines | Data Processing | Data Quality | Deep learning | ELT | ETL | Evaluation Frameworks | Experimentation | Feature Engineering | Fine Tuning | Forecasting | LLM orchestration | LLMOps | Language Models | Language Processing | Large Language Models | Machine Learning | Model Fine-tuning | Natural Language | Natural Language Processing | Prompt engineering | Python | Ranking | Recommendation Systems | Regression testing | Snowflake | Spark | Streaming Data | Streaming data processing | Tool orchestration
Education
N/A
Roles
AI | AI Engineer | Engineer | Lead | Lead AI Engineer
Regions
Countries
States
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R8h ago
-
BE CAD Physical Impl and AI Engiineer USD 117K-154KAI-assisted design | ASIC | Automation | Back End CAD | Back-end401k matching | Annual bonuses | Educational assistance | Health & dental benefits | Life insurance coverageSenior-level Full TimeAustin,Texas,United States4h ago
-
Data Analytics & Engineering Opportunities USD 65K-105KHive | Microstrategy | MySQL | Oracle | Python401k | Dental insurance | Disability insurance | Flexible spending account | Health insuranceEntry-level Full TimeWashington, DC, United States4h ago
-
Data Engineer USD 145K-160KAWS | AWS Glue | Apache Airflow | Apache Spark | Data Quality15 percent travel | Hybrid remote onsite work | Public Trust support | Technical documentation updatesMid-level Full TimeFAIRFAX, VA, United States4h ago
-
Senior Data Engineer-JT0224 USD 120K-183K.Net Core | .Net Framework | Apache Airflow | Azure | Azure Data401k match | Career growth opportunities | Dental insurance | Employee resource groups | Health insuranceSenior-level Full TimeRemote, United States R5h ago
-
AWS CloudFormation | AWS EC2 | AWS S3 | Amazon Elastic Kubernetes Service | Amazon Web ServicesCompany parties | Health insurance | Opportunity for advancementMid-level Full TimeSan Francisco, CA, US6h ago
-
Founding Engineer USD 110K-160KAPIs | Automated Evaluation | Fine Tuning | Infrastructure | Language ProcessingMid-level Full TimeSan Francisco, CA, US7h ago
-
AWS | Agentic AI | Azure | CI/CD | Cloud platform401k | Medical | Paid sick leaveMid-level ContractSouth San Francisco, United States7h ago
-
Senior-level Full TimeMiami, New York, San Francisco8h ago
-
Lead Financial Modeling & BI Analyst USD 89K-119KAnaplan | Business Intelligence | CTE | CTE Subqueries | Data GovernanceDental insurance | Disability insurance | Hybrid work environment | Life insurance | Medical insuranceSenior-level Full TimeAurora9h ago
-
Lead Financial Modeling & BI Analyst USD 89K-119KAnaplan | Business Intelligence | CTE | Data Quality | ETLDental insurance | Disability insurance | ECO pass | Hybrid work environment | Life insuranceSenior-level Full TimeAurora9h ago
-
Senior Databricks Forward Deployed Engineer - GPS USD 155K-306KAirflow | CI/CD | DBT | Data Modeling | DatabricksMentorship | Professional development | Travel for client workSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …9h ago
-
Lead Databricks Forward Deployed Engineer - GPS USD 189K-372KAPI | AWS | Agent Bricks | Airflow | Apache SparkSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …9h ago
-
Entry-level Full TimeArlington/Rosslyn, Virginia, United States9h ago
-
Databricks Senior Consultant USD 124K-207KAWS | Azure | Business Intelligence | Cloud Computing | Cloud platformSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Sacramento, California, …9h ago
-
Delivery Senior Consultant, Data Engineering and Gen AI USD 155K-265K.NET | AWS | Agile | Angular | AzureMentorship opportunities | Professional development | Travel reimbursementSenior-level Full TimeGilbert, Arizona, United States; Lake Mary, …9h ago
-
AI and Data Science Engineer (TS/SCI Poly) USD 93K-170KAPIs | Artificial Intelligence | CI/CD | Cloud Platforms | ContainerizationMid-level Full TimeMcLean, Virginia, United States9h ago
-
Azure Databricks Developer USD 126K-198KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeLouisville, Kentucky, United States9h ago
-
Acceptance Testing | Data Analysis | Data Quality | Data Visualization | Data reportingSenior-level Full TimeArlington/Rosslyn, Virginia, United States9h ago
-
Delivery Senior Consultant, Data Engineering and Gen AI USD 155K-265K.NET | AWS | Agile | Angular | AzureMentorship | Professional development | Travel opportunitiesSenior-level Full TimeGilbert, Arizona, United States; Lake Mary, …9h ago
-
Generative AI Engineer III - Federal Health USD 110K-218KArtificial Intelligence | Data Engineering | Data Pipelines | Data Validation | DockerMentorship opportunities | Professional developmentSenior-level Full TimeArlington/Rosslyn, Virginia, United States9h ago
-
Engineering Lead-Data, Analytics & AI Platform USD 125K-155KAI Agent | AI Agent Portal | Agentic AI | Application Integration | Cloud NativeSenior-level Full TimeJersey City, New Jersey, United States9h ago
-
Data Engineer III (Secret Clearance Required) USD 107K-179KAWS | Anomaly Detection | Artificial Intelligence | Classification | ClusteringProfessional developmentSenior-level Full TimeArlington/Rosslyn, Virginia, United States9h ago
-
Data Management Engineer III USD 97K-162KAPI Integration | Agile | Apache Spark | Cloud Data | Cloud Data PlatformsProfessional development | Travel 10 to 15 percentSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Baltimore, Maryland, …9h ago
-
Lead AI and Data Solutions Engineer II USD 134K-224KAmazon Web Services | Apache Spark | Application Programming | Application Programming Interfaces | Cloud platformMentorship | Professional developmentSenior-level Full TimeSacramento, California, United States; Tempe, Arizona, …9h ago