Senior Platform Data Engineer
USD 180K-248K (estimate) Senior-level Full Time
Tasks
- Administer Feature Store
- Administer user group management and access control
- Administer vector database for retrieval
- Build and manage RAG retrieval infrastructure
- Build hybrid retrieval pipelines
- Configure Databricks workspace and Unity Catalog governance
- Curate shared clinical feature tables
- Design and operate document ingestion pipelines
- Establish data quality gates for RAG
- Implement chunking strategies for healthcare content
- Manage clusters compute and cost monitoring
- Manage embedding model pipeline
- Monitor retrieval quality metrics and optimize
- Own platform data roadmap and architecture reviews
- Stream clinical data into Databricks
Perks/Benefits
- Collaborative work environment
- Dental insurance
- Health insurance
- Paid time off
- Vision insurance
- Work from home
Skills/Tech-stack
Access Control | Apache Kafka | BM25 | Batch ETL | Data Governance | Data Lineage | Data Quality | Databricks | Databricks Vector Search | Delta Live Tables | Delta Live) | Embedding Models | Feature Store | Hybrid search | MRR | Metadata Management | Pandas | Pinecone | PrecisionAtK | PySpark | Python | Qdrant | RAG | RecallAtK | Reranking | SQL | Spark Structured Streaming | Streaming ETL | Structured Streaming | Unity Catalog | Vector Databases | Vector Search | Weaviate
Education
Related jobs
-
ML Engineer Summer Intern (Remote & Paid) USD 40K-42KArtificial Intelligence | Classification | Data Visualization | Data Wrangling | Generative AI401k participation | Flexible work schedule | Remote work | Volunteer time offEntry-level InternshipUnited States, United States R12h ago
-
Agile | Algorithms | CI/CD | Data Engineering | Data Structures401k plan | Accident insurance | Dependent care FSA plan | HSA and FSA | Hospital indemnity insuranceSenior-level Full TimeAustin, Texas or Remote R1d ago
-
Pre-Sales Data Scientist USD 70K-90KAPIs | AUC | Credibility Testing | Cross-validation | Data AnalysisCompany sponsored volunteering days | Discounted private health insurance | Extra paid time off | Fully remote within continental United States | Generous parental leaveMid-level Full TimeCarlsbad, CA, United States R1d ago
-
Senior Data Engineer USD 162K-242KCloud Platforms | Data Lakes | Data Modeling | Data Pipelines | Data Transformation401k match | Company holidays | Dental insurance | Life insurance | Long-term disabilitySenior-level Full TimeUSA - MA - Cambridge, United … R1d ago
-
Senior Applied ML Engineer USD 180K-200KAWS | Amazon Web Services | Computer Vision | Distributed Systems | Docker401k match | Disability Leave | Family building benefits | Health benefits | Life insuranceSenior-level Full Time06083 GameChanger, United States R1d ago
-
Data Engineer I USD 30K-36KACID | Apache Spark | Azure | Azure DevOps | Batch Data Processing401k match | Community giveback paid time off | Employee assistance program | Employee discounts | FSAEntry-level Full TimeUnited States - Remote R1d ago
-
Assistant Data Science Engineer USD 78K-110KAWS | Access | Computational Finance | Decision Trees | DynamoDBEntry-level Full TimeRemote, Pennsylvania, United States of America R1d ago
-
AI Solution Engineer – Platform USD 89K-175KAmazon Neptune | Automated testing | CI/CD | CloudFormation | Containerization401k match | Certification programs | Childcare option | Comprehensive medical, dental and vision plans | Flexible spending accountMid-level Full TimeRemote - Alabama, United States R1d ago
-
AI Solution Engineer - Operations and Implementation USD 89K-175K800-171 | AWS | Airflow | Azure | CUI401k match | Certification programs | Childcare option | Flexible spending account | Flexible work scheduleMid-level Full TimeRemote - Alabama, United States R1d ago
-
Lead Data Engineer USD 150K-191KAccess Control | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeHealth insurance | Paid time off | Remote work optionSenior-level Full TimeUnited States, United States R1d ago
-
Freelance Creative Technologist, Applied AI USD 150K-190KAPI | Agentic Workflows | ComfyUI | ControlNet | Embeddings401k match | Dental | Healthcare | Paid Holidays | Paid time offMid-level FreelanceUnited States R1d ago
-
Senior AI/ML Engineer USD 192K-240KAWS | Agentic Orchestration | Automated Labeling | Automated Labeling Pipelines | AzureHybrid work scheduleSenior-level Full TimeRedwood City, CA (Hybrid); San Francisco, … R1d ago
-
Senior Software Engineer, Data Platform USD 146K-230KAPI Gateway | API Versioning | AWS Lambda | AWS RDS | AWS S3401k match | Catered lunch | Commuter benefit | Dental insurance | Fully paid parental leaveSenior-level Full TimeNew York, New York, United States R1d ago
-
Senior Forward Deployed AI Engineer USD 160K-226KData Pipelines | DevOps | Distributed Systems | Edge Computing | JAX401k match | Continuing education support | Function health subscription | Health & wellness stipend | Health, dental, vision benefitsSenior-level Full TimeAustin, TX R1d ago
-
Machine Learning Engineer – Search & Retrieval Systems USD 225K-280KA/B | A/B Testing | ANN indexing | B testing | CTR401k plan | Company holidays | Equity stock options | Flexible PTO | Fully remote United StatesSenior-level Full TimeRemote - USA R1d ago
-
Data Scientist III - AI & Machine Learning USD 126K-149KAI Pipelines | Airflow | Apache Spark | Bayesian Inference | Bias Variance401k matching | Equity options grant | Flexible time off | Get Out Get Active funds | Health benefitsSenior-level Full TimeMissoula, Montana, United States R1d ago
-
Finance Analytics Engineer USD 76K-95KAI | Acceptance Testing | Dashboarding | Data Modeling | Data Pipelines401k matching | Bereavement leave | Employee assistance program | Employee discount program | Health and dental insuranceSenior-level Full TimeRemote - Nationwide, United States R1d ago
-
Senior Staff Data Engineer USD 127K-158KAI machine learning | API Integration | AWS | Amazon ECR | Amazon S311 company-paid holidays | 401k match | Employee assistance program | Employee ownership program | Life and AD and D insuranceSenior-level Full TimeRemote United States R1d ago
-
Data Engineer USD 120K-160KAWS | Airflow | DBT | Data Warehousing | ELT401k plan | Commuter benefits | Employee Meals Snacks | FSA | Flexible time offSenior-level Full TimeLos Angeles; New York; Remote; San … R1d ago
-
Agile | Backend Development | Code review | Data Science | DebuggingFully remote | Mentorship | Paid apprenticeshipEntry-level Apprenticeship ContractRemote (United States) R1d ago
-
AI Software Engineer - Minneapolis USD 80K-120KAI coding | AI coding assistant | Agents | Automation | C#Collaborative environment | Comprehensive benefits package | Employee ownership | Flexible workplace | Innovative cultureEntry-level Full TimeSt. Louis Park, Minnesota, United States R1d ago
-
Machine Learning Engineer USD 130K-194KAI machine learning | AWS AI | AWS AI Machine Learning | Amazon DynamoDB | Amazon EC2Professional development | Work from homeMid-level Full TimeRemote, NY, US R1d ago
-
Senior Optimization Engineer USD 140K-180KAPIs | Asynchronous orchestration | Auditability | CP-SAT | Combinatorial OptimizationRemote workSenior-level Full TimeSchenectady, New York, United States, Remote R1d ago
-
Data Scientist, Analytics (Technical Leadership) USD 160K-190KAI Workflow Optimization | AI workflow | Agent Orchestration | Bias Mitigation | Causal InferenceCareer development | World class analytics communitySenior-level Full TimeRemote, US | Bellevue, WA | … R1d ago
-
Senior Data Analytics Developer USD 140K-170KAgile | Azure Data | Azure Data Factory | BI Data modeling | DAX401k match | Accident insurance | Critical illness insurance | Dental insurance | Hospital indemnity insuranceSenior-level Full TimeEden Prairie, MN, 55344, USA R1d ago