Advisor - Scientific Data Engineer
US: South San Francisco Haskins, United States
USD 166K-266K Senior-level Full Time
Tasks
- Build semantic layer
- Build vector embedding pipelines
- Create data validation checks
- Create versioned reproducible data snapshots
- Design AI-ready data products
- Design data harmonization architecture
- Develop ETL and ELT pipelines
- Develop SQL and question pairs
- Develop integration pipelines for heterogeneous data
- Enforce metadata standards for AI access
- Implement data quality monitoring
- Maintain data dictionary and ontology mapping
- Maintain schema documentation
- Optimize lakehouse architecture for AI
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS Redshift | Amazon Athena | Amazon S3 | Apache Airflow | Apache Spark | DBT | Databricks | Databricks SQL | Delta Lake | ELT | ETL | Feature Store | MLflow | Python | RAG | SQL | Snowflake | Unity Catalog | Vector Database | Vector Databases | Vector embeddings
Education
Regions
Countries
States
Related jobs
-
Sr. Manager, Software Engineering- Developer Experience & Performance Optimization (Remote) USD 110K-170KAgile | Ansible | Azure Cloud | Azure DevOps | CI/CDInfrequent travel | Overtime as needed | Remote work | Transportation supportSenior-level Full TimeOak Brook, IL, United States R4h ago
-
Sr. Product Manager- Data Warehouse (Remote) USD 195K-250KAgile | Azure DevOps | CI/CD | Change Data Capture | Data CaptureMentorship opportunities | Remote workSenior-level Full TimeOak Brook, IL, United States R4h ago
-
Data and AI Engineer USD 120K-165KAWS | Agile | Azure | Big Data | Data ArchitecturePublic trust clearance required | Remote workMid-level Full TimeWork from home, VA, United States R4h ago
-
Sr. Data and AI Engineer USD 180K-200KAgile | Amazon Web Services | Azure | Big Data | Data ArchitecturePublic trust clearance support | Remote workSenior-level Full TimeWork from home, VA, United States R4h ago
-
Business Intelligence | Dashboards | Data Modeling | Data Visualization | ETLSenior-level Full TimeBoston, MA, United States5h ago
-
Data Engineer ID50062 USD 148K-170KAmazon Web Services | Apache Airflow | Apache Spark | Avro | Cloud platformEducation budget | Fitness budget | Flexible schedule | Mentorship | Remote work optionSenior-level Full TimeSan Francisco, United States7h ago
-
DevOps Engineer - Project Delivery Senior Analyst USD 107K-173KAnsible | Argo CD | Bash | CI/CD | DockerSenior-level Full TimeDallas, Texas, United States8h ago
-
Senior Software Engineer, Cross Platform Applications USD 212K-387KArtificial Intelligence | Automation | Code Analysis | Dynamic analysis | JavaScriptSenior-level Full TimeSan Jose, California, United States8h ago
-
Machine Learning Engineer, AI Coding Tools USD 156K-387KDeep learning | GPU clusters | Inference acceleration | Language Models | Large Language ModelsMid-level Full TimeSan Jose, California, United States8h ago
-
Automated Regression | Automated regression testing | BM25 | Benchmarking | Code ExecutionSenior-level Full TimeSeattle, Washington, United States8h ago
-
Agent architecture | Automated Regression | Automated regression testing | BM25 | BenchmarkingSenior-level Full TimeSan Jose, California, United States8h ago
-
Data Engineer USD 62K-62KAzure Data | Azure Data Factory | DBT | Data Factory | Data Modeling401k | Dental insurance | Disability insurance | Flexible spending account | Internal promotion opportunitiesMid-level Full TimeKS, Leawood8h ago
-
Backend Software Engineer - Security Data USD 122K-316KApache Kafka | Apache Spark | Data Modeling | Data Quality | ETLMid-level Full TimeSan Jose, California, United States8h ago
-
C++ | Cloud platform | Conversational AI | Document AI | Evaluation FrameworksConferences and industry events participation | Industry thought leadership | Technical product briefingsSenior-level Full TimeReston, VA, USA; Boulder, CO, USA9h ago
-
Senior Software Engineer, AI/ML GenAI USD 174K-252KC++ | Capacity Management | Cloud platform | Computer Vision | Data ProcessingSenior-level Full TimeSunnyvale, CA, USA9h ago
-
Software Engineer, AI/ML Infrastructure, TILES USD 147K-211KArtificial Intelligence | Automation | C++ | Capacity Management | Data StorageMid-level Full TimeSunnyvale, CA, USA9h ago
-
C++ | Data Processing | Debugging | Generative AI | Language ModelsSenior-level Full TimeMountain View, CA, USA9h ago
-
C++ | Data Processing | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeMountain View, CA, USA9h ago
-
Senior Software Engineer, AI/ML, Search Ads USD 174K-252KAds bidding | C++ | Data Science | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeNew York, NY, USA; Mountain View, …9h ago
-
Staff Datacloud Blackbelt Engineer, Data and AI USD 183K-265KAI Engineering | AI/ML | AI/ML workflows | BigQuery | Cloud ArchitectureSenior-level Full TimeSunnyvale, CA, USA9h ago
-
Product Manager, AI Foundations Data USD 163K-237KBig Data | Data Management | Data acquisition | Information Retrieval | LLMMid-level Full TimeSunnyvale, CA, USA9h ago
-
Apache Flink | Apache Hive | Apache Hudi | Apache Iceberg | Apache SparkSenior-level Full TimeSunnyvale, CA, USA9h ago
-
Staff Software Engineer, Generative AI, Core ML USD 207K-300KAI Feedback | Computer Vision | Data Processing | Deep learning | Digital TwinSenior-level Full TimeMountain View, CA, USA9h ago
-
Customer Engineer III, Applied AI, Google Cloud USD 174K-252KAgent tooling | C++ | Cloud Native | Cloud Native Architecture | Conversational AISenior-level Full TimeNew York, NY, USA; Chicago, IL, …9h ago
-
APIs | Agent systems | CrewAI | Fine Tuning | Hugging FaceSenior-level Full TimeAddison, TX, USA; Austin, TX, USA9h ago