Member of Technical Staff - Data Flywheel Infra, Frontier Models
Tasks
- Apply geographic and regulatory data restrictions
- Automate data acquisition classification filtering deduplication and quality scoring
- Build data flywheel infrastructure for 1P and 3P data
- Build evaluation to data feedback loops for failure mining
- Build synthetic and AI native data pipelines
- Cluster failures and mine hard examples
- Detect and protect PII and sensitive data
- Enable policy aware dataset inclusion exclusion quarantine and restriction
- Enforce data security and policy compliance
- Generate label filter validate and enrich data using LLMs and agents
- Generate targeted datasets from data gaps
- Implement data provenance and lineage
- Implement data retention and deletion enforcement
- Ingest process curate version and serve first party and third party data
- Maintain provenance for human and model generated data
- Manage access control and data isolation
- Measure dataset quality coverage diversity contamination duplication and policy compliance
- Provide observability for data quality and attribution
Perks/Benefits
- N/A
Skills/Tech-stack
Access Control | Active Learning | Agents | Apache Flink | Apache Spark | Clean room | Compliance | Confidential Computing | Consent Management | Data Collaboration | Data Governance | Data Quality | Data Quality Metrics | Data Retention | Data clean room | Data deletion | Data isolation | Data provenance | Deduplication | Deidentification | Evaluation | Failure Mining | Hard example mining | LLM | License Management | Lineage | Multimodal Data | Observability | PII Detection | Policy enforcement | Privacy | Python | Quality metrics | Ray | Rights Metadata | SQL | Secure Data | Secure Data Collaboration | Synthetic data | VLM
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Related jobs
-
Research Scientist / Software Engineer, LLM/Agent Platform - TikTok - Content Ecology AI Innovation & Platform USD 160K-230KAccelerator optimization | Deep learning | DeepSpeed | Distributed Systems | Evaluation FrameworksSenior-level Full TimeSan Jose, California, United States7h ago
-
C++ | Data Processing | Debugging | Entity Extraction | Fine TuningSenior-level Full TimeMountain View, CA, USA8h ago
-
Practice Customer Engineer, Data Analytics, Google Cloud USD 152K-221KAlooma | Apache Spark | Architecture Design | Batch Processing | Big DataSenior-level Full TimeMountain View, CA, USA; Boulder, CO, …8h ago
-
Staff Software Engineer, Data Protection USD 207K-300KArtificial Intelligence | C++ | Data Governance | Data Privacy | Data StorageBonus | Equity | Health insurance | Paid time offSenior-level Full TimeSan Jose, CA, USA8h ago
-
Dev and AI Infra Software Engineer, Releases, XR USD 207K-300KAI Software Engineering | AI software | Automation frameworks | Bug detection | Build AutomationSenior-level Full TimeSan Jose, CA, USA8h ago
-
Staff ML Engineer, Search Ads Auto-Bidding USD 207K-300KC++ | Deep learning | Experiment design | Keras | Language ModelsSenior-level Full TimeNew York, NY, USA8h ago
-
Azure | Azure Data | Azure Data Lake | Azure Data Lake Storage | CI/CDCollaborative team environment | Learning & Mentorship | On-the-job training | Onsite work opportunityEntry-level Full TimeIrvine, CA, US10h ago
-
Cyber Software Engineer Staff (Embedded) USD 120K-224KBlue Team | C++ | CISSP | Code Analysis | Cybersecurity401k match | Education assistance | Employee assistance program | Flexible spending accounts | Flexible work schedulesSenior-level Full TimeOrlando, FL, US14h ago
-
Senior Machine Learning Engineer, Payments USD 191K-223KAirflow | Anomaly Detection | Data Processing | Deep learning | Fine TuningSenior-level Full TimeRemote-USA R17h ago
-
AI Engineer (Early Career) USD 50K-120KAI Agents | JavaScript | Language Models | Large Language Models | Machine LearningEntry-level Full TimeSan Francisco Bay Area17h ago
-
Lead Software Engineer - Data and Payments Data Platform USD 170K-201KAWS Glue | AWS S3 | Amazon Athena | Amazon EMR | Amazon RedshiftBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeAustin, TX, United States18h ago
-
Senior Data Engineer (Data Architecture) USD 105K-135KAPIs | AWS Glue | Airflow | Azure Data | Azure Data Factory401k matching | Dental insurance | Extended holiday break | Flexible schedules | Life insuranceSenior-level Full TimeRemote, United States R18h ago
-
Staff Engineer, Data Platform (R5659) USD 131K-215KAPI Design | Analytical Databases | AsyncAPI | Cloud infrastructure | Columnar StorageSenior-level Full TimeSan Diego, California19h ago
-
Data Engineer, Hardware Reliability (Starlink) USD 135K-185KBash | C# | C++ | Concurrency | Data InfrastructureExtended hours and weekends | Onsite work required | Travel up to 10%Mid-level Full TimeBastrop, TX R19h ago
-
Apache Airflow | Apache Flink | Apache Iceberg | Apache Kafka | Apache Spark401k employer match | Comprehensive healthcare benefits | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - United States R19h ago
-
Forward Deployed Engineer (Generative AI) USD 180K-230KAI Agent Builder | AI Pipelines | Agent Builder | Agent Developer Kit | Agentic designCareer development | Equal employment opportunities | Individual responsibilitySenior-level Full TimeAustin, Texas, United States - Remote R19h ago
-
AI Engineer USD 130K-170KClaims data | Data Preprocessing | Data Transformation | Data Visualization | Data cleaning401k match | Disability insurance | Employee wellness program | Health insurance | Life insuranceSenior-level Full TimeWarren, NJ, United States19h ago
-
Staff Software Engineer, Data Platform USD 231K-340KAWS | Access Control | Airbyte | Airflow | Anomaly DetectionSenior-level Full TimeNew York R19h ago
-
Staff Software Engineer, Data Platform USD 231K-340KAWS | Access Control | Airbyte | Amazon Redshift | Apache AirflowSenior-level Full TimeSan Francisco R19h ago
-
Sr. Staff Software Engineer, Big Data Platform USD 177K-364KAWS | Apache Flink | Apache Presto | Apache Spark | Data ProcessingIn office collaboration 1 to 2 times per quarterSenior-level Full TimePalo Alto; Seattle, WA; New York, … R19h ago
-
Mid-level Full TimeUnited States20h ago
-
Mid-level Full TimeSan Francisco, CA, United States20h ago
-
Change Management | Cloud Data | Cloud data warehousing | DBT | Data EngineeringHybrid work scheduleEntry-level Full TimeSan Francisco, CA, United States R20h ago
-
Senior Embedded Software Engineer USD 180K-235KAutomated testing | Board Bringup | C# | C++ | Code review401k matching | Disability insurance | Equity incentive options | Flexible PTO | Free Onsite Catered MealsSenior-level Full TimeSan Francisco21h ago
-
Senior AI Engineer, VideoAI USD 144K-236KA/B | A/B Testing | Apache Spark | Artificial Intelligence | B testingHealth and wellness programs | Time offSenior-level Full TimeMountain View, CA, United States R21h ago