Senior Staff AI Data Infrastructure/Pipeline Engineer
Tasks
- Build data cleaning and annotation quality inspection tools
- Build data management platform to support model training
- Build distributed data processing systems
- Build offline and real time data processing systems
- Collaborate with model training teams on requirements and implementation
- Design data closed loop pipelines
- Develop data mining toolchains for error case discovery
- Enable fast data retrieval for team collaboration
- Implement data lake ingestion platform
- Implement log event tracking and connected vehicle data ingestion
- Manage data version control data lineage and metadata
- Optimize data pipeline throughput and latency
- Perform data synchronization and data standardization
- Provide data as a service and data visualization
- Solve large scale transmission memory and I O bottlenecks
Perks/Benefits
Skills/Tech-stack
Apache Iceberg | Apache Kafka | Caching | Data Lake | Data Lineage | Data version control | Distributed Systems | Docker | ETL | Go | High Throughput | Iceberg | Java | Kubernetes | Lance | Low Latency | Metadata Management | MongoDB | MySQL | NoSQL | Performance Tuning | PostgreSQL | Pulsar | Python | RabbitMQ | Redis | Relational databases | Stream processing | Version control
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Roles
AI | AI Data Infrastructure Engineer | AI Data Pipeline Engineer | Data Engineering | Data Engineering Manager | Data Infrastructure Engineer | Data Pipeline Engineer | Engineer | Engineering Manager | Infrastructure Engineer | Manager | Pipeline Engineer | Senior Staff AI Data Infrastructure Engineer | Staff AI Data Infrastructure Engineer
Regions
Countries
States
Cities
Related jobs
-
Senior Staff Data Engineer USD 123K-185KAPI | Automated testing | Cloud platform | Data Analysis | Data GovernanceDental insurance | Health care | Paid time off | Retirement plan | Sick leaveSenior-level Full TimeResidence Based, Residence Based, US3h ago
-
ML Engineer USD 190K-320KCost Optimization | Data Versioning | Dataset Operations | Dataset curation | Eval Frameworks401k matching | Dental insurance | Employee assistance program | Health insurance | Stock optionsSenior-level Full TimeSan Francisco5h ago
-
Senior-level Full TimeOklahoma City7h ago
-
Principal Data Engineer USD 200K-240KAWS | Agentic Workflows | Anomaly Detection | Batch pipelines | CCPA401k plan | Commuter benefits | Flexible vacation | Life insurance | Long-term disabilitySenior-level Full TimeBoulder, Colorado or New York City, … R7h ago
-
Sr. Manager, Engineering USD 228K-314KCloud Computing | Cross-Functional Collaboration | Cross-functional | Distributed Systems | Functional collaborationSenior-level Full TimeMountain View, California10h ago
-
Staff Machine Learning Engineer USD 159K-309KAWS | Airflow | Apache Spark | BigQuery | Cloud platform401k plan with company match | Commuter benefits | Disability coverage | Electric Car Charging Station | Employee assistance programSenior-level Full TimeMountain View, USA10h ago
-
Staff Machine Learning Engineer USD 152K-261KAWS | Airflow | Apache Spark | BigQuery | Cloud platform401k plan with company match | Commuter benefits | Disability insurance | Electric Car Charging Station | Employee assistance programSenior-level Full TimeMountain View, USA10h ago
-
Staff Software Engineer - AI Research Infrastructure USD 190K-270KBackend Services | C plus plus | CI/CD | Cloud infrastructure | Cluster managementSenior-level Full TimeNew York City, New York; San …11h ago
-
Staff Software Engineer - AI Research Infrastructure USD 190K-270KBackend Services | CI testing | Cluster scheduling | Data Pipelines | Distributed SystemsSenior-level Full TimeNew York City, New York11h ago
-
Senior AI Solutions Engineer, Enterprise Knowledge Work USD 260K-325KAgentic Systems | Dspy | Evaluation | LLM orchestration | LanggraphCollaborative culture | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States; …11h ago
-
Senior AI Solutions Engineer, Software Engineering USD 260K-325KAgentic Software | Agentic Software Engineering | Agentic Workflows | Benchmarking | Code generationCollaborative culture | Five days per week | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States; …11h ago
-
Senior Manager, Finance Insights & Analytics USD 89K-180KBudgeting | Cost drivers | Data Mining | Data Modeling | Data QueryingSenior-level Full TimeTwo Destiny Way, Westlake TX, United …11h ago
-
Principal, AI Platform Engineer USD 125K-187KAWS | Azure | CI/CD | Data leakage | Deterministic executionSenior-level Full TimeAtlanta, Georgia, US United States, 3034011h ago
-
Generative AI Consultant USD 105K-105KAWS | Azure | CI/CD | Deep learning | Docker401k matching | Health insurance | Paid time off | Parental leave | Professional developmentMid-level Full TimeSan Francisco, CA, United States12h ago
-
Lead Product Manager, Data Science USD 109K-162KA Model Governance | A/B | A/B Testing | Amazon SageMaker | B testing401-k plan | Commuter benefits | Dental insurance | Employee stock purchase program | Family planning supportSenior-level Full TimeLos Angeles, California, United States13h ago
-
Robotics Integration Engineer USD 170K-250KAutomation | Behavior Trees | C++ | Control Systems | GitMid-level Full TimeSan Jose, CA13h ago
-
Applied Scientist - ML/Ai USD 156K-310KComputer Vision | Convolutional Neural Networks | Data Processing | Deep Neural Networks | Deep learning401k | Dental insurance | Life insurance | Medical insurance | Unlimited PTOSenior-level Full TimeMiami, Florida, United States; Office - …14h ago
-
Astrodynamics | C++ | Conjunction analysis | Embedded Systems | Estimation TheorySenior-level Full TimeChantilly, VA or Aurora, CO14h ago
-
AI Engineer USD 150K-250KAPI Integration | Agents | Data integration | Debugging | Evaluation401k | Dental insurance | Health insurance | Vision insuranceMid-level Full TimeSan Francisco14h ago
-
Internal Systems Engineer (Applied AI) USD 140K-160KAgentic Workflows | CI/CD | DAG | Freshdesk | Gitbook401k | Catered lunch | Flexible PTO | Flexible spending accounts | Great coffeeEntry-level Full TimeColumbus14h ago
-
Senior Machine Learning Engineer USD 200K-230KBatching | Cloud Inference | Computer Vision | Deep learning | Edge ComputingDental insurance | Flexible PTO | Health insurance | Remote work | Vision insuranceSenior-level Full TimeRemote, US or Canada - NYC … R14h ago
-
Senior Data Engineer USD 150K-165KAPIs | AWS | Automation | CI/CD | Data Pipelines401k matching | Birthday day off | Fitness stipend | Floating holidays | Health benefitsSenior-level Full TimeUnited States R14h ago
-
Manager Data Analytics USD 110K-125KA/B | A/B Testing | Adobe Analytics | Amazon Athena | Amazon QuickSightMid-level Full TimeEl Segundo, CALIFORNIA, United States14h ago
-
Associate Director, Digital Marketing Analytics USD 83K-100KAI Agents | CDP | CRM Analytics | Contentsquare | Customer DataHybrid work model | Remote work optionsMid-level Full TimeOffice - San Diego, CA14h ago
-
Sr Software Engineer II, Storage USD 148K-237KArchitecture | Design by Contract | Distributed Systems | Error Handling | Incident ResponseDiscretionary paid time off | Emotional and mental wellness support | Employee resource groups | Fitness programs | Learning and development programsSenior-level Full TimeWashington, United States R15h ago