AI Pipeline Engineer
Tasks
- Build evaluation dataset construction pipelines
- Build high throughput data loading for training
- Build ingestion systems for multimodal data
- Collaborate with ML teams on data infrastructure needs
- Design and operate AI data pipelines
- Design storage architectures across data tiers
- Develop dataset versioning and lineage systems
- Document data systems schemas and procedures
- Drive observability for data quality drift and pipeline health
- Implement data cleaning and quality assurance
- Implement data privacy redaction and consent enforcement
- Implement labeling and active learning pipelines
- Optimize cost and performance of data processing
Perks/Benefits
Skills/Tech-stack
Active Learning | Apache Beam | Apache Spark | CI/CD | Caching | Compression | Data Governance | Data Ingestion | Data Lineage | Data Modeling | Data Privacy | Data Quality | Data Storage | Data redaction | Dataset versioning | Deep learning | Distributed Systems | GPU Utilization | Human-in-the-loop | Java | Java Virtual Machine | Machine Learning | Observability | Python | Ray | Scala | The Loop | Virtual machine
Education
Roles
AI | AI Pipeline Engineer | Data Engineer | Engineer | Pipeline Engineer
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R10d ago
-
Director, Data Science: Data Science Tools USD 125K-211KAirflow | Bash | Celery | Dash | DatabricksHybrid schedule | Professional development | Remote workExecutive-level Full TimeRemote, Remote, United States R11h ago
-
Senior Staff AI Data Engineer - Hybrid USD 135K-202KAWS | Alerting | Azure | Batch pipelines | ChunkingHybrid work schedule | Learning and development opportunities | MentorshipSenior-level Full TimeHartford CT- Home Office, United States R1d ago
-
Mid-level Full TimeUnited States - Remote R1d ago
-
AI Engineer - Application Development USD 75K-158KAPI Integration | AWS | Agno | Amazon Bedrock | AzureFlexible time off | Learning resourcesMid-level Full Time999 REMOTE, United States R1d ago
-
Embedded AI Engineer USD 100K-150KC++ | Core ML | Edge AI | Edge inference | Energy EfficiencyCareer growthSenior-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Edge AI Engineer USD 100K-150KC++ | Core ML | Energy Efficiency | Federated Learning | Hybrid Cloud100 percent remote | Diversity and inclusion | Long-term career growthSenior-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer USD 100K-150KAblation Studies | Accelerators | Computer Vision | Data Quality | Data labeling100 percent remote work | Benefits packageMid-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer USD 100K-150KAblation Studies | Accelerators | Baseline Models | Computer Vision | Data QualityFull-time benefits | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Lead Full Stack Engineer, AI Solutions USD 129K-177KAgentic AI | Angular | Artificial Intelligence | Automated testing | Azure401k retirement savings | Hybrid work option | Life insurance | Long-term disability | Medical/Dental/Vision insuranceSenior-level Full TimeWork at Home - Kentucky, United … R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Hudi | Apache IcebergCareer growth opportunities | Health benefits | Mentorship | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Principal AI Data Analyst- Remote USD 112K-193KAWS | Automation | Azure | CI/CD | Data Lake401k contribution | Comprehensive benefits | Equity stock purchase | Incentive and recognition programs | Remote workSenior-level Full TimePrimary location: Eden Prairie, MN R1d ago
-
AI Data Engineer USD 100K-150KApache Beam | CI/CD | Data Lineage | Data Modeling | Data PrivacyCareer growth | Health benefits | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
AI Data Engineer USD 100K-150KApache Beam | CI/CD | Data Lineage | Data Modeling | Data PrivacyFull-time benefits | No third party employment | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Data Platform Architect USD 100K-150KAccess Control | Access Management | Alation | Amazon Redshift | Apache FlinkFull time W2 employment benefits | Long-term career growth | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Generative AI Specialist USD 100K-150KAgent Frameworks | Agentic Workflows | Embeddings | Evaluation | Language ModelsCareer growth | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
LLM Engineer USD 100K-150KAdapter Layers | Attention Optimization | Benchmarks | DPO | Data GenerationRemote workMid-level Full TimeUnited States - Remote R1d ago
-
LLM Engineer USD 100KAdapters | Benchmarking | DPO | Dataset curation | Distributed TrainingRemote workMid-level Full TimeUnited States - Remote R1d ago
-
LLM Engineer USD 100K-150KAdapter-Tuning | Benchmarking | DPO | DeepSpeed ZeRO | Evaluation methodologyMid-level Full TimeUnited States - Remote R1d ago
-
Mid-level Full TimeUnited States - Remote R1d ago