AI Pipeline Engineer
Tasks
- Build evaluation dataset construction pipelines
- Build high throughput data loading systems for training
- Build ingestion systems for multimodal data
- Collaborate with ML researchers and engineers
- Design and operate large scale AI data pipelines
- Design storage architectures for cost throughput and latency
- Develop dataset versioning lineage and provenance tracking
- Document data systems schemas and operational procedures
- Drive observability of data quality drift and pipeline health
- Implement data cleaning deduplication and quality assurance
- Implement data privacy redaction and consent enforcement
- Implement labeling workflows and active learning pipelines
- Optimize cost and performance with compression formats and caching
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Beam | Apache Spark | CI/CD | Code review | Compression | Data Lineage | Data Modeling | Data Privacy | Data Quality | Data Storage | Data caching | Data redaction | Dataset versioning | Distributed Systems | GPU Utilization | High Throughput | JVM | Python | Ray | Testing
Education
Roles
AI | AI Pipeline Engineer | Data Engineer | Engineer | Pipeline Engineer
Related jobs
-
Automated Speech Recognition | CI/CD | CUDA | Computer Vision | Containerization401k matching | Company events | Dental coverage | Flexible work schedules | Internet reimbursementSenior-level Full TimeAnnapolis Junction, MD R9h ago
-
4G | 5G | Automation | Network Analysis | Network TroubleshootingEducational assistance | Paid Holidays | Paid vacation | Sick leave | Stock purchase planMid-level Full TimePlano,Texas,United States R10h ago
-
Data Engineer USD 124K-124KAWS | Apache Spark | DBT Cloud | DBT Core | JSON401k | Employee assistance program | Health savings account | Life insurance | Medical, dental, and visionMid-level ContractWestbrook, Maine, USA R12h ago
-
Sr Data Engineer_ITDE1I USD 102K-170KAPI Integration | AWS | Automation | Azure | CI/CD401k match | Dental insurance | Disability insurance | Hybrid work policy | Life insuranceSenior-level Full TimeHOUSTON, US, 77056 R17h ago
-
Sr. Automation Engineer Robotics Software USD 115K-144KAutomation | Computer Vision | Databases | FastAPI | HMIDental insurance | Health insurance | Paid time off | Retirement plan | Sick leaveSenior-level Full TimeAnkeny, Iowa, US R17h ago
-
Mid-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R18h ago
-
Software Engineer, Data Platform Team USD 152K-179KApache Airflow | Data APIs | Data Catalog | Data Lineage | Data Modeling401k matching | Medical, dental, and vision | Quarterly in person surges | Remote-first work environmentMid-level Full TimeRemote - USA R21h ago
-
Senior Machine Learning Engineer USD 229K-360KAB Testing | APIs | Airflow | Algorithm Development | Amazon S3Disability benefits | Health insurance | Life insurance | Paid Equity Awards | Paid time offSenior-level Full TimeNew York, New York R21h ago
-
Senior Machine Learning Engineer USD 229K-360KA/B | A/B Testing | Amazon S3 | Amazon SageMaker | Apache AirflowCommuter benefits | Disability benefits | Equity awards | Financial wellness support | Health insuranceSenior-level Full TimeSan Jose, California R21h ago
-
Senior AI Engineer – AI Platform USD 140K-175KAWS | Drift Detection | Embeddings | Evaluation Pipelines | Function CallingDaily group classes | Dry cleaning | Free onsite fitness center | Free shuttle transportation | Gourmet cafeteriaSenior-level Full TimeEnglewood Cliffs, NEW JERSEY, United States R21h ago
-
Automated Speech Recognition | CI/CD | Computer Vision | Docker | Inference Server401k | Employee discount program | Flexible work schedule | Health savings accounts | Life insuranceSenior-level Full TimeFORT MEADE, MD, US R23h ago
-
AI Engineer USD 220K-260KAPI Development | Agent Orchestration | Data Generation | Debugging | Fine Tuning401k matching | Dental insurance | Fertility and family building stipend | Flexible PTO | Health insuranceMid-level Full TimeSan Francisco R1d ago
-
Forward Deployed Engineer, Agentic AI USD 180K-180KAI Security | AWS Bedrock | Access Control | Agent Development | Anthropic ClaudeMid-level Full TimeUS - Remote R1d ago
-
Agents | Golang | Information Retrieval | Language Models | Language Processing401k company match | ESPP | Family leave programs | Flexible spending accounts | Flexible time offSenior-level Full TimeMountain View, CALIFORNIA, United States R1d ago
-
Director, AI & Agentic Engineering CAD 200KAI Foundry | AWS Bedrock | Agent Orchestration | Agentic Systems | Artificial IntelligenceHybrid workExecutive-level Full Time135 W 26th Street, New York, … R1d ago
-
21 CFR | 21 CFR Part 11 | AVEVA PI Data Historian | Asset Framework | Aveva PISenior-level Full TimeHolly Springs, United States R1d ago
-
Data Engineer USD 63K-114KAWS Glue | Azure Synapse | CI/CD | Cloud Dataproc | DB2Be Well programs | Dental coverage | Disability benefits | Hybrid work environment | Medical coverageSenior-level Full TimeUSDALFRI - Dallas Frisco AI HUB … R1d ago
-
AWS | Amazon S3 | ETL | Elasticsearch | GeoJSONHybrid workMid-level Full TimeUS-MA-Boston-Office, United States R1d ago
-
Software Engineer Energy Grid Data Platform. USD 140K-150KAWS | Database Design | Distributed Job Processing | ETL | GISHybrid workMid-level Full TimeUS-MA-Boston-Office, United States R1d ago
-
Senior Data Engineer USD 133K-172K.NET | AWS | AWS Glue | AWS Glue Data Catalog | AWS Lambda401k matching | Commuter benefits | Dental insurance | Employee stock purchase plan | Healthcare coverageSenior-level Full TimeUS-VA Richmond - CoStar Tower, United … R1d ago
-
Jr. Data Engineer (Puerto Rico) USD 57K-108KCI/CD | Data Curation | Data Ingestion | Data Mining | Data Modeling401k match | Counseling sessions | Dental insurance | Disability coverage | Employee assistance planEntry-level Full TimeUS-PR-SANTA ISABEL-B1 ~ Felicia Industrial Park … R1d ago
-
Senior Data Engineer - Homes.com - Arlington, VA USD 128K-190KAI Assisted Development | AWS | AWS Lambda | AWS ML | Amazon S3401-K matching | Commuter benefits | Dental insurance | Diversity equity and inclusion employee resource groups | Employee stock purchase planSenior-level Full TimeUS-VA Arlington, United States R1d ago
-
Principal--Data, Analytics & AI Architect USD 200K-269KAI Governance | AWS | Amazon Web Services | Cloud Architecture | Data GovernanceSenior-level Full TimeReston Town Center, United States R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Data Visualization | Econometrics | Machine Learning | Modeling | PythonCross-functional networking | Executive speaker sessions | Mentorship | Networking opportunities | Professional developmentEntry-level Full TimeMidtown Center, United States R1d ago