AI Data Engineer
Tasks
- Build high throughput data loading for training
- Build ingestion systems for multimodal data
- Collaborate with ML researchers and engineers
- Construct evaluation datasets with integrity controls
- Design and operate large scale AI data pipelines
- Design storage architectures for cost throughput and latency
- Develop dataset versioning and lineage tracking
- Document data systems schemas and procedures
- Drive observability for data quality and pipeline health
- Implement data cleaning and quality assurance
- Implement data privacy redaction and consent enforcement
- Implement labeling workflows and active learning
- Optimize cost and performance with compression and caching
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Beam | Apache Spark | CI/CD | Data Lineage | Data Modeling | Data Privacy | Data Quality | Data Storage | Data pipeline | Data redaction | Dataset versioning | Distributed Systems | High Throughput | High-throughput computing | Java | Python | Ray | Unit Testing
Education
Roles
Related jobs
-
Senior / Principal Infrastructure Engineer - ML Platform USD 278K-345KAWS | CI/CD | Cloud infrastructure | Cloud platform | Cluster managementEquity compensation | Onsite schedule Tuesday Wednesday ThursdaySenior-level Full TimeSan Mateo, CA, United States R18h ago
-
Mid-level Full TimeCarmel, Indiana- Hybrid OR St. Louis, … R23h ago
-
Senior AI Infrastructure Engineer, LLM/AI Platforms USD 140K-215KAWS | Airflow | Amazon SageMaker | Ansible | BatchingCompetitive vacation and holidays | Comprehensive wellness programs | Employee networks | Paid adoption leave | Paid parental leaveSenior-level Full TimeUSA VA Remote, United States R23h ago
-
Data Engineer USD 83K-158KAngular | Continuous Delivery | Continuous integration | DevOps | Distributed SystemsMid-level Full TimeTwo Destiny Way, Westlake TX, United … R23h ago
-
Senior-level Full TimeTwo Destiny Way, Westlake TX, United … R23h ago
-
Senior Data Engineer USD 97K-185KAgile | Data Governance | Data Modeling | GitHub | Metadata ManagementOnsite work modelSenior-level Full Time2 Contra Way, Merrimack NH, United … R23h ago
-
Senior-level Full TimeMansfield, MA (Remote) R23h ago
-
Staff Software Engineer, Applied AI USD 200K-240KDataset curation | Evaluation | FastAPI | LLM | Langchain401k | Co-working space reimbursement | Equity incentive | Flexible vacation policy | HSA contributionSenior-level Full TimeU.S. (Remote) R1d ago
-
AI Solutions Architect USD 148K-195KAI Solution | AI Solution Architecture | Application development | Cloud deployment | Data PipelinesEquity commitment | Flexible work | Professional development | Remote work | Social impact projectsSenior-level Full TimeRemote, United States; Washington, District of … R1d ago
-
.NET | Azure | Azure Data | Azure Data Explorer | Azure IoT401k match | Health insurance | Paid Holidays | Paid time offSenior-level Full TimeUnited States R1d ago
-
API | AWS Glue | Amazon Redshift | Amazon Web Services | Apache AirflowFully remote | On call production supportMid-level Full TimeOrlando, FL, United States R1d ago
-
Cleared Hybrid Data Engineer (5418) USD 103K-171KAPI Integration | AWS | AWS Glue | AWS Redshift | Access ControlHealth insurance | Learning and development opportunities | Paid leave | RetirementSenior-level Full TimeHanover, MD R1d ago
-
AWS | AWS Batch | AWS Bedrock | AWS CDK | AWS CloudWatch401k plan | Healthcare benefits | PTO | Paid Company Holidays | Phone stipendSenior-level Full TimeSan Carlos - Hybrid R1d ago
-
Autonomy | C++ | DDS | Data Ingestion | Debugging401k | Healthcare coverage | PTO | Paid Holidays | Phone stipendMid-level Full TimeSan Carlos - Hybrid R1d ago
-
Autonomy | C++ | CPU GPU | CPU/GPU Optimization | DDS401k | Healthcare | Hybrid work | Paid Holidays | Paid time offSenior-level Full TimeSan Carlos - Hybrid R1d ago
-
Senior DataOps Engineer USD 130K-258KAgent Jobs | App Service | App Service Environments | App Services | Azure AutomationSenior-level Full TimeRemote R1d ago
-
Apache Airflow | BigQuery | Cloud Dataflow | Cloud platform | DBTAnnual company off site events | Annual professional development budget | Co-working space allowance | Comprehensive health insurance | Equity via ESOPSenior-level Full TimeCanada R1d ago
-
Senior-level Full TimeChicago, Illinois, USA R1d ago
-
Senior Quantitative Software Engineer USD 121K-140KAgile | Data Analysis | Python | Quantitative risk | Relational databasesFlexible hybrid work model | Health insurance | Life insurance | Paid time off | Pension benefitsSenior-level Full TimeJersey City, NJ, United States R1d ago
-
Staff Designated Support Engineer USD 122K-160KAWS | AWS Glue | As-a-Service | Azure | Azure DataOn-call support availabilitySenior-level Full TimeUS-TX-Remote R1d ago
-
AI Solutions Engineer - Professional Services USD 107K-144KAPI Integration | Anthropic Claude | Benefit Analysis | Change Management | Code MigrationRemote work | Work from anywhereMid-level Full TimeUnited States R1d ago
-
Director, Data Science: Data Science Tools USD 125K-211KAirflow | Bash | Celery | Dash | DatabricksHybrid schedule | Professional development | Remote workExecutive-level Full TimeRemote, Remote, United States R1d ago
-
Software Engineer, ML Dev Enablement USD 123K-163KAWS | C++ | DDP | Data Pipelines | Distributed Systems401k match | Dental insurance | Health insurance | Health savings account | Hybrid remote workSenior-level Full TimeLas Vegas, Nevada, United States; Remote … R1d ago
-
Senior Data Engineer USD 117K-146KAPI Development | API Gateway | AWS Glue | AWS Lambda | AWS S3401k match | Dental insurance | Education assistance program | Employee assistance program | Family leaveSenior-level Full TimeRemote, United States R1d ago
-
Senior Software Engineer- Big Data & Java USD 133K-160KADLS | AWS | Amazon S3 | Apache Beam | Apache FlinkAllyship and inclusion communities | Caregiver leave | Continuous development support program | Employee assistance program | Employee recognitionSenior-level Full TimeRemote, USA R1d ago