Machine Learning Data Engineer
Tasks
- Apply testing CI CD and code review processes
- Build data ingestion pipelines
- Develop high throughput data loading for accelerator training
- Ensure data quality and lineage
- Implement dataset versioning and reproducibility
- Operate petabyte scale storage and pipeline systems
- Support ML training and evaluation data delivery
- Transform and validate datasets
Perks/Benefits
Skills/Tech-stack
Apache Beam | Apache Spark | CI/CD | Code review | Data Lineage | Data Modeling | Data Quality | Data Storage | Data loading | Data storage formats | Dataset versioning | Distributed Systems | High Throughput | High Throughput Data Loading | High-throughput data | JVM | Java | Python | Ray | Reproducibility | Scala | Storage Formats | Testing
Education
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R15d ago
-
Applied AI Engineer, Investments USD 134K-183KAPIs | Cloud Computing | Data Pipelines | Data Quality | Data ValidationEmployer 401k match | Family forming benefits funding | Hybrid work onsite at least 60 percent of the time | Paid time off | Relocation supportNone Full TimeRedwood City, CA (Hybrid) R15h ago
-
Edge Computing AI Engineer USD 100K-150KC++ | DSP Toolchains | Device optimization | Device security | Edge inferenceMid-level Full TimeUnited States - Remote R15h ago
-
Generative AI Engineer USD 100K-150KBenchmarks | Dataset Construction | Direct Preference Optimization | Distributed Training | EvaluationCareer growth | Remote workMid-level Full TimeUnited States - Remote R15h ago
-
Big Data Engineer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Hudi | Apache IcebergRemote workSenior-level Full TimeUnited States - Remote R15h ago
-
Streaming Data Engineer USD 100K-150KACLs | AWS MSK | Ansible | Apache Flink | Apache KafkaRemote workSenior-level Full TimeUnited States - Remote R15h ago
-
Senior DataOps Engineer USD 150K-180K800-171 | AWS CloudFormation | AWS Glue | AWS GovCloud | AWS IAMRemote position | US government clearance requiredSenior-level Full TimeRemote - United States R17h ago
-
Senior Data Science Engineer I, Claims USD 170K-190KAWS | Apache Airflow | Automated testing | ClickHouse | Data Modeling401k matching | Disability and life insurance | Flexible working hours | Fully remote work | HSA & FSA optionsSenior-level Full TimeRemote R17h ago
-
Senior AI Engineer, Real-World Data USD 137K-175KAI orchestration | AWS | AWS Fargate | AWS Lambda | AWS S3401k benefits | Commuter benefits | Employee referral program | Fertility care benefits | Free testingSenior-level Full TimeUS Remote R18h ago
-
Senior AI Engineer USD 188K-258KAgentic Systems | Agile | Cloud Architecture | Code review | Configuration ManagementCell phone allowance | Comprehensive health coverage | Equity for every employee | Growth-focused environment | Home office setup allowanceSenior-level Full TimeRemote - US R18h ago
-
Amazon Redshift | Amazon SageMaker | Amazon Web Services | Azure Machine Learning | Azure SynapseDental insurance | Flexible spending account | Health insurance | Paid time off | Stock optionsEntry-level Full TimeUnited States - Remote R18h ago
-
Staff Data Engineer USD 237K-270KAmazon EMR | Amazon Redshift | Apache Airflow | Apache Flink | Apache SparkFamily planning support | Flexible time off | Lifestyle stipend | Mental health support | Paid parental leaveSenior-level Full TimeSan Francisco, CA R18h ago
-
Senior Performance Engineer, Data Products USD 172K-195KAPI | Benchmarking | ClickHouse | ClickHouse Cloud | Concurrency401k matching | Co hanging stipend | Company sponsored disability insurance | Company-sponsored life insurance | DCFSASenior-level Full TimeRemote R18h ago
-
Mid-level Full TimeRemote, United States R18h ago
-
Senior DataOps Engineer ( Remote US) USD 113K-163KAWS | AWS CloudFormation | Amazon EMR | Ansible | Apache Airflow401K employee contribution | Employee assistance program | Flexible Time Away From Work | Health & medical benefits | Learning platformSenior-level Full TimeRemote US R18h ago
-
Senior Software Engineer II - Ingestion AI Engineer USD 105K-155KAWS | Agile | Alerting | Azure | Causal InferenceMid-level Full TimeRemote, United States R19h ago
-
Senior Software Engineer, Data Engineering Platform USD 186K-218KAPIs | Bitcoin | Blockchain Protocols | Blockchain infrastructure | Crypto infrastructureSenior-level Full TimeRemote - USA R19h ago
-
Senior Software Engineer (Storage) - remote in the US USD 100K-150KArgoCD | CSI | Cluster API | Flux | GPUDirect StorageCompany outings happy hours | Conferences and working groups | Hackathons and tech talks | Professional development and trainingSenior-level Full TimeRemote, USA, United States R20h ago
-
Lead Data Engineer USD 170K-198KAWS DMS | BI Semantic Layer | CDC | CI/CD | Contract EnforcementCareer development | Hybrid work environment | Performance reviewsSenior-level Full TimeNew York, NY R20h ago
-
Senior DevOps Engineer (Storage) - remote in the US USD 200K-250KAir-gapped | Alerting | Argo CD | ArgoCD | Bare MetalAttend conferences and working groups | Professional development and trainingExecutive-level Full TimeRemote, USA, United States R21h ago
-
AI Engineer - AI Agents (Remote-United States) USD 112K-216KA/B | A/B Testing | Agent Orchestration | Automated testing | B testing401k retirement plan | Employee stock purchase plan | Medical/Dental/Vision insurance | Mental health support | Paid HolidaysSenior-level Full TimeUnited States R1d ago
-
Explosives Research Experiment Lead USD 146K-222KAerospace Engineering | Bench testing | C++ | Computational modeling | Computer Aided Design401k | Education reimbursement | Flexible schedule | Hybrid work schedule | Relocation assistanceSenior-level Full TimeLivermore, CA, United States R1d ago
-
AI Engineer - ICAM USD 146K-197KAccess Management | Agile | Artificial Intelligence | Generative AI | Hugging Face100 percent remote workMid-level Full TimeUSA MD Home Office (MDHOME), United … R1d ago
-
APIs | AWS | CData | Change Data Capture | Cloud Native401k retirement plan | Adoption Assistance | Dental coverage | Education assistance | Employee Learning and DevelopmentSenior-level Full TimeNEO - Tamer Rashid Building OA, … R1d ago
-
AWS AI/ML Technical Practice Lead USD 155K-205KAWS | Agile | Amazon Bedrock | Amazon Rekognition | Amazon SageMakerSenior-level Full TimeUSA - Remote, United States R1d ago