Data Engineering Specialist – AI
Tasks
- Build high throughput data loading to maximize GPU utilization
- Build ingestion systems for multimodal data
- Design and operate large scale data pipelines for AI training and evaluation
- Design storage architectures for throughput cost and latency
- Develop dataset versioning lineage and provenance tracking
- Document data systems schemas and operational procedures
- Drive data quality drift and pipeline health observability
- Implement data cleaning deduplication filtering and quality assurance
- Implement data privacy redaction and consent enforcement
- Implement evaluation dataset construction with integrity controls
- Implement labeling workflows and active learning pipelines
- Optimize cost and performance using compression and caching
Perks/Benefits
- N/A
Skills/Tech-stack
Active Learning | Apache Beam | Apache Spark | CI/CD | Data Lineage | Data Modeling | Data Privacy | Data Quality | Data loading | Data redaction | Data reproducibility | Dataset versioning | Distributed Systems | High Throughput | High Throughput Data Loading | High-throughput data | JVM | Java | Python | Ray | Testing
Education
Related jobs
-
Staff Data Analytics Engineer USD 159K-220KApache Airflow | Apache Spark | BigQuery | DBT | Data ContractsFlexible working hours | Remote work flexibilitySenior-level Full TimeAmericas - Remote, US - Remote, … R1d ago
-
Director, Data Engineering USD 126K-222KAWS Lambda | Aerospike | Amazon Web Services | Autosys | CI/CDExecutive-level Full Time300 New Millennium Way, Durham NC, … R1d ago
-
Director, Revenue Analytics & AI Innovation USD 196K-247KAI | Automation | BigQuery | DBT | Data Governance401k match | Child care backup care | Donation match | FSA | Fertility care supportExecutive-level Full TimeNew York (Hybrid) R1d ago
-
Data Visualization Engineer USD 90K-112KArcGIS | Cartography | D3 | Data Visualization | GDALCommuter benefits | Employee assistance program | Health savings account | Home office reimbursement | LinkedIn Learning accessMid-level Full TimeSan Francisco, CA R1d ago
-
Manager, Data Platform Engineering USD 160K-201KAmazon Redshift | Batch Processing | Cost Optimization | Data Modeling | Data WarehousingMid-level Full TimeBoston, Massachusetts, United States R1d ago
-
Data Engineering Manager USD 102K-212KAnalytics engineering | Data Governance | Data Lakehouse | Data Modeling | Data WarehouseFlexible work environment | Learning opportunities | Well-being benefitsMid-level Full TimeUS-Remote R1d ago
-
Principal Data Engineering USD 112K-193KAzure | Azure Data | Azure Data Factory | Batch Processing | CI/CD401k contribution | Comprehensive benefits package | Equity stock purchase | Incentive and recognition programs | Remote work flexibilitySenior-level Full TimeEden Prairie, Minnesota, UNITED STATES; REMOTE R2d ago
-
Senior HR Reporting & Analytics Specialist USD 87K-174KDashboard Development | Data Quality | Data Reconciliation | Data Storytelling | Data Validation401k savings | Employee assistance programs | Health and welfare benefits | Hybrid work flexibility | Tuition assistanceSenior-level Full TimeNew York - 1166, United States R2d ago
-
Director - Data Engineering USD 215K-275KAWS | Amazon Web Services | Azure | Bash | Container OrchestrationFlexible time off | Healthcare | Hybrid work | Leave benefits | Retirement benefitsExecutive-level Full TimeSF4-San Francisco - 400 Howard Street, … R2d ago
-
VP, Data Platform and Analytics USD 167K-180KAWS | Agile | Artificial Intelligence | Azure | Data Engineering401k | Continuing education and training | Health and wellness days | Hybrid or remote work schedule | PTOExecutive-level Full TimeUnited States - Remote R2d ago
-
AI Governance | AWS | Analytics architecture | Data Engineering | Data Governance401k | Associate Purchase Discount Program | Community volunteer opportunities | Employee assistance program | Flexible work scheduleExecutive-level Full TimeTamarac, Florida, United States R2d ago
-
Generative AI Specialist USD 100K-150KAgentic Workflows | Embeddings | Evaluation | LLM APIs | Language ModelsFull-time W2 employment | Remote workMid-level Full TimeUnited States - Remote R3d ago
-
Head of Data USD 193K-230KAPI Integration | BigQuery | CDC | Cloud Storage | DBTEquity compensation | Quarterly visits to center | Relocation benefits | Remote workExecutive-level Full TimeLos Angeles or San Francisco; Remote … R5d ago
-
AI Specialist USD 182K-295KAgent systems | AgentCore) | Agentbuilder | Architecture Diagrams | Automated EvaluationDental insurance | Health insurance | Mental health benefits | Restricted stock units | Vision insuranceSenior-level Full TimeRemote - US R5d ago
-
Software Engineering Manager, Data & Analytics USD 120K-150KAWS | Alerting | Amazon Redshift | Amazon S3 | Architecture401k match | Flexible PTO | Fully remote | HSA match | Health, dental, and vision insuranceMid-level Full TimeCharlotte, NC R6d ago
-
Data Analyst USD 87K-120KDAX | Data Modeling | Data Quality | Data Refresh | Data refresh monitoring401k match | Dental insurance | Flexible spending account | Health insurance | Health savings accountMid-level Full TimeRemote, United States R6d ago
-
Hadoop Big Data Developer USD 100K-150KApache Airflow | Apache Flink | Apache Hudi | Apache Iceberg | Apache OozieCareer growth | Full-time employment | Remote workSenior-level Full TimeUnited States - Remote R7d ago
-
Generative AI Specialist USD 100K-150KAgent architecture | Chunking | Embeddings | Evaluation Frameworks | Fine Tuning100% remote | Career growthMid-level Full TimeUnited States - Remote R7d ago
-
Director, AI, Data and Developer Enablement USD 165K-275KAccess Controls | Apache Kafka | Apache Spark | CI/CD | Change ManagementDevelopment programs for advancement and career growth | Paid education assistance | Paid parental leave | Scheduling flexibility | Team member discountExecutive-level Full Time985 - Fred Meijer Office, United … R7d ago
-
Access Control | Amazon Web Services | Azure | CI/CD | Cloud Architecture401k retirement plan | Dental insurance | Employee assistance program | Medical insurance | Paid HolidaysSenior-level Full TimeUSA, TX, Work-at-Home, United States R7d ago
-
Associate Director, Data Engineering (Remote) USD 130K-140KAutomated testing | CI/CD | Continuous Delivery | Continuous integration | Data Governance401k company match | Career growth opportunities | Company holidays | Generous PTO | Medical/Dental/Vision insuranceMid-level Full TimePortland R7d ago
-
Automation | Big Data | CI/CD | Cloud infrastructure | Cloud platformFlexible location | Remote-first work environment | Work-life balance cultureExecutive-level Full TimeCanada R7d ago
-
Data Governance | Data Modeling | Data Quality | Data Visualization | Data quality assuranceFederal background investigation required | Federal healthcare environment | Obtain VA Personal Identity Verification PIV credential | VA cybersecurity trainingSenior-level Full TimeRemote, United States R7d ago
-
Data Engineer with AI/ML USD 72K-130KAWS | Agile | Apache Airflow | Azure ML | Azure ML Studio401k contribution | Career development | Comprehensive benefits | Equity stock purchase | Incentive and recognition programsMid-level Full TimePrimary location: Minnetonka, MN R8d ago
-
Artificial Intelligence | Data Engineering | Database systems | Financial Modeling | Portfolio analyticsFlexible time off | Healthcare benefits | Hybrid work model | Leave benefits | Retirement benefitsExecutive-level Full TimeSF4-San Francisco - 400 Howard Street, … R8d ago