Data Engineer III
Tasks
- Build data foundations for AI and ML training datasets
- Build real time data access layers for AI systems
- Design CI CD and automated testing for data pipelines
- Design feature stores and embedding pipelines
- Establish monitoring and alerting with SLAs
- Implement data governance across data models and AI assets
- Implement data quality strategies and validation rules
- Integrate data solutions with MLOps and DevOps
- Lead architecture and design of data pipelines
- Mentor engineers and lead code reviews
- Migrate workloads and optimize compute
- Optimize Delta Lake table layouts and clustering
- Own data infrastructure health scalability and modernization
- Perform Delta Live Tables expectations for data quality
- Support data quality testing and troubleshooting
Perks/Benefits
- 401k match
- Adoption Assistance
- FSA
- Fertility assistance
- Group health insurance
- HSA
- Life and accident insurance
- Long-term disability
- Paid Holidays
- Paid parental leave
- Paid time off
- Short-term disability
Skills/Tech-stack
Alerting | Apache Spark | Automated testing | CI/CD | CloudFormation | Clustering | Compute Optimization | Cost attribution | Data Governance | Data Lakes | Data Management | Data Quality | Data Validation | Data virtualization | Databricks | Delta Lake | Delta Live Tables | Delta Live) | Docker | ELT | ETL | Feature Store | FinOps | Kubernetes | Lakehouse Architecture | MLflow | Master Data | Master Data Management | Monitoring | Python | SQL | Structured Streaming | Terraform | Unity Catalog | Vector Search | Z-ordering
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Regions
Countries
States
Cities
Related jobs
-
AI Solutions Specialist USD 148K-200KAI Search | Agent Frameworks | Artificial Intelligence | Automation | Azure AIHybrid workMid-level Full TimeKansas City, MO, United States5h ago
-
Data Science Engineer (Shreveport, LA) USD 37K-40KData Historian | Data Visualization | Data analytics | Excel | Machine Learning401k match | Dental insurance | Disability insurance | Health insurance | Life insuranceMid-level Full TimeAtlanta, GA, United States R5h ago
-
AWS Bedrock | CI/CD | CUI SPI | Chunking | Data GovernanceGovernment furnished equipment | No sponsorship | No subs requirement | Remote workEntry-level Full TimeUnited States6h ago
-
Staff Software Engineer, Knowledge Catalog, AI USD 207K-301KBig Data | Computer Vision | Context engineering | Conversational Analytics | Data GovernanceBenefits | Bonus | EquitySenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA10h ago
-
Senior Data Engineer USD 156K-227KApache Flume | Apache Spark | Data Analysis | Data Engineering | Data ModelingSenior-level Full TimeMountain View, CA, USA; Zürich, Switzerland10h ago
-
Lead Analyst Data Engineer USD 129K-170KAWS Glue | AWS Lake Formation | AWS Step Functions | Alation | Amazon AthenaSenior-level Full TimeHouston, TX, 77046, US11h ago
-
Principal Research Data Engineer USD 142K-185KAirflow | Analytical processing | ArcGIS | Avro | CI/CDDental | Health care | PTO | Retirement | Sick leaveSenior-level Full TimeSt. Louis, Missouri, US R14h ago
-
Generative AI Engineer - Ford Pro Intelligence USD 118K-232KAPI Integration | Agent Orchestration | Cloud deployment | Cloud platform | Data OutputsMid-level Full TimeBellevue, WA, United States16h ago
-
Machine Learning Engineer (Active Secret Clearance) USD 160K-190KAgile | Asynchronous programming | CI/CD | Data Engineering | Docker401k plan | FSA | Fully remote work | HSA | Hybrid onsite optionMid-level Full TimeRemote; Tacoma, WA R19h ago
-
Lead ML Inference Engineer, Advertising USD 195K-352KArtificial Intelligence | Auction dynamics | Co-design | Control Optimization | Distributed SystemsSenior-level Full TimeAustin, Texas22h ago
-
HR AI/ML Engineer II USD 90K-135KApache Airflow | Databricks | ETL | Git | Machine LearningDental insurance | Employee assistance program | Employee stock ownership plan | Health insurance | Paid parental leaveSenior-level Full TimeHerndon, VA, United States22h ago
-
Cloud Storage | Compute Orchestration | Computer Vision | Data Lineage | Data PipelinesEnd-to-end responsibility | Fast-paced startup environment | High autonomy | Onsite work | OwnershipMid-level Full TimeSan Mateo, CA; Onsite R22h ago
-
Market Data Platform Engineer USD 168KAccess Control | Automation | Bash | Capacity Planning | Disaster Recovery401k plan | Disability benefits | Life insurance | Paid time off | Parental leaveMid-level Full Time142019-NC-300 South Brevard, Charlotte, United States22h ago
-
Principal Optimization Engineer USD 117K-234KCONOPT | Cloud Computing | Convergence analysis | Discrete Optimization | Fluid modelingHealth care benefits | Hybrid remote option | Paid Holidays | Paid sick days | Paid vacationSenior-level Full TimeCAG10: ALC HQ, 1025 Cobb Place … R22h ago
-
Data/AI Engineer USD 94K-135KACID | Artificial Intelligence | Automated testing | Azure DevOps | Bronze Silver Gold401k savings plan | Flexible Spending Accounts FSA | Health Savings Account (HSA) | Healthy Lifestyle Programs | Long-term disabilitySenior-level Full TimeUS-Nationwide-FIELD, United States22h ago
-
Data AI Engineer, Dir, P4 USD 150K-190KAWS | Apache Spark | Azure | Data Architecture | Data GovernanceHybrid workSenior-level Full Time1 New York Plaza, United States22h ago
-
Analytics Engineer USD 118K-177KAWS | Airflow | DBT | Dagster | Data Architecture401k match | Dental insurance | Life insurance | Medical insurance | Tuition reimbursementSenior-level Full TimeWaltham Office, United States22h ago
-
Senior Big Data Engineer USD 130K-196KAWS | Access Control | Airflow | Alerting | Apache Spark401k matching | Employee assistance program | Flexible paid time off | Medical, dental, vision, life, and disability insurance | Paid HolidaysSenior-level Full TimeSan Francisco, United States22h ago
-
Pathology Computational Scientist USD 93K-136KBioinformatics | Containerization | Data Analysis | Data Visualization | Database systemsCareer advancement opportunities | Comprehensive benefits | Onsite work environmentMid-level Full Time60 Fenwood Road Boston (Hale Building), …22h ago
-
APIs | Agile | Azure | Azure Data | Azure Data FactoryPeriodic travel | Remote work permittedSenior-level Full Time6314 Remote/Teleworker US, United States R22h ago
-
Senior-level Full TimePlano, TX, United States22h ago
-
C++ | Embedded Linux | Hardware-in-the-loop | Hardware-in-the-loop Testing | Loop Testing401k match | Education reimbursement | Health Savings Account contribution | Paid time offMid-level Full TimeCambridge - B3 Crossing, United States22h ago
-
Software Engineer, Knowledge Systems USD 180K-350KData Pipelines | Data Processing | Data Quality | Distributed Systems | Entity ResolutionSenior-level Full TimeSan Francisco, California23h ago
-
Robotics Forward Deployed Engineer USD 135K-217KAutomation | Cause analysis | Control Systems | Dashboards | Data VisualizationCross-functional collaboration | On site work experience | Travel to customer sitesSenior-level Full TimeWatertown, MA1d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Bonus | Equity | Friendly and laid-back atmosphereMid-level Full TimeSeattle, WA, USA1d ago