Data Engineer III
Tasks
- Build data foundations for AI and ML training datasets
- Build real time data access layers for AI systems
- Design CI CD and automated testing for data pipelines
- Design feature stores and embedding pipelines
- Establish monitoring and alerting with SLAs
- Implement data governance across data models and AI assets
- Implement data quality strategies and validation rules
- Integrate data solutions with MLOps and DevOps
- Lead architecture and design of data pipelines
- Mentor engineers and lead code reviews
- Migrate workloads and optimize compute
- Optimize Delta Lake table layouts and clustering
- Own data infrastructure health scalability and modernization
- Perform Delta Live Tables expectations for data quality
- Support data quality testing and troubleshooting
Perks/Benefits
- 401k match
- Adoption Assistance
- FSA
- Fertility assistance
- Group health insurance
- HSA
- Life and accident insurance
- Long-term disability
- Paid Holidays
- Paid parental leave
- Paid time off
- Short-term disability
Skills/Tech-stack
Alerting | Apache Spark | Automated testing | CI/CD | CloudFormation | Clustering | Compute Optimization | Cost attribution | Data Governance | Data Lakes | Data Management | Data Quality | Data Validation | Data virtualization | Databricks | Delta Lake | Delta Live Tables | Delta Live) | Docker | ELT | ETL | Feature Store | FinOps | Kubernetes | Lakehouse Architecture | MLflow | Master Data | Master Data Management | Monitoring | Python | SQL | Structured Streaming | Terraform | Unity Catalog | Vector Search | Z-ordering
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Regions
Countries
States
Cities
Related jobs
-
Senior-level Full TimeCosta Mesa, California, United States9h ago
-
Robotics Software Engineer, Sensor Integration USD 191K-253KAgent systems | C++ | Computer Vision | Distributed Systems | Embedded SystemsEmployee assistance programs | Health benefits | Recovery Benefits | Travel opportunitiesMid-level Full TimeCosta Mesa, California, United States9h ago
-
Software Engineer - Business Analytics USD 100K-125KAPI Integration | Cloud Computing | Data Modeling | Data Visualization | Database401k matching | Equity package | Global Entry | Health and wellness stipend | Health, dental, vision insuranceEntry-level Full TimeSan Diego10h ago
-
Senior Software Engineer - Backend & Machine Learning USD 180K-250KAWS | Amazon Web Services | Argo | Blue-Green Deployment | Blue/greenSenior-level Full TimeNew York, New York, United States11h ago
-
Senior-level Full TimeUS-WA-Bellevue12h ago
-
Senior-level Full TimeMansfield, MA (Remote) R12h ago
-
Staff Software Engineer, Applied AI USD 200K-240KDataset curation | Evaluation | FastAPI | LLM | Langchain401k | Co-working space reimbursement | Equity incentive | Flexible vacation policy | HSA contributionSenior-level Full TimeU.S. (Remote) R12h ago
-
Software Engineer - Training/Inference (C++) USD 180K-440KAuto Scaling | C++ | CI/CD | CUDA | Code generation401k plan | Dental insurance | Disability insurance | Discounts | Health insuranceSenior-level Full TimePalo Alto, CA13h ago
-
Mid-level Full TimeMountain View, California, United States13h ago
-
AWS | Airflow | Apache Flink | Apache Spark | CrawlingCareer growth | Competitive pay | Remote workMid-level Full TimeColumbia - Maryland14h ago
-
Airflow | Amazon Neptune | Apache Cassandra | Apache Flink | Apache SparkRemote work | US time zones supportMid-level Full TimeColumbia - Maryland14h ago
-
Senior ML Ops Engineer USD 210K-300KAWS | Airflow | Amazon SageMaker | Aurora | Bedrock401k matching | Catered meals | Dental and vision coverage | Desk setup stipend | Paid health coverageSenior-level Full TimeNYC Office14h ago
-
AI Integration Engineer USD 125K-188KAWS | AWS Lambda | Algorithms | Amazon S3 | Artificial Intelligence401k matching | Commuter benefits | Dental insurance | Free snacks | Health insuranceMid-level Full TimeWashington D.C.15h ago
-
Staff Software Engineer, Data Platform (FedRamp) USD 194K-267KApache Beam | Apache Flink | Apache Hadoop | Apache Spark | Data Observability401k | Dental insurance | Flexible spending account | Health insurance | Paid leaveSenior-level Full TimeSan Francisco, California15h ago
-
Data Engineer USD 125K-188KAWS | Apache Spark | Data Governance | Data Modeling | Data Validation401k company match | Commuter transportation benefit | Dental insurance | Free snacks | Medical insuranceEntry-level Full TimeWashington D.C.15h ago
-
Devops Team Lead USD 160K-190KAlerting | Cloud platform | Dashboards | Google Cloud | Google Cloud Platform401k retirement plan | Birthday off | Cell phone reimbursement | Child care reimbursement | Company-Paid HolidaysSenior-level Full TimeBoston, MA16h ago
-
Entry-level Full TimeHurlburt Field, FL16h ago
-
API | AWS Glue | Amazon Redshift | Amazon Web Services | Apache AirflowFully remote | On call production supportMid-level Full TimeOrlando, FL, United States R16h ago
-
Senior Algorithm & Signal Processing Researcher USD 139K-170KAdaptive Signal Processing | C plus plus | C# | Communications Systems | Electronic WarfareSenior-level Full TimeDayton, OH17h ago
-
Senior Algorithm & Signal Processing Researcher USD 139K-170KAdaptive Radar Signal Processing | Adaptive radar | C++ | Communications Systems | Electronic WarfareTop Secret Security ClearanceSenior-level Full TimeAtlanta, GA17h ago
-
Senior Algorithm & Signal Processing Researcher USD 139K-170KAdaptive Signal Processing | C++ | Communications Systems | Electronic Warfare | Embedded SystemsFlexible location | Relocation assistance | Top-Secret Clearance supportSenior-level Full TimeWoburn, MA17h ago
-
Senior Algorithm & Signal Processing Researcher USD 139K-170KAdaptive Signal Processing | C plus plus | C# | Communications Systems | Electronic WarfareHealth insurance | Paid time off | Relocation assistance | Top Secret Clearance FundingSenior-level Full TimeArlington, VA17h ago
-
Principal AI Engineer, Special Programs USD 220K-350KAPI Development | API Orchestration | AWS | Agentic Systems | Azure401k retirement plan | Disability insurance | Employee stock purchase plan | Life insurance | Medical, dental & vision coverageSenior-level Full TimeWashington, DC17h ago
-
Principal AI Engineer, Special Programs USD 220K-350KAI Governance | AI Safety | API Development | API Orchestration | AWS401k | Dental insurance | Employee stock purchase plan | Life insurance | Long-term disability insuranceSenior-level Full TimePalo Alto, CA17h ago
-
Cleared Hybrid Data Engineer (5418) USD 103K-171KAPI Integration | AWS | AWS Glue | AWS Redshift | Access ControlHealth insurance | Learning and development opportunities | Paid leave | RetirementSenior-level Full TimeHanover, MD R17h ago