Senior Data Engineer — Translational Data Products
Tasks
- Build data products end to end
- Catalog describe permission and validate new data sources
- Collaborate with ML engineers on feature ready model ready datasets
- Continuously improve data products with stakeholder feedback
- Create governed documented datasets in Unity Catalog
- Create infrastructure as code and automated checks for robustness
- Design build test and maintain ETL and data normalization pipelines
- Implement test driven validation and automated reconciliation checks
- Monitor alert and manage incident response for data services
- Support CI CD pipelines for build test and deploy
- Translate scientific and business questions into data models and mappings
- Unlock data access with governance and quality checks
Perks/Benefits
- N/A
Skills/Tech-stack
AWS CDK | AWS CLI | AWS ECS | AWS Fargate | AWS Glue | AWS IAM | AWS Lambda | AWS S3 | Access Management | CI/CD | CloudFormation | Container Scanning | Data Quality | Data Validation | Databricks | Databricks SQL | Delta Lake | Dependabot | Dependency Scanning | Docker | ELT | ETL | Git | GitHub | GitHub Actions | IAM (Identity and Access Management) | Identity and Access Management | Infrastructure Scanning | Infrastructure as Code | Linux | OIDC | Python | Regression testing | SQL | SSO | Shell | Unit Testing | Unity Catalog | Wiz | “as-code”
Education
Roles
Related jobs
-
AI/Machine Learning Engineer USD 99K-225KAPI Integration | AWS | Agentic Workflows | Azure | CrewAI401k Company Contributions | Career development | Company funded HRA | Employer-paid life insurance | Long-term disabilityMid-level Full TimeFt. Meade, MD; Laurel, MD R17h ago
-
Apache Spark | Azure Synapse | DAX | Data Lake | Data ModelingBirthday day off | Life insurance | Prepaid medicine | Work from homeMid-level Full TimeColombia, United States R20h ago
-
Load Forecasting Data Scientist USD 86K-120KBig Data | Data Wrangling | Data munging | Data pipeline | Geospatial AnalyticsEmployee assistance program | Flexible work hours | Hybrid work environment | Paid time off | Professional developmentMid-level Full TimeWindsor, CT, 06095, USA R1d ago
-
AWS | Azure | CI/CD | Containers | DNS401k match | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeSan Diego, CALIFORNIA, United States R1d ago
-
AI Engineer USD 180K-225KAWS | Agentic Workflows | Airflow | BigQuery | CI/CD401k match | Dental and vision coverage | Employee Assistance Program (EAP) | Employee discounts | HSA contributionsSenior-level Full TimeRemote, US R1d ago
-
Software Engineer, Data Plane Hybrid USD 147K-237KAgile | C# | C++ | Cloud Native | Cloud Native Network Function CNFSenior-level Full TimeWESTFORD, United States R1d ago
-
AI Engineer USD 140K-182KCaching | Embeddings | Error Recovery | Evaluation | Fallback LogicCollaborate with small fast moving team | Competitive equity | Direct ownership | Full-time employment | Hybrid workMid-level Full TimeNew York, New York, United States R1d ago
-
Senior Data Engineer II USD 145K-207KAirflow | Alerting | BigQuery | CI/CD | CloudMeaningful greenfield work | Onsite visits up to four times per year | Remote work within United States | Work-life balanceSenior-level Full TimeUnited States - Remote R1d ago
-
Principal Solutions Engineer, Data & AI USD 175K-200KAPIs | CRM | Databricks | Delta Sharing | HIPAA401k | Company on site visits | Dental insurance | Fully remote | Health and wellness stipendSenior-level Full TimeUnited States - Remote R1d ago
-
Data Platform Engineer USD 170K-210KAWS | AWS Neptune | Amazon Kinesis | Apache Airflow | Apache FlinkDental insurance | Family leave | Flexible paid time off | Free food and snacks | Health care planSenior-level Full TimeOrlando, Florida, United States - Remote R1d ago
-
Senior Agentic (AI) Engineer USD 160K-200KA/B | A/B Testing | AWS | Agent SDK | ArgoCDDental insurance | Family leave | Flexible paid time off | Free food and snacks | Health insuranceSenior-level Full TimeOrlando, Florida, United States - Remote R1d ago
-
AWS Glue | AWS Lambda | AWS S3 | Amazon RDS | Amazon RedshiftSenior-level Full TimeUnited States - Remote R1d ago
-
Databricks Lakehouse Engineer and Analyst, Mid USD 77K-176KAccess Control | Artificial Intelligence | Databricks | Delta Lake | HadoopDependent care | Health insurance | Paid leave | Professional development | Retirement benefitsMid-level Full TimeUSA, VA, McLean (8251 Greensboro Dr), … R1d ago
-
Data Visualization Engineer USD 62K-141KArtificial Intelligence | Dashboard Development | Data Quality | Data Transformation | Data VisualizationDependent care | Disability insurance | Health insurance | Life insurance | Paid leaveMid-level Full TimeUSA, CA, Monterey (20 Ryan Ranch … R1d ago
-
Robotics Autonomy Engineer USD 77K-176KAgent systems | Architecture development | C plus plus | CI/CD | CameraMid-level Full TimeUSA, CA, San Diego (1615 Murray … R1d ago
-
AI/ML Software Developer USD 69K-158KAWS | Azure | C++ | Computer Vision | Deep learningDependent care | Health benefits | Paid leave | Professional development | Retirement benefitsMid-level Full TimeUSA, MD, Fort Meade (9800 Savage … R1d ago
-
Senior Storage Infrastructure Engineer USD 85K-135KBackup and Recovery | Business Continuity | Capacity Planning | Cause analysis | Commvault401k match | Disability insurance | Employee assistance program | Employee discounts | Flexible spending accountsSenior-level Full TimeNellie, United States R1d ago
-
Senior Data Engineer, AI/ML Platforms USD 130K-220KAWS | Agile | Apache Spark | Data Cleansing | Data GovernanceSenior-level Full TimeRemote US, United States R1d ago
-
Senior-level Full TimeUSA, Massachusetts, Boston, 200 Berkeley Street, … R1d ago
-
Senior Machine Learning Engineer I USD 150K-241KAWS | Azure | Batch Processing | Data Pipelines | Data labelingDental insurance | Emotional wellness support | Employee resource groups | Fitness programs | Learning and development programsSenior-level Full TimeSeattle, Washington, United States R1d ago
-
Principal Machine Learning Engineer USD 240K-420KAgent systems | Architecture | C plus plus | Compliance | Deep learning401k plan | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeSanta Clara, California, United States R1d ago
-
Agent architecture | Benchmarking | Biomedicine | Context engineering | Data integrationFlexible working hours | Generous vacation | Hybrid work policy | Optional equity donation matching | Parental leaveMid-level Full TimeSan Francisco, CA | New York … R1d ago
-
Site Reliability Engineer - Ceph Storage USD 128K-192KAnsible | Block devices | CRUSH | Cause analysis | CephEmployee stock purchase plan | Generous time off | Healthcare benefits | Parental leave | Remote work optionsSenior-level Full TimeUnited States R1d ago
-
ARINC 429 | ARINC 653 | C plus plus | C# | CAN401k match | Dental insurance | Disability insurance | Educational assistance | Employee assistance programMid-level Full TimePhoenix, AZ, United States R1d ago
-
Senior Data Engineer USD 140K-170KAPIs | Azure DevOps | DBT | Data Architecture | Data GovernanceDiscretionary bonus | Hybrid work schedule | Training and developmentSenior-level Full TimeNew York, New York, United States R1d ago