Senior Data Engineer (Health Research Team)
Chicago, Illinois, United States
R
USD 104K-199K Senior-level Full Time
Tasks
- Address pipeline issues
- Apply data governance and retention policies
- Build ad hoc data workflows
- Build data validation frameworks
- Collaborate on process enhancements
- Communicate progress status and issues
- Deploy workflows to production
- Design data ETL pipelines
- Enhance data ETL pipelines
- Establish data quality metrics
- Implement corrective actions
- Ingest transform healthcare data for Databricks
- Investigate data pipeline failures
- Lead data pipeline reviews
- Maintain data ETL pipelines
- Monitor pipeline health dashboards
- Monitor pipeline performance
- Provide technical support via help desk
- Validate data pipeline integrity
- Write Databricks notebook scripts
Perks/Benefits
- 401k plan
- Employee Assistance Program (EAP)
- Family building benefits
- Flexible Spending Accounts FSA
- Flexible work arrangements
- Holidays
- Medical/Dental/Vision
- Paid parental leave
- Paid time off
- Remote work option
Skills/Tech-stack
AWS EC2 | AWS S3 | Apache Spark | Azure | Data Governance | Data Quality | Data Retention | Data Validation | Databricks | Excel | GitHub | Power Query | PySpark | Python | REST API | SAS | SQL | VBA
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Roles
Related jobs
-
Senior-level Full TimeRemote - United States R12h ago
-
Senior Full Stack Software Development Engineer - AI USD 135K-188KAWS | Agile | Amazon SQS | Automated testing | CI/CD401k matching | Flexible time off | Fully remote | Medical, dental, and vision coverage | Paid HolidaysSenior-level Full TimeUnited States, UNITED STATES, United States R14h ago
-
Senior Snowflake / data platform engineer USD 120K-155KAWS | Agile | Alerting | Automation | Backend ServicesFlexible remote days | Health insurance | Hybrid work model | Life insurance | Onsite days fixed scheduleSenior-level Full TimeTampa, FL, United States R15h ago
-
Sr. Data Engineer USD 120K-160KAPI | AWS | AWS Glue | Airflow | Amazon RedshiftComprehensive benefits package | In-person collaboration opportunities | Mentorship and growth opportunities | On-call rotation | Remote-firstSenior-level Full TimeOrlando, FL, United States R15h ago
-
Senior Software Engineer - Data Infrastructure, Safety USD 196K-243KA/B | A/B Testing | AI | Automation | B testingSenior-level Full TimeSan Mateo, CA, United States R16h ago
-
Senior Machine Learning Platform Engineer USD 160K-210KAutomated retraining | C plus plus | CI/CD | Docker | Elasticsearch401k match | Annual bonus | Company equipment provided | Company in person events | Company medical dental vision plansSenior-level Full TimeAtlanta, GA preferred, Remote R18h ago
-
Data Engineer USD 133K-159KBigQuery | Cloud platform | DBT | Data Governance | Data Modeling401k matching | Employee assistance program | Employee stock purchase program | Flexible vacation | Hybrid work modelMid-level Full TimeSan Francisco, CA R18h ago
-
Machine Learning Engineer USD 180K-250KAWS | Azure | CUDA | DDP | Distributed Training401k employer match | Health, dental, vision insurance | Paid time off | Professional development | Work-life balanceMid-level Full TimeEmeryville, California, United States; Hybrid (2-3 … R20h ago
-
Apache Airflow | Data Architecture | Data Engineering | Data Governance | Data ModelingCollaborative work environment | Continuous learning and development | Flexible work hours | Health and wellness programs | Work from homeSenior-level Full TimeMassachusetts R20h ago
-
AI Tooling | Apache Airflow | Data Architecture | Data Governance | Data ModelingCollaborative work environment | Continuous learning | Flexible work hours | Health and wellness programs | Work from homeSenior-level Full TimeMinnesota R20h ago
-
Apache Airflow | Data Architecture | Data Compliance | Data Governance | Data ModelingCollaborative work environment | Continuous learning | Flexible work hours | Health and wellness programs | Work from homeSenior-level Full TimeIllinois R20h ago
-
Airflow | Analytics engineering | Data Architecture | Data Compliance | Data GovernanceAccess to cutting-edge technologies | Collaborative work environment | Continuous learning and development | Flexible work hours | Health and wellness programsSenior-level Full TimeIdaho R20h ago
-
Apache Airflow | Data Architecture | Data Governance | Data Modeling | Data ObservabilityAccess to cutting-edge technologies | Collaborative work environment | Continuous learning | Flexible work hours | Health and wellness programsSenior-level Full TimeColumbia R20h ago
-
Apache Airflow | Data Architecture | Data Compliance | Data Governance | Data ModelingCollaborative work environment | Continuous learning | Flexible work hours | Health and wellness programs | Remote workSenior-level Full TimeColorado R20h ago
-
Apache Airflow | Data Architecture | Data Governance | Data Modeling | Data orchestrationCollaborative work environment | Continuous learning | Flexible work hours | Health and wellness programs | Work from homeSenior-level Full TimeFlorida R20h ago
-
Apache Airflow | Data Architecture | Data Governance | Data Modeling | Data orchestrationCollaborative work environment | Continuous learning and development | Flexible work hours | Health and wellness programs | Remote workSenior-level Full TimeCalifornia R20h ago
-
Apache Airflow | Data Architecture | Data Governance | Data Modeling | Dimensional dataCollaborative work environment | Continuous learning | Flexible work hours | Health and wellness programs | Remote workSenior-level Full TimeArizona R20h ago
-
Apache Airflow | Data Architecture | Data Engineering | Data Governance | Data ModelingAccess to cutting edge technologies and data tools | Collaborative work environment | Continuous learning and development | Flexible work hours | Health and wellness programsSenior-level Full TimeConnecticut R20h ago
-
Machine Learning Engineer - Computer Vision USD 220K-250KAmazon Bedrock | Cloud ML | Cloud ML services | Computer Vision | Convolutional Neural NetworksCareer growth mindset | Equity | Meaningful impact on product and users | Remote-first work environmentMid-level Full TimeRemote (U.S.) R21h ago
-
Software Engineer - Platform USD 190K-230KAPI Design | Amazon Web Services | CI/CD | Distributed Systems | GraphQLBenefits | Equity | Remote work flexibilityMid-level Full TimeRemote with offices in San Francisco, … R21h ago
-
Senior-level Full TimeUSA - Remote R1d ago
-
Automation | Data Engineering | Data Integrity | Data Reconciliation | Data pipelineDental coverage | Medical coverage | Professional development | Remote work | Stock optionsSenior-level Full TimeIdaho R1d ago
-
Automation | Data Engineering | Data pipeline | Databricks | ETLDental insurance | Medical insurance | Professional development | Stock options | Unlimited PTOSenior-level Full TimeColorado R1d ago
-
Amazon Kinesis | Amazon Kinesis Data Analytics | Apache Beam | Apache Cassandra | Apache Flink401k match | Comprehensive benefits | Flexible vacation | Paid time offSenior-level Full TimeSanta Monica, CA R1d ago
-
Software Engineer, ML Infrastructure USD 155K-190KCloud Computing | Data Annotation | Data Engineering | Data Mining | EmbeddingsMid-level Full TimeUSA (remote) R1d ago