Senior Data Engineer
Tasks
- Build and optimize ETL and ELT workflows
- Design scalable batch and streaming data pipelines
- Develop medallion architecture patterns
- Ensure compliance with healthcare regulations
- Implement DataOps processes
- Implement auditability lineage and metadata management
- Implement automated testing and CI/CD
- Integrate structured and unstructured data sources
- Lead technical design reviews
- Manage PHI and PII data securely
- Mentor junior engineers
- Monitor pipeline health and performance
- Optimize data storage and processing performance
- Set up monitoring, alerting, and incident response
- Troubleshoot production data issues
Perks/Benefits
Skills/Tech-stack
AWS | Apache Spark | Auditability | Azure | CI/CD | Collibra | Data Lineage | Data Quality | Data orchestration | DataOps | Databricks | Delta Lake | Delta Lake Governance | Delta Lakehouse | ELT | ETL | Git | Informatica | Ingestion | Lakehouse | Learning operations | MLOps | Machine Learning | Machine Learning Operations | Medallion Architecture | Metadata Management | Monitoring | Observability | PySpark | Python | SQL | Unity Catalog | Workflow Management
Education
Roles
Regions
Countries
States
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R4d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R17d ago
-
Data Engineer USD 40K-52KData Quality | Data quality monitoring | OCaml | Python | Quality monitoringGroup discussions | Mentorship | Project ownershipEntry-level Full TimeNew York, New York, United States5h ago
-
Batch Processing | Bias Mitigation | C++ | Data Processing | Experimentation401k employer match | Caregiving support | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - United States R6h ago
-
AWS | Apache Iceberg | Application refactoring | Architectural Reviews | Cloud ComputingFlexible work culture | Mentorship | Work-life balanceSenior-level Full TimeNew York, New York, USA6h ago
-
Principal Engineer - Data Platform USD 221K-387KAccess Control | Apache Spark | Audit Logging | CDC | CompactionSenior-level Full TimeSanta Clara, California, United States R6h ago
-
Machine Learning Engineer, Relevance and Personalization USD 166K-195KA/B | A/B Testing | Apache Airflow | Apache Kafka | Apache SparkMid-level Full TimeUnited States7h ago
-
Forward Deployed AI Engineer USD 90K-110KAPI Integration | AWS | Access Management | Agentic AI | Automated testingEntry-level Full TimeChicago, IL, United States9h ago
-
Senior Data Engineer USD 120K-126K3NF | API Design | API Management | Apache Airflow | Auditing401k match | Charitable Gift Matching | Community giving day | Dental insurance | Discounted personal insuranceSenior-level Full TimeWestern States or Midwest10h ago
-
Senior-level Full TimeDeerfield, IL, United States R10h ago
-
Full Stack Computer Scientist (Senior-Level) USD 82K-138K.Net Core | Agile | C# | CI/CD | Configuration ManagementCertification reimbursement | Dental insurance | Life insurance | Long-term disability insurance | Medical insuranceSenior-level Full TimeSierra Vista, AZ, United States11h ago
-
Data Engineer USD 115K-135KAPIs | Anomaly Detection | CI/CD | Cause analysis | Change Data Capture401k matching | Dental insurance | Health insurance | Paid Maternity Leave | Paid time offSenior-level Full TimeChicago, Illinois, United States11h ago
-
Artificial Intelligence Machine Learning USD 99K-200KC# | Data Engineering | Data Governance | Data Modeling | Data PipelinesDental insurance | Employee referral bonus | Health insurance | Identity theft protection | Legal protectionMid-level Full TimeAnnapolis Junction, Maryland12h ago
-
Embedded Software Engineer– Technical Lead USD 150K-175KARM | Agile | Build systems | C++ | CI/CD401k match | Health insurance | Paid time off | Relocation not availableSenior-level Full TimeWaltham, MA, United States12h ago
-
Senior Data Engineer - Databricks USD 180K-247KAWS | Access Control | Apache Spark | Azure | CI/CD401k match | Career development program | Corporate Benefit Program | Educational resources | Employee Referral Bonus ProgramSenior-level Full TimeDenver, CO R12h ago
-
AWS | AWS Config | Checkov | CloudTrail | CloudWatchDomestic travel up to 100 percent | On-call support | Remote workMid-level Full TimeRemote - USA R12h ago
-
Senior-level Full TimeOrlando, FL, United States13h ago
-
AWS | Agile | Apache Spark | Azure | Big DataMid-level Full TimeUnited States13h ago
-
Data Engineer I USD 87K-137KAPIs | Clay | Data Governance | Data Modeling | Data Quality401k match | Conference attendance support | Employee resource groups | Flexible PTO | Flexible work scheduleMid-level Full TimeMorrisville, United States13h ago
-
Generative AI Engineer USD 138K-213KAWS | Azure | Caching | Cloud platform | Databricks401k matching | Generous paid time off | Health, dental, vision benefits | Work from home equipment providedSenior-level Full TimeNew York, NY, United States15h ago
-
Data Visualization & Integration Specialist USD 115K-150KAPI Integration | Bill of Materials | Data Governance | ETL | ExcelHybrid work scheduleMid-level Full TimeMarietta, GA, United States15h ago
-
Azure Data | Azure Data Factory | Azure DevOps | Azure Synapse | Azure Synapse Analytics401k plan | Company holidays | Floating holidays | Paid time off | Remote workSenior-level Full TimeUnited States R15h ago
-
Software Engineer, Scientific Computing USD 90K-160KCUDA | Debugging | Deployment | Numerical Methods | Performance optimizationEntry-level Full TimeRedwood City16h ago
-
Entry-level Full TimeRedwood City16h ago
-
API Design | Apache Airflow | Automated testing | CI/CD | DBTComprehensive health care and benefits | Growth opportunities | Inclusion and diversity | Public service missionSenior-level Full TimePhiladelphia, PA, United States16h ago