Senior Data Engineer
Tasks
- Build self service analytics frameworks and patterns
- Communicate technical trade-offs and risks to stakeholders
- Create reusable data assets for analytics
- Design and maintain data lake and data warehouse structures
- Design and optimize ETL/ELT pipelines
- Develop analytics ready curated datasets
- Develop and enforce data modeling standards and schema design
- Ensure HIPAA regulatory privacy and security compliance
- Establish code quality documentation testing and version control best practices
- Evaluate and recommend new data tools and technologies
- Implement batch and near real time processing
- Implement data partitioning strategies
- Integrate data from enterprise systems
- Lead data engineering workstreams in agile teams
- Lead data pipeline automation monitoring and CI CD
- Mentor data engineers and review code and architecture artifacts
- Optimize pipeline performance reliability and cost
- Refactor legacy data pipelines
- Support feature engineering and model training workflows
- Translate requirements into technical solutions
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Airflow | Apache Spark | CI/CD | Data Governance | Data Lake | Data Mart | Data Modeling | Data Quality | Data Security | Data Warehouse | ELT | ETL | FHIR | Google Cloud | HIPAA | HL7 | Microsoft Azure | Python | SQL | Workflow Orchestration
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Automation Testing | CI/CD | CSS | Cypress | Feature DevelopmentMedical, dental & vision coverage | Paid time off | Parental leave | Reimbursement programs | Retirement planMid-levelRaleigh, United States R11d ago
-
Robotics Test & Data Engineer, Mapping USD 70K-300K3D Point Cloud Processing | 3D point cloud | Bash | Cloud processing | Cloud validationMid-level Full TimeIrvine, CA3h ago
-
Senior Developer, Data & IT - AI Solutions USD 120K-142KAI Agents | API Integration | AWS | AWS Bedrock | AWS SageMakerDental insurance | Dependent Care Account | Health insurance | Health savings account | Mental health counseling supportSenior-level Full TimeNew York, NY, United States10h ago
-
Senior Data Engineer USD 120K-142KApache Airflow | C# | Continuous integration | DBT | Data Modeling401b retirement savings program | Dental insurance | Dependent Care Account | Employer match | Flexible spending accountsSenior-level Full TimeNew York, NY, United States10h ago
-
Principal AI Engineer - Nexus Black USD 135K-160KCI/CD | Cloud Native | Cloud Native Architecture | Distributed Systems | EvaluationHybrid workSenior-level Full TimeItasca, United States12h ago
-
Distinguished Software Engineer, Data Infrastructure USD 248K-406KAI Inference | AI Training | Batch Processing | Compliance | Data InfrastructureExecutive-level Full TimeMountain View, CA, United States12h ago
-
Senior-level Full TimeMorristown, NJ, United States13h ago
-
Staff AI/ML Engineer USD 240K-270KAI Agents | AWS | Azure | Cloud infrastructure | Data Curation401k | Commuter benefits | Dog-friendly office | Equity | FSA benefitsSenior-level Full TimeSan Francisco, CA13h ago
-
Staff AI/ML Engineer USD 240K-270KAWS | Agentic Workflows | Azure | Cloud infrastructure | Data Curation401k | Commuter benefits | Dog-friendly office | Equity | FSA benefitsSenior-level Full TimeNew York City, NY13h ago
-
Senior AI/ML Engineer USD 240K-270KAWS | Agentic Workflows | Cloud Computing | Cloud platform | Data Curation401k | Commuter benefits | Dog-friendly office | Equity | Flexible spending accountSenior-level Full TimeNew York City, NY13h ago
-
Senior AI/ML Engineer USD 240K-270KAI Agents | AWS | Azure | Cloud infrastructure | Data Curation401k | Commuter benefits | Dog-friendly office | Equity | FSA benefitsSenior-level Full TimeSan Francisco, CA13h ago
-
Staff Data Engineer - Information Security USD 152K-248KAzure | Big Data | C# | C++ | Data PipelinesHealth and wellness programs | Time away from workSenior-level Full TimeSunnyvale, CA, United States14h ago
-
Manager, Data Engineering USD 130K-166KAWS | Access Controls | Apache Airflow | Audit Logging | AzureCollaborative team culture | Remote work | Work-life balanceSenior-level Full TimeRemote, United States R14h ago
-
AI Search | API Development | AWS | AWS Bedrock | Azure401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States14h ago
-
AWS S3 | Access Control | Active IQ | Ansible | Azure Blob Storage401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States15h ago
-
Senior Data Engineer (Remote, US) USD 140K-211KAirflow | Aiven | Apache Spark | BigQuery | CI/CD401k company contribution | Annual professional development fund | Be Well program | Paid volunteer service hours | Parental leaveSenior-level Full TimeRemote - United States R15h ago
-
Communication optimization | Data parallelism | Deep learning | Distributed Training | GPU AccelerationMid-level Full TimeSeattle, Washington, United States18h ago
-
Robotics/UAS Engineer II/III USD 89K-176KArduPilot | Autopilot | C++ | CAD | Embedded SystemsCareer Development Training Opportunities | Education assistance | Fitness reimbursement | Flexible work schedules | Paid Time Off N/ASenior-level Full TimeUS-Massachusetts-Wilmington18h ago
-
Product Engineering, Full Sack Engineer USD 85K-142K.NET | .Net Core | AWS | Agile | AngularMentorship | Professional development | Travel opportunitiesNone Full TimeNew York, New York, United States18h ago
-
Mid-level Full TimeGreenwich, CT18h ago
-
Software Engineer, Data Security - USDS USD 118K-237KData Security | Distributed Systems | Language Models | Large Language Models | Performance optimizationEntry-level Full TimeSan Jose, California, United States18h ago
-
Content Safety | Data Modeling | Feature Engineering | Graph Databases | Information RetrievalSenior-level Full TimeSan Jose, California, United States18h ago
-
Partner Engineering GenAI - US USD 133K-203KAPIs | Artificial Intelligence | C plus plus | Claude | Cloud ComputingSenior-level Full TimeMenlo Park, CA | Seattle, WA …19h ago
-
Machine Learning Performance Modeling Architect USD 173K-249KC# | C++ | Data Visualization | Heterogeneous computing | Image qualitySenior-level Full TimeSunnyvale, CA19h ago
-
Mid-level Full TimeSunnyvale, CA | Burlingame, CA19h ago