Lead Data Engineer – Modernization & Reliability
USD 142K-195K Senior-level Full Time
Tasks
- Collaborate with BI team to improve data access
- Create technical documentation for stakeholders
- Develop and maintain ETL and data movement pipelines
- Direct contract resources and review deliverables
- Enhance pipeline security posture
- Establish data pipeline governance
- Improve pipeline observability and fault tolerance
- Lead data platform modernization
- Manage Databricks pipeline patterns
- Modernize SSIS based ETL workflows
- Optimize data warehouse and ODS reliability
Perks/Benefits
Skills/Tech-stack
Agile | Azure | Azure Data | Azure Data Factory | Corepoint | Data Factory | Data Governance | Data Warehouse | Data integration | Data pipeline | Databricks | ELT | ETL | Fault Tolerance | Healthcare Data | Healthcare data integration | ODS | Observability | Performance Tuning | Rhapsody | SAFe | SQL | SQL Server | SSIS | SSRS | Security | Technical documentation
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Lead - POC Data Science USD 160K-270KA/B | A/B Testing | Anomaly Detection | Apache Kafka | Apache Spark401k matching | Dental insurance | Flexible paid time off | Health and wellness stipend | Health insuranceSenior-level Full TimeUnited States R8h ago
-
Senior AI Engineer USD 216K-277KAWS | Agent systems | Autonomous Agents | Azure | By DesignCareer development | Home workspace stipend | MacBook provided | Medical, dental, and vision insurance | Mental health benefitsSenior-level Full TimeAustin, TX R8h ago
-
AWS | Anomaly Detection | Databricks | Docker | Explainability401k | Dental insurance | Equity compensation | Healthcare | Paid time offSenior-level Full TimeSan Francisco (Remote) R14h ago
-
Senior Software Engineer USD 107K-150KAWS | Agile | Datadog | GitHub | GitHub ActionsOn-call rotation | Remote workSenior-level Full TimeCosta Mesa, CA, United States R14h ago
-
Senior AI Product Engineer, Frameworks USD 166K-225KAgentic Workflows | Anthropic API | Chunked HTTP | Context Management | Data Processing401k plan | Healthcare concierge services | Hybrid work model | In office Tuesday through Thursday | Life and disability insuranceSenior-level Full TimeHybrid - San Francisco R14h ago
-
Data Engineer USD 126K-208KAPI Integration | Airflow | Amazon Web Services | BigQuery | CCPADEI initiatives | Dental benefits | Employee rewards program | Medical benefits | Mental health supportMid-level Full TimeRemote, United States R15h ago
-
Alerting | Ansible | Bash | CI/CD | CephRemote workSenior-level Full TimeUnited States, United States R16h ago
-
Machine Learning Engineer USD 131K-178KAWS | Cassandra | Convolutional Neural Networks | Data Lakes | Data PipelinesMid-level Full TimeRemote, NY, US R18h ago
-
Case design | Data Integrity | Database Testing | Database optimization | Defect ReportingSenior-level Full TimeAustin, TX R19h ago
-
Principal Software Engineer - Data Infrastructure USD 266K-425KAPIs | Architecture | Batch Processing | Data Infrastructure | Data ModelingSenior-level Full TimeRemote - USA R21h ago
-
AI Engineer USD 195K-285KAsync Programming | Concurrency | Distributed Systems | Fault Tolerance | Kubernetes401k employer match | Flexible vacation policy | Flexible work environment | Health, dental, vision, life insurance | Learning budgetSenior-level Full TimeOakland, CA (or remote within US … R1d ago
-
Senior AI Data Engineer USD 155K-185KApache Airflow | Apache Spark | Azure Synapse | BigQuery | ClickHouseEmployer paid Medical Dental Vision Insurance | Flexible paid time off | Manager check ins | Paid cell phone and service | Paid parental leaveSenior-level Full TimeRemote - United States R1d ago
-
Senior Staff Software Engineer - Data Platform USD 200K-250KAWS Glue | AWS IAM | Amazon EMR | Amazon S3 | AmundsenDevelopment dollars | Employee stock purchase program | Family-forming benefits | Financial coaching | Flexible time offSenior-level Full TimeRemote, USA R1d ago
-
Senior Staff Software Engineer - Data Platform USD 200K-250KAWS EMR | AWS Glue | AWS IAM | AWS S3 | Apache AirflowDevelopment dollars | Financial coaching | Flexible remote work | Flexible time off | Free therapy sessionsSenior-level Full TimeRemote, USA R1d ago
-
APIs | Compliance | Distributed Systems | Enterprise Integration | Generative AIOccasional evening calls | Remote workSenior-level Full TimeRemote - US Based R1d ago
-
AV Safety Engineering Analytics Engineer (GPSSC) USD 160K-246KCI/CD | Dash | Docker | GitHub | JenkinsRemote workMid-level Full TimeWork From Home - United States, … R1d ago
-
Vice President, Internal Audit - Data Analytics USD 162K-215KAWS | Audit Testing | Azure | Azure DevOps | Business IntelligenceFlexible time off | Healthcare | Hybrid work model | Retirement benefits | Tuition reimbursementEntry-level Full TimeNY7 - 50 Hudson Yards, New … R1d ago
-
Agile | C++ | Deep learning | Distributed Computing | GPU ComputingDiscretionary bonus | Flexible time off | Healthcare | Leave benefits | Retirement benefitsExecutive-level Full TimeNY7 - 50 Hudson Yards, New … R1d ago
-
Lead Data Engineer USD 224KApache Airflow | Apache Beam | BigQuery | CI/CD | CMEK401k plan | Adoption reimbursement | Commuter benefits | Critical caregiving leave | Critical illness insuranceSenior-level Full Time112265-NJ-MetroPark, Iselin, United States R1d ago
-
Senior Software Engineer, AI USD 171K-210KAirflow | Amazon Web Services | Apache Hive | Apache Impala | C#Career development access | Employee resource groups | Flexible WFH | Generous PTO | Internet reimbursementSenior-level Full TimeUS-California-Remote, United States R1d ago
-
Senior Software Engineer USD 144K-192KAWS | Angular | Apache Spark | Azure | BuildahCareer development | Employee resource groups | Flexible WFH | Generous PTO | Paid volunteer timeSenior-level Full TimeUS-California-Remote, United States R1d ago
-
AI Research Engineer (Applied AI) USD 100K-150KAblation Studies | Accelerator hardware | Computer Vision | Data Quality | Data labelingCareer growth | Full-time employment | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Senior Data Engineer (Snowflake) USD 78K-133KAPI Development | AWS | AWS Glue | Amazon Redshift | Apache AirflowSenior-level Full TimeRemote CA - R2, United States R1d ago
-
AI Data Infrastructure Engineer USD 100K-150KActive Learning | Apache Beam | CI/CD | Code review | Data GovernanceCareer growth | Health benefits | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Senior Machine Learning Engineer USD 156K-211KAPI Development | AWS | Agentic Workflows | CI/CD | Cloud ArchitectureAward-winning time-off plans | Comprehensive health, dental, vision coverage | Flexible work models | Life and disability insurance | Retirement and savings planSenior-level Full TimeUS - California - Thousand Oaks … R1d ago