Data Engineering Lead
United States - Remote
R
USD 148K-164K (estimate) Senior-level Full Time
Tasks
- Architect data pipelines
- Build ETL pipelines
- Conduct code reviews
- Define Medallion Architecture layers
- Design PostgreSQL schemas and queries
- Implement CI/CD workflows
- Implement data validation framework
- Integrate ML model orchestration into ETL
- Lead agile sprint cycles
- Optimize Apache Spark performance
- Set up monitoring and alerting
- Tune Databricks clusters
Perks/Benefits
Skills/Tech-stack
Apache Airflow | Apache Spark | Azure Databricks | Azure DevOps | Azure Kubernetes | Azure Kubernetes Service | CI/CD | Delta Lake | Docker | Git | Great Expectations | Kubernetes Service | PGVector | PostgreSQL | PySpark | Python
Education
N/A
Roles
Data Engineering | Data Engineering Lead | Engineering Lead | Lead
Related jobs
-
BigQuery | CI/CD | Containerization | Data Modeling | DatabricksSenior-level ContractNew York, NY (Hybrid) R18h ago
-
Data Engineering Manager USD 160K-242KApache Airflow | Cloud Run | Cloud platform | Dagster | Data ModelingAutonomy | Educational budget | Equity | Flexible work schedule | Remote work budgetMid-level Full TimeRemote: United States | Canada | … R22h ago
-
Data Engineering Manager USD 150K-185KAirflow | Apache Flink | Apache Kafka | Automated testing | CI/CD401k match | Company HSA contributions | Company observed holidays | Flexible PTO | Life insuranceMid-level Full TimeRemote (United States) R1d ago
-
Network Optimization Lead USD 115K-158KBusiness Analytics | C++ | Claims | Common table expressions | Data Architecture401k retirement savings plan | Home office internet expense stipend | Life insurance | Long-term disability | Medical, dental, vision benefitsSenior-level Full TimeRemote US, United States R1d ago
-
Azure | C# | C++ | Cloud Computing | Code reviewInclusive diverse workplace culture | Learning opportunities | Remote-first work environmentSenior-level Full TimeMassachusetts R2d ago
-
Azure | C plus plus | C# | Cloud Computing | Data PipelinesInclusive and diverse workplace culture | Learning and growth opportunities | Remote-first work environmentSenior-level Full TimeColumbia R2d ago
-
Asynchronous Communication | Azure | C# | C++ | Code reviewInclusive and diverse workplace culture | Learning and growth opportunities | Remote-first work environmentSenior-level Full TimeColorado R2d ago
-
Azure | C# | C++ | Data Pipelines | GoInclusive and diverse workplace culture | Learning and growth opportunities | Remote-first work environmentSenior-level Full TimeIllinois R2d ago
-
Azure | C# | C++ | Cloud | Data PipelinesInclusive and diverse workplace culture | Learning and growth opportunities | Remote-first work environmentSenior-level Full TimeFlorida R2d ago
-
Asynchronous Communication | Azure | C# | C++ | Cloud ComputingInclusive and diverse workplace culture | Learning and growth opportunities | Remote-first work environmentSenior-level Full TimeCalifornia R2d ago
-
Automation | DBT | Data Modeling | Data Pipelines | Data Warehousing401k matching | Dental insurance | Education assistance | Health and wellbeing resources | Health insuranceSenior-level Full TimeMinnesota R3d ago
-
Automation | DBT | Data Modeling | Data Pipelines | Data Warehousing401k matching | Education assistance | Health benefits | Paid time off | Professional developmentSenior-level Full TimeMassachusetts R3d ago
-
DBT | Data Modeling | Data Warehousing | Data pipeline | Data pipeline automation401k match | Dental insurance | Education assistance | Health insurance | Paid HolidaysSenior-level Full TimeIdaho R3d ago
-
Automation | DBT | Data Modeling | Data Warehousing | Data pipeline401k match | Education assistance | Health insurance | Paid time off | Professional developmentSenior-level Full TimeIllinois R3d ago
-
Automation | DBT | Data Modeling | Data Pipelines | Data Reliability401k match | Dental insurance | Education assistance | Health insurance | Paid time offSenior-level Full TimeColumbia R3d ago
-
Automation | DBT | Data Modeling | Data Pipelines | Data Warehousing401k match | Education assistance | Health benefits | Paid time off | Professional developmentSenior-level Full TimeColorado R3d ago
-
Automation | DBT | Data Modeling | Data Pipelines | Data Warehousing401k match | Dental insurance | Education assistance | Flexible schedule | Health insuranceSenior-level Full TimeCalifornia R3d ago
-
Automation | DBT | Data Modeling | Data Pipelines | Data Warehousing401k match | Dental insurance | Education assistance | Health insurance | Paid HolidaysSenior-level Full TimeFlorida R3d ago
-
Automation | DBT | Data Modeling | Data Pipelines | Data Warehousing401k match | Dental insurance | Education assistance | Health insurance | Paid time offSenior-level Full TimeConnecticut R3d ago
-
Automation | DBT | Data Modeling | Data Pipelines | Data Warehousing401k match | Dental insurance | Education assistance | Health insurance | Paid time offSenior-level Full TimeArizona R3d ago
-
Sr Mgr Data Engineering USD 104K-252K3NF | AWS | Airflow | Azure | BigQueryEducation assistance | Health and wellbeing resources | Life insurance | Medical/Dental/Vision insurance | Paid time offSenior-level Full TimeRemote, United States R4d ago
-
AI Governance | AWS | Amazon EC2 | Amazon S3 | Amazon SageMaker401k matching | Bonus eligibility | Commuting subsidy | Educational assistance | Equity awards (eligibility)Senior-level Full Time5000 - Vertex US - Fan … R4d ago
-
A/B | A/B Testing | Anomaly Detection | Assortment optimization | Azure MLBackground check | Remote workSenior-level Full TimeRemote - US, United States R4d ago
-
Corporate Vice President - Data & Analytics Lead USD 175K-250KAWS | AWS Lambda | Amazon Redshift | Amazon S3 | Data GovernanceAdoption Assistance | Annual discretionary bonus | Leave programs | Remote work | Student loan repayment programsSenior-level Full TimeRemote, any state, US R4d ago
-
Data platform Manager - IT USD 131K-185KAccess Control | Azure | Azure Data | Azure Data Lake | Azure DevOpsMedical, dental, and vision coverage | Paid time off | Retirement savings plansSenior-level Full TimeHouston, TX, United States R4d ago