Data Engineering Lead
United States - Remote
R
USD 148K-164K (estimate) Senior-level Full Time
Tasks
- Architect data pipelines
- Build ETL pipelines
- Conduct code reviews
- Define Medallion Architecture layers
- Design PostgreSQL schemas and queries
- Implement CI/CD workflows
- Implement data validation framework
- Integrate ML model orchestration into ETL
- Lead agile sprint cycles
- Optimize Apache Spark performance
- Set up monitoring and alerting
- Tune Databricks clusters
Perks/Benefits
Skills/Tech-stack
Apache Airflow | Apache Spark | Azure Databricks | Azure DevOps | Azure Kubernetes | Azure Kubernetes Service | CI/CD | Delta Lake | Docker | Git | Great Expectations | Kubernetes Service | PGVector | PostgreSQL | PySpark | Python
Education
N/A
Roles
Data Engineering | Data Engineering Lead | Engineering Lead | Lead
Related jobs
-
Lead Data Engineer, Marketing Operations and Engineering USD 139K-257KAWS | Apache Airflow | Apache Spark | Cloud Computing | Cloud platformSenior-level Full TimeSan Jose, United States R20h ago
-
AI | AWS | Agile | Architecture Design | CI/CDHybrid work | Onsite 3 days per week | W2 employmentSenior-level Contract Full TimeIrvine, CA, United States R1d ago
-
Analytics Team Lead USD 109K-230KCustomer communication | Data Analysis | Data Modeling | Deployment | Fraud DetectionCustomer facing exposure | Mentorship | Remote workSenior-level Full TimeHome Based - San Francisco, CA, … R1d ago
-
Sr. Data Pipeline Engineer (Remote) USD 125K-180KAPI Integration | Airflow | Alerting | Batch Processing | CI/CDPaid adoption leave | Paid parental leave | Paid time off | Professional development opportunities | Wellness programsSenior-level Full TimeUSA CA Remote, United States R1d ago
-
Analytics Team Lead USD 109K-230KData Analysis | Decisioning Platforms | Financial crime | Financial crime analytics | Fraud DetectionSenior-level Full TimeHome Based - San Francisco, CA, … R1d ago
-
API Integration | AWS | Airflow | Azure | Cloud DataAI tooling stipend | Code review | Dedicated mentor | Priority consideration for full time role | Work on production featuresEntry-level Internship TemporaryGlendale, CA R1d ago
-
Lead AI Engineer - AI & Credit Analytics USD 156K-234KAWS | CI/CD | Data Governance | Generative AI | LLMOpsFlexible time off | Flexible work environment | Hybrid work option | Matching 401k | Medical/Dental/Vision insuranceSenior-level Full TimeCosta Mesa, CA, United States R1d ago
-
Engineering Manager, Data USD 190K-230KApache Airflow | Cloud Cost Optimization | Cost Optimization | DICOM | DagsterBonus | Equity | Health insurance | Remote work opportunitySenior-level Full TimeRemote in the United States R2d ago
-
Apache Airflow | BigQuery | Business Intelligence | Cloud platform | Data GovernanceFlexible work environment | Open office environment | Team building eventsSenior-level Full TimeIdaho R2d ago
-
Data, Analytics & AI Team Lead USD 113K-180KAzure | Cloud Data | Cloud Data Platforms | Computer Vision | Data ArchitectureHybrid work modelSenior-level Full TimeATLANTA, GA, United States R2d ago
-
VP, Engineering USD 185K-210KAWS | Apache Airflow | Azure Cosmos | Azure Cosmos DB | Cloud ComputingHybrid work option | Remote work optionExecutive-level Full TimeUnited States R2d ago
-
Sr. Data Scientist, Payments USD 152K-205KApache Superset | Business Intelligence | Dashboarding | Data Visualization | PythonSenior-level Full TimeU.S. - California, United States R2d ago
-
Data Engineering Intern - REMOTE USD 80K-90KAzure | BigQuery | Cloud Composer | Cloud Storage | Cloud platformRemote workEntry-level Full Time Internship2 First American Way, Santa Ana, … R2d ago
-
Embedded Lead Intelligence Analyst USD 130K-157KBrandwatch | Business Continuity | CLEAR | Crisis management | Dark Web401k match | Disability insurance | Employee assistance program | Employee discount program | HolidaysSenior-level Full TimeSan Jose, CA, United States R3d ago
-
Director, Data and AI Engineering USD 146K-219KAWS Bedrock | AWS CDK | AWS CloudFormation | AWS ECS | AWS EKSHybrid work environmentExecutive-level Full TimeRemote Worker - USA R3d ago
-
Lead AI Engineer USD 128K-188KAI Search | Access Control | Agentic AI | App Service | Azure AI401k match | Employee resource group network | Holiday pay | Long-term disability | Paid Maternity LeaveSenior-level Full TimeUnited States R3d ago
-
Lead Azure Data Engineer USD 128K-168KApplication Insights | Azure Data | Azure Data Factory | Azure Monitor | Azure Pipelines100% remote | 24/7 support | On-call supportSenior-level Full TimeUnited States - Remote, United States R3d ago
-
Apache Airflow | Data Architecture | Data Governance | Data Modeling | Data orchestrationCollaborative work environment | Continuous learning | Flexible work hours | Health and wellness programs | Work from homeSenior-level Full TimeFlorida R4d ago
-
Data Engineering | Data Integrity | Data pipeline | Databricks | ETLHealth, dental, vision coverage | Professional development | Remote work | Stock options | Unlimited PTOSenior-level Full TimeMinnesota R4d ago
-
Dashboard Development | Data Engineering | Data Integrity | Data Modeling | Data pipelineDental insurance | Medical insurance | Professional development | Stock options | Unlimited PTOSenior-level Full TimeMassachusetts R4d ago
-
BI platform | Data Engineering | Data pipeline | Databricks | ETLDental insurance | Medical insurance | Stock options | Unlimited PTO | Vision insuranceSenior-level Full TimeIllinois R4d ago
-
Automation | Data Engineering | Data Integrity | Data Reconciliation | Data pipelineDental coverage | Medical coverage | Professional development | Remote work | Stock optionsSenior-level Full TimeIdaho R4d ago
-
Dashboard Development | Data Engineering | Data Pipelines | Data Reconciliation | DatabricksDental insurance | Flexible work schedule | Medical insurance | Professional development | Stock optionsSenior-level Full TimeColumbia R4d ago
-
Data Engineering | Data Modeling | Data pipeline | Databricks | ETLCommunity impact | Dental insurance | Flexible work-life balance | Medical insurance | Professional developmentSenior-level Full TimeFlorida R4d ago
-
Data Engineering | Data pipeline | Databricks | ETL | KPI ManagementDental insurance | Flexible working time | Medical insurance | Professional development | Remote work optionSenior-level Full TimeCalifornia R4d ago