Data Engineer Lead
Tasks
- Automate deployments and monitoring
- Build reusable data processing frameworks
- Design scalable data pipelines
- Develop and maintain ETL/ELT pipelines
- Enable datasets for analytics and ML workflows
- Ensure data quality and consistency
- Handle schema evolution
- Implement CI/CD for data pipelines
- Optimize PySpark job performance
- Process and transform large datasets
- Tune BigQuery query performance
- Use Git for version control
Perks/Benefits
- Company-Paid Holidays
- Employee assistance programs
- Life and disability insurance
- Medical, dental & vision coverage
- Paid time off
- Personal days
- Retirement savings plans
- Sick leave
Skills/Tech-stack
Airflow | Apache Spark | BigQuery | CI/CD | Cloud Dataflow | Cloud Dataproc | Cloud Storage | Cloud platform | Composer | Data Consistency | Data Modeling | Data Pipelines | Data Quality | DataFrame | ELT | ETL | Git | Google Cloud | Google Cloud Dataflow | Google Cloud Dataproc | Google Cloud Platform | PubSub | PySpark | Python | RDD | SQL | Schema evolution
Education
N/A
Roles
Data Engineer | Data Engineering | Data Engineering Lead | Engineer | Engineering Lead | Lead
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R4d ago
-
AWS Data Engineering Advisor USD 117K-179KAWS | AWS Batch | AWS Glue | AWS Secrets | AWS Secrets Manager401k retirement savings plan | ESPP | Employer-paid disability insurance | Health, dental, and vision insurance | HolidaysSenior-level Full TimeHOUSTON, US, 770564h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Bonus | Equity | Friendly atmosphere | Remote-friendly environmentMid-level Full TimeSeattle, WA, USA8h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Portfolio and LinkedIn application support | Remote-friendlyMid-level Full TimeChicago, IL, USA8h ago
-
.NET | Accessibility APIs | Algorithms | App SDK | Asynchronous programmingAutonomy | Cross-functional collaboration | Flexible work setting | Mentorship opportunitiesSenior-level Full TimeAnchorage, AK, USA8h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Flexible, hands-off management | Opportunity to build accessible learning products | Remote or distributed teamMid-level Full TimeSan Francisco, CA, USA8h ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Bonus opportunities | Flexible management approach | Remote workMid-level Full TimeDallas, TX, USA8h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Bonus | Competitive compensation | Equity | Remote-friendlyMid-level Full TimeWashington, DC, USA8h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Friendly work environmentMid-level Full TimeRedmond, WA, USA8h ago
-
Bash | Data Processing | Docker | GCP | LinuxAsynchronous culture | Bonus | Equity | Friendly work environment | Remote/distributed workMid-level Full TimeScottsdale, AZ, USA8h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous work culture | Career growth | Collaborative team | Remote-friendlyMid-level Full TimePlano, TX, USA8h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeMid-level Full TimeSan Antonio, TX, USA8h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Laid-back atmosphere | Remote-friendly, distributed teamMid-level Full TimeSan Mateo, CA, USA8h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Hands off management approach | Portfolio and LinkedIn sharing during application | Remote distributed settingMid-level Full TimeSacramento, CA, USA8h ago
-
Bash | Data Processing | Docker | GCP | Large Scale DataAsynchronous culture | Friendly laid-back atmosphere | Opportunity to make impactMid-level Full TimeCulver City, CA, USA8h ago
-
Artificial Intelligence | Bash | Cloud platform | Data Ingestion | Data Ingestion PipelinesAsynchronous work culture | Bonus | Equity | Friendly work environment | Remote or distributed workMid-level Full TimePasadena, CA, USA8h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Hand off management | Remote-friendly, distributed teamMid-level Full TimeIndianapolis, IN, USA8h ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Bonus | Equity | Flexible, hands-off management | Remote-friendly environmentMid-level Full TimeNaperville, IL, USA8h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Flexible remote setting | Friendly work environmentMid-level Full TimePrinceton, NJ, USA8h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous work culture | Friendly work environmentMid-level Full TimeProvidence, RI, USA8h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerFlexible asynchronous culture | Friendly work environment | Impactful product | Remote/distributed workMid-level Full TimeBaltimore, MD, USA8h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Bonus | Equity | Flexible management approach | Remote-friendly, distributed teamMid-level Full TimeBend, OR, USA8h ago
-
Bash | Cloud infrastructure | Cloud platform | Data Ingestion | Data ProcessingAsynchronous culture | Friendly work environment | Opportunities for high impact on productMid-level Full TimeTucson, AZ, USA8h ago
-
Bash | Data Processing | Data pipeline | Docker | GCPAsynchronous culture | Career growth | Friendly work environment | Remote workMid-level Full TimeRiverside, CA, USA8h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeMid-level Full TimeBaton Rouge, LA, USA8h ago