Data Engineering Lead (Remote)
Tasks
- Apply agile project management
- Architect data platform using BigQuery
- Build data pipelines with Dataflow
- Create data platform roadmap
- Create engineering documentation
- Define data platform architecture
- Establish data modeling standards
- Implement TDD and modular testing
- Improve data handling and cost efficiency
- Integrate AI and LLM tools into workflows
- Manage workflows with Airflow
- Mentor data engineers and analysts
- Optimize query performance
- Set up CI CD pipelines with automated testing
Perks/Benefits
Skills/Tech-stack
Agile | Airflow | Automated testing | BI tools | BigQuery | CI/CD | Cloud Storage | Dataflow | Git | Google Cloud | Google Cloud Storage | LLM integration | Modular Testing | Python | SQL | TDD
Education
N/A
Roles
Data Engineer | Data Engineering | Data Engineering Lead | Engineer | Engineering Lead | Lead
Related jobs
-
AI Gateways | AWS CDK | Chunking | Context engineering | Cost Tracking401k match | Counseling membership | Flexible time away | Life insurance | Long-term disabilityMid-level Full Time-REMOTE, USA- R12h ago
-
Agile | Apache Airflow | Automated testing | BigQuery | CI/CDCollaborative company culture | Flexible working hours | Professional development opportunities | Remote-first work environmentSenior-level Full TimeMassachusetts R19h ago
-
Agile | Apache Airflow | Artificial Intelligence | Automated testing | BigQueryCollaborative culture | Flexible working hours | Performance evaluations | Professional development opportunities | Remote workSenior-level Full TimeIdaho R19h ago
-
Agile | Apache Airflow | BigQuery | CI/CD | Cloud StorageCollaborative company culture | Flexible working hours | Professional development opportunities | Remote-first work environmentSenior-level Full TimeMinnesota R19h ago
-
Agile | Airflow | BigQuery | CI/CD | Cloud StorageCollaborative culture | Professional development | Remote-first flexibilitySenior-level Full TimeColorado R19h ago
-
Agile | Airflow | BigQuery | CI/CD | Cloud StorageCollaborative company culture | Flexible working hours | Professional development opportunities | Remote-first environmentSenior-level Full TimeColumbia R19h ago
-
Agile | Airflow | BigQuery | CI/CD | Cloud StorageCollaborative company culture | Professional development opportunities | Remote-first flexible hoursSenior-level Full TimeFlorida R19h ago
-
Agile | Airflow | Automated testing | BI tools | BigQueryCollaborative culture | Flexible working hours | Professional development | Remote-first environmentSenior-level Full TimeCalifornia R19h ago
-
Agile | Apache Airflow | Automated testing | BigQuery | CI/CDCollaborative company culture | Professional development opportunities | Remote-first flexibilitySenior-level Full TimeConnecticut R19h ago
-
Agile | Airflow | BI tools | BigQuery | CI/CDCollaborative & Innovative Culture | Professional development | Remote-first flexible hoursSenior-level Full TimeArizona R19h ago
-
Data Integrity | Data Visualization | Data collection | Data reporting | Database ManagementHealth insurance | Long-term disability | Paid parental leave | Paid sick leave | Paid vacationSenior-level Full TimeMinnesota R1d ago
-
Defensive Security AI Scientist USD 240K-260KAccelerate | Artificial Intelligence | CISA KEV | CUDA | CVSS401k plan with company matching | Bereavement | Disability insurance | Employee assistance program | Employee discount programSenior-level Full TimeRemote - Nationwide, United States R1d ago
-
ML Infrastructure Engineer USD 145K-165KAWS | Amazon Elastic Kubernetes Service | Amazon SageMaker | BigQuery | CD pipelinesHealth benefits | Paid time off | Remote work optionMid-level Full TimeBoston, MA R2d ago
-
ML Infrastructure Engineer USD 145K-165KAWS | Amazon SageMaker | BigQuery | CI/CD | CloudFormationBenefits plans | Remote work optionMid-level Full TimeNew York, New York, United States R2d ago
-
ML Infrastructure Engineer USD 145K-165KAWS | Amazon SageMaker | BigQuery | BigQuery datasets | CI/CDCompany benefits plan enrollment | Health benefits | Performance-based bonus | Remote work optionMid-level Full TimeLos Angeles, California, United States R2d ago
-
AI | AWS | DBA | Database systems | DevOpsDental insurance | Flexible working hours | Health insurance | Paid time off | Professional developmentSenior-level Full TimeMinnesota R2d ago
-
AI machine learning | AWS | Cloud platform | DBA operations | Database systemsDental insurance | Flexible working hours | Health insurance | Paid time off | Professional developmentMid-level Full TimeIllinois R2d ago
-
Senior AI Data Engineer USD 160K-200KAWS | AWS Athena | AWS Glue | AWS Lambda | Amazon Redshift401k matching | Dental insurance | Disability insurance | Life insurance | Medical insuranceSenior-level Full TimeSan Diego, California, United States R2d ago
-
Causal Inference | Classification | Clustering | Data Warehousing | Experiment designFlexible PTO | Home office stipend | Learning budget | Paid health, dental, vision | Parental leaveSenior-level Full TimeBoston or Remote R2d ago
-
Senior Data Engineer USD 155K-220KAPI Integration | Alerting | Amazon Redshift | Automated testing | CI/CDSenior-level Full TimeDenver, CO;San Francisco, CA;New York, NY;Los … R2d ago
-
Infrastructure Engineer (Storage) USD 180K-200KAutomation | Bare Metal | Bring-up | Capacity Planning | CephComprehensive medical/dental/vision coverage | Flexible work environment | Paid parental leave | Paid time off | Pension contributionMid-level Full TimeNew York, New York, United States; … R2d ago
-
Data Engineer USD 74K-133KAgile | Apache Airflow | BigQuery | Cloud Composer | Cloud Storage401k employer match | Dental insurance | Disability insurance | Flexible time off | Health insuranceMid-level Full TimeLisle, IL, United States R2d ago
-
Lead Instructor: MLOps / AI Platform Engineering USD 23K-27KAI Foundry | Azure AI | Azure AI Foundry | Azure Machine Learning | CI/CDFlexible scheduling | Professional training delivery | Remote workSenior-level Full TimeU.S. Remote R2d ago
-
Lead Instructor: Agentic AI Engineering USD 23K-27KAI Foundry | API Design | Agent Design | Agent design patterns | Agent systemsFlexible scheduling | Remote work | West Coast Pacific Time hoursSenior-level Full TimeU.S. Remote R2d ago
-
Lead Software Engineer USD 121K-181KAWS | Agile | Cause analysis | Data Modeling | Data WarehousingFlexible work arrangement | Health insurance | Hybrid work model | Life insurance | Paid time offSenior-level Full TimeTX, United States R2d ago