Lead Data Engineer
Tasks
- Adopt and govern AI and LLM workflows
- Architect data platforms for dev test and production
- Build data pipelines
- Conduct postmortems
- Create documentation and runbooks
- Define data contracts
- Define data platform standards
- Design disaster recovery
- Enforce access controls
- Ensure compliance & validation
- Forecast capacity
- Implement PII handling controls
- Implement audit logging
- Implement corrective actions
- Implement data quality controls
- Implement observability for data pipelines
- Lead cost optimization
- Lead incident response
- Maintain architectural decision records
- Maintain data pipelines
- Manage build vs buy decisions
- Manage data retention policies
- Monitor data freshness and volume
- Operate data pipelines
- Optimize Snowflake architecture
- Plan technical initiatives across teams
- Plan upgrades without downtime
- Remove technical blockers
- Respond to alerts
- Troubleshoot production data systems
- Validate AI generated pipelines
Perks/Benefits
- 401k matching
- Dental insurance
- Disability insurance
- Flexible paid time off
- Insurance benefits
- Life insurance
- Medical insurance
- Vision insurance
Skills/Tech-stack
API Standards | AWS | Access Control | Airflow | Audit Logging | Capacity Planning | Cause analysis | Clustering | Compliance | Cost Optimization | DBT | Data Architecture | Data Contracts | Data Governance | Data Lineage | Data Pipelines | Data Quality | Data Retention | Data SLOs | Deployment Automation | Disaster Recovery | Disaster Recovery Testing | Flink | High Availability | Incident Management | Kafka | Kinesis | MWAA | Materialized views | Observability | OpenLineage | PII | Performance Tuning | Postmortems | Python | Recovery testing | Resource Management | Resource monitors | Root Cause Analysis | Root cause | SLAs | SQL | Schemachange | Service Level | Service Level Agreements | Snowflake | Uptime monitoring
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Featured Feat. Applied AI Engineer - Bay Area USD 211K-263KArtificial Intelligence | C plus plus | C# | Embeddings | Feature Engineering401k | Comprehensive health and wellness benefits | Learning and development opportunities | Unlimited time offMid-level Full TimeHQ (San Francisco)24d ago
-
Linguistic Engineer USD 103K-156KBias Mitigation | Ethical AI | Hack | Knowledge graphs | Machine LearningMid-level Full TimeRedmond, WA3h ago
-
Research Engineer, Robotics USD 184K-356KC++ | CUDA | Computer Graphics | GPU Architectures | GPU KernelsSenior-level Full TimeRedmond, WA3h ago
-
Partner Engineer, Generative AI USD 159K-223KAWS | Agent Orchestration | Azure | Bias Mitigation | C++Senior-level Full TimeMenlo Park, CA3h ago
-
Senior Data Scientist, Machine Learning USD 194K-218KAWS | Active Learning | Airflow | Amazon Redshift | Automated Labeling100% TelecommutingSenior-level Full TimeRedwood City, CA R13h ago
-
Principal Scientist, Machine Learning - Biomolecules USD 208K-286KAWS Batch | AWS ECS | AWS EKS | AWS S3 | AWS SageMakerAnnual incentive program | Healthcare coverage | Retirement benefitsSenior-level Full TimeCambridge, MA USA13h ago
-
AI Engineer USD 125K-201KAWS | Agent Frameworks | Agent SDK | Agent coordination | Claude Agent SDKCollaboration with little supervision | Startup environment | Work on cutting-edge AIEntry-level Full TimePittsburgh, Pennsylvania, United States13h ago
-
Mid-level Full TimeSan Francisco14h ago
-
Mid-level Full TimeSan Francisco15h ago
-
Data Engineer Data Pipelines and ETL USD 99K-147KAnomaly Detection | Apache Airflow | CDC | Cloud Composer | Data Governance401k plan | Disability benefits | Life insurance | Life insurance coverage | Medical/Dental/VisionMid-level Full TimeBurbank, CA, US, 9150515h ago
-
Sr. Software Engineer, Data Streaming Systems USD 130K-195KAutoscaling | Blocking I/O | CI/CD | Concurrency | Distributed Systems401k plan | Dental insurance | Disability benefits | Life insurance | Medical insuranceSenior-level Full TimeBurbank, CA, US, 9150515h ago
-
Medicaid AI Lead USD 71K-156KArtificial Intelligence | Automation | Capacity Planning | Data Analysis | Data dashboards401k match | Dental insurance | Employee assistance program | Flexible spending account | Health savings accountSenior-level Full TimeSpringfield, IL, US15h ago
-
Analytics | Business Intelligence | Dashboard Development | Data Modeling | Data QualitySenior-level Full TimeMarietta, GA, US15h ago
-
Senior Analytics Engineer, GTM USD 176K-265KAPI Integration | CI/CD | DBT | Data Modeling | Data QualityCompany-sponsored team events | Flexible time off | Wellness resourcesSenior-level Full TimeSanta Clara, California16h ago
-
Senior AI Engineer – Developer Products USD 170K-250KAPI Design | LLMOps | Language Models | Large Language Models | MLOpsGenerous benefits | Health benefits | Remote work options | Stock optionsSenior-level Full TimeSan Francisco, California16h ago
-
ETL Engineer_Woonsocket, RI USD 44K-154KAWS | Apache Spark | CI/CD | CloudFormation | Data Quality401k retirement plan | Dental benefits | Medical benefits | Paid Holidays | Paid time offSenior-level Full TimeUnited States16h ago
-
Machine Learning Engineer USD 140K-190KApache Flink | Apache Kafka | Apache Spark | Bigtable | CI/CDMid-level Full TimeRemote - USA R16h ago
-
Staff AI/ML Engineer USD 240K-270KAWS | Agentic Workflows | Azure | Data Curation | Deep learning401k | Commuter benefits | Dog-friendly office | Equity | FSA benefitsSenior-level Full TimeNew York City, NY16h ago
-
Staff AI/ML Engineer USD 240K-270KAWS | Agentic Workflows | Cloud platform | Deep learning | Foundation Models401k | Commuter benefits | Dog-friendly office | Equity | Flexible spending accountSenior-level Full TimeSan Francisco, CA16h ago
-
Senior AI/ML Engineer USD 240K-270KAWS | Agentic Workflows | Azure | Data Curation | Deep learning401k | Commuter benefits | Dog-friendly office | Equity | FSA benefitsSenior-level Full TimeNew York City, NY16h ago
-
Senior AI/ML Engineer USD 240K-270KAWS | Agentic Workflows | Artificial Intelligence | Azure | Cloud infrastructure401k | Commuter benefits | Dog-friendly office | Equity | Flexible spending accountSenior-level Full TimeSan Francisco, CA16h ago
-
BigQuery | Cloud Functions | Compute Engine | DBT | Fivetran11 paid holidays | 401k matching | Basic life insurance | Commuter benefits | Disability insuranceMid-level Full TimeNew York, NY16h ago
-
Research Engineers, Data USD 150K-250KData Annotation | Data Drift | Data Modeling | Data Pipelines | Data Quality401k | Access to modern AI tools | Commuter benefits | In-office lunch | Medical, dental & vision coverageSenior-level Full TimeSan Francisco16h ago
-
Senior Embedded Software Engineer - Future Forward USD 153K-201KAgile | Authentication | Board Bring-up | Bring-up | C#Senior-level Full TimeSunnyvale, CA, United States R17h ago
-
Principal Applied Scientist USD 200K-250KA/B | A/B Testing | Agent Orchestration | B testing | Continuous LearningCareer growth | Hybrid work flexibility | Mentorship | Remote work option | Training opportunitiesSenior-level Full TimeBellevue17h ago