Lead Data Engineer
Tasks
- Adopt and govern AI and LLM workflows
- Architect data platforms for dev test and production
- Build data pipelines
- Conduct postmortems
- Create documentation and runbooks
- Define data contracts
- Define data platform standards
- Design disaster recovery
- Enforce access controls
- Ensure compliance & validation
- Forecast capacity
- Implement PII handling controls
- Implement audit logging
- Implement corrective actions
- Implement data quality controls
- Implement observability for data pipelines
- Lead cost optimization
- Lead incident response
- Maintain architectural decision records
- Maintain data pipelines
- Manage build vs buy decisions
- Manage data retention policies
- Monitor data freshness and volume
- Operate data pipelines
- Optimize Snowflake architecture
- Plan technical initiatives across teams
- Plan upgrades without downtime
- Remove technical blockers
- Respond to alerts
- Troubleshoot production data systems
- Validate AI generated pipelines
Perks/Benefits
- 401k matching
- Dental insurance
- Disability insurance
- Flexible paid time off
- Insurance benefits
- Life insurance
- Medical insurance
- Vision insurance
Skills/Tech-stack
API Standards | AWS | Access Control | Airflow | Audit Logging | Capacity Planning | Cause analysis | Clustering | Compliance | Cost Optimization | DBT | Data Architecture | Data Contracts | Data Governance | Data Lineage | Data Pipelines | Data Quality | Data Retention | Data SLOs | Deployment Automation | Disaster Recovery | Disaster Recovery Testing | Flink | High Availability | Incident Management | Kafka | Kinesis | MWAA | Materialized views | Observability | OpenLineage | PII | Performance Tuning | Postmortems | Python | Recovery testing | Resource Management | Resource monitors | Root Cause Analysis | Root cause | SLAs | SQL | Schemachange | Service Level | Service Level Agreements | Snowflake | Uptime monitoring
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Featured Feat. Applied AI Engineer - Bay Area USD 211K-263KArtificial Intelligence | C plus plus | C# | Embeddings | Feature Engineering401k | Comprehensive health and wellness benefits | Learning and development opportunities | Unlimited time offMid-level Full TimeHQ (San Francisco)24d ago
-
Senior-level ContractAustin, United States2h ago
-
AI Search | Agile | Angular | Azure AI | Azure AI Search100 percent onsite | Public trust clearance requiredSenior-level ContractWoodlawn, United States2h ago
-
Senior Software Engineer - DevOps & Data Engineering USD 140K-190KAgentic Workflows | Automation | CI/CD | Claude | Cloud infrastructureSenior-level ContractChandler, United States2h ago
-
Azure Databricks Developer USD 125K-198KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeLouisville, Kentucky, United States3h ago
-
Entry-level Full TimeUS-Kansas-Wichita3h ago
-
Mid-level Full TimeUS-Kansas-Wichita4h ago
-
Data Engineer II USD 101K-176KAWS | Agile | Airflow | Azure | Azure DevOps401k matching | Health & dental insurance | Onsite fitness center | Time off | Tuition reimbursementSenior-level Full TimeUS-Rhode Island-Providence4h ago
-
C++ | Cloud Native | Container Orchestration | Deep learning | Distributed SystemsCareer growth | Open Source contribution | World Class CollaborationEntry-level Full TimeSan Jose, California, United States4h ago
-
Senior Algorithm Engineer, Performance Advertising USD 174K-252KA/B | A/B Testing | Ad Ranking | Auction optimization | B testingCollaborative team environment | Continuous learning | Flat organizational structure | Ownership and empowermentSenior-level Full TimeSan Francisco, United States4h ago
-
Linguistic Engineer USD 103K-156KBias Mitigation | Ethical AI | Hack | Knowledge graphs | Machine LearningMid-level Full TimeRedmond, WA5h ago
-
Research Engineer, Robotics USD 184K-356KC++ | CUDA | Computer Graphics | GPU Architectures | GPU KernelsSenior-level Full TimeRedmond, WA5h ago
-
Partner Engineer, Generative AI USD 159K-223KAWS | Agent Orchestration | Azure | Bias Mitigation | C++Senior-level Full TimeMenlo Park, CA5h ago
-
Senior Software Developer, Computer Vision, XR USD 100K-253KAr | Augmented Reality | C++ | Computer Vision | Data ProcessingSenior-level Full TimeSan Jose, CA, USA; Waterloo, ON, …5h ago
-
Customer Engineer III, Applied AI, Google Cloud USD 174K-253KAgent tooling | C++ | Cloud Architecture | Conversational AI | Document AISenior-level Full TimeSunnyvale, CA, USA; Mountain View, CA, …5h ago
-
Staff Datacloud Blackbelt Engineer, Data and AI USD 183K-266KAI/ML | AI/ML workflows | BigQuery | Cloud Architecture | Computer VisionSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA5h ago
-
Senior Software Engineer, AI/ML, Google Cloud Platforms USD 174K-253KC++ | Code Reviews | Data Processing | Data Structures | Data structures algorithmsSenior-level Full TimeKirkland, WA, USA5h ago
-
Senior Software Engineer, AI/ML, Google Cloud USD 174K-253KC++ | Data Processing | Debugging | Distributed Computing | Information RetrievalSenior-level Full TimeSunnyvale, CA, USA5h ago
-
Senior Software Engineer, AI/ML GenAI, Google Cloud USD 174K-253KAlgorithms | C++ | Computer Vision | Data Processing | Data StructuresSenior-level Full TimeSunnyvale, CA, USA5h ago
-
C++ | Computer Vision | Data Processing | Debugging | Image classificationSenior-level Full TimeSan Diego, CA, USA5h ago
-
Database querying | Deep learning | Language Processing | Machine Learning | Natural LanguageMid-level Full TimeNew York, NY, USA; Mountain View, …5h ago
-
AI Engineer, Advanced Solutions Lab, Google Cloud USD 152K-222KApache Beam | Artificial Intelligence | Cloud platform | ELT | ETLSenior-level Full TimeChicago, IL, USA; Atlanta, GA, USA5h ago
-
Technical Lead, Storage Distributed and Sovereign Cloud USD 207K-301KAI/ML | AI/ML Workloads | Access Control | Automated remediation | Block StorageSenior-level Full TimeRaleigh, NC, USA; Durham, NC, USA5h ago
-
Agent Construction | Agent Orchestration | Air Gapped Computing | Air-gapped | Data IngestionBonus | Equity | Security clearance travel availabilitySenior-level Full TimeWashington D.C., DC, USA; Maryland, USA5h ago
-
Senior Data Scientist, Machine Learning USD 194K-218KAWS | Active Learning | Airflow | Amazon Redshift | Automated Labeling100% TelecommutingSenior-level Full TimeRedwood City, CA R14h ago