Lead Data Engineer - Auctions & Outcomes
Tasks
- Build path to streaming pipelines
- Centralize monitors and alerts
- Collaborate with analysts and business stakeholders
- Create runbooks for incident response
- Define cross surface metric definitions
- Lead and grow data engineering team
- Own business metric reporting
- Own data sharing for reports and partners
- Own observability and alert response
- Process event log pipelines using Spark
- Record decisions in ADRs
- Refactor pipelines for testability
- Review code and drive knowledge sharing
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Airflow | Apache Iceberg | Apache Kafka | Apache Spark | ArgoCD | CI/CD | ClickHouse | GitHub Actions | Grafana | Kubernetes | Prometheus | Python | Redpanda | SQL | Snowflake | VictoriaMetrics
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Regions
Countries
States
Cities
Related jobs
-
(US) Principal ML System Engineer USD 139K-304KAWS | Access Control | Alerting | Audit Logging | AuthenticationSenior-level Full TimeRemote, USA R6h ago
-
Machine Learning Engineer, API Multicloud USD 295K-445KAPIs | AWS | Data Pipelines | Data Structures | Data structures algorithmsSenior-level Full TimeSan Francisco7h ago
-
Applied Probability | Artificial Intelligence | C++ | Data Engineering | Data VisualizationExposure to senior leaders | Mentorship | Rotational projects | Technical trainingEntry-level Full Time141753-NC-Three Wells Fargo Center, Charlotte, United …10h ago
-
Senior Software Engineer - Storage Control Plane USD 266K-395KBlock Storage | C# | C++ | CI/CD | CephSenior-level Full TimeSan Francisco Office (Fremont St) R11h ago
-
A/B | A/B Testing | B testing | Data parallelism | Deep learning401k employer match | Family planning support | Flexible vacation | Gender-affirming care | Global benefit programsSenior-level Full TimeRemote - United States R11h ago
-
A/B | A/B Testing | B testing | C++ | Cloud Computing401k employer match | Family planning support | Flexible vacation | Gender-affirming care | Global benefitsSenior-level Full TimeRemote - United States R11h ago
-
Applied AI/ML Engineer USD 150K-200KAPI Integration | Anomaly Detection | Apache Spark | CI/CD | Cloud Platforms401k match | Comprehensive benefits package | Flexible PTO | Paid Holidays | Remote workMid-level Full TimeWashington DC area R12h ago
-
Finance & Strategy AI Engineer USD 146K-246KAPI Integration | Adaptive Planning | Agentic Workflows | BigQuery | Data GovernanceFlexible remote work | Health benefits | Parental leave | Professional development stipendSenior-level Full TimeSan Francisco - SF9 R12h ago
-
AI Assisted Query Profiling | AI assisted code | AI-assisted code review | ClickHouse | Code reviewSenior-level Full TimeUnited States R12h ago
-
Software Engineer, Data Infrastructure - AI Platform USD 200K-230KAI-assisted tooling | ClickHouse | Data Pipelines | Debugging | Distributed SystemsSenior-level Full TimeUnited States R12h ago
-
Staff Data Platform Engineer - AI Platform USD 200K-230KClickHouse | Compliance | Data Pipelines | Debugging | Distributed SystemsSenior-level Full TimeUnited States R12h ago
-
Senior Data Platform Engineer - AI Platform USD 200K-230KAI code review | AI-assisted debugging | ClickHouse | Code review | Data Pipeline ReliabilitySenior-level Full TimeUnited States R12h ago
-
Data Platform Engineer - AI Platform USD 200K-230KClickHouse | Data Pipelines | Distributed Systems | Incident Response | Log AnalysisSenior-level Full TimeUnited States R12h ago
-
Senior DevOps Engineer (Storage) - remote in the US USD 200K-290KAir-gapped | ArgoCD | CAPI | CSI | Cluster APICompany outings | Conference attendance | Hackathons | Happy hours | Professional development and trainingExecutive-level Full TimeRemote, USA, United States R13h ago
-
Senior Software Engineer (Storage) - remote in the US USD 100K-170KArgoCD | CSI | Cluster API | Flux | GitOpsCompany outings and happy hours | Conferences and working groups | Hackathons and tech talks | Professional development and trainingSenior-level Full TimeRemote, USA, United States R13h ago
-
Autonomy Algorithms Software Engineer USD 115K-145KAgent systems | Agile | Algorithms | C++ | CI/CDHybrid work environment | Remote work optionMid-level Full TimeArlington, VA R14h ago
-
Autonomy Algorithms Software Engineer USD 115K-145KAgent systems | Agile | Algorithms | C++ | CI/CDFlexible work schedule | Hybrid work environment | Remote work availableMid-level Full TimeWoburn, MA R14h ago
-
Software Engineer I - Lab - 934 USD 125K-195KC plus plus | CI/CD | Data acquisition | Docker | Embedded SystemsMid-level Full TimeUS Broomfield, CO14h ago
-
Forward Deployed Engineer USD 280K-320KAgent Development | Deployment | Evaluation | JavaScript | Language ModelsFlexible working hours | Generous vacation | Parental leave | Visa sponsorshipMid-level Full TimeNew York City, NY; San Francisco, … R14h ago
-
Software Engineer, Embedded Agentic AI USD 170K-210KC# | C++ | Cloud Platforms | Containerization | DockerDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offEntry-level Full TimeSan Jose, California R14h ago
-
Senior Software Engineer, Data Platform USD 196K-245KAirflow | BigQuery | Cost Optimization | Dagster | Data GovernanceBenefits | Equity | Relocation assistanceSenior-level Full TimeSan Francisco Bay Area or Remote … R14h ago
-
Senior Research Engineer, LLM Training & Post-Training USD 165K-310KCUDA | DPO | DeepSpeed | Distributed Training | Experiment design401k matching | Company holidays | Comprehensive health coverage | Dental coverage | Flexible time offSenior-level Full TimeNew York, New York, United States; … R14h ago
-
Data Engineer - DataOps USD 130K-150KApache Airflow | Apache Iceberg | Apache Spark | CI/CD | Cause analysis401k match | Career growth | Hybrid work schedule | Medical, dental, and vision insurance | Paid parental leaveMid-level Full TimeCupertino, California, United States15h ago
-
Staff Data Engineer - AI Platform USD 200K-230KAI Assisted Query Profiling | AI assisted code | AI-assisted code review | ClickHouse | Code reviewSenior-level Full TimeUnited States R15h ago
-
Senior Data Engineer - AI Platform USD 200K-230KClickHouse | Data Pipeline Reliability | Data pipeline | Debugging | Distributed SystemsSenior-level Full TimeUnited States R15h ago