Senior Lead Data Engineer (R4680)
San Francisco, California
USD 121K-194K (estimate) Senior-level Full Time
Tasks
- Apply governance controls for compliance
- Architect and implement ELT ETL pipelines
- Build secure automated ingestion frameworks
- Design Medallion Architecture
- Design orchestration and monitoring frameworks
- Develop production-grade data models
- Implement data quality validation and reconciliation
- Mentor engineers and lead engineering standards
- Optimize Microsoft Fabric compute usage
- Productionize ML enabled workflows
Perks/Benefits
- N/A
Skills/Tech-stack
Analytics engineering | Anomaly Detection | Azure Data | Azure Data Factory | Azure Synapse | CI/CD | Data Factory | Data Governance | Data Modeling | Data Quality | Data Reconciliation | Databricks | Dimensional Modeling | ELT | ERP | ETL | FP and A | Feature Engineering | Financial Reporting | Forecasting | GitHub | IAM | Indexing | Lakehouse | Machine Learning | Microsoft Fabric | Model Evaluation | Monitoring | Networking | Orchestration | Partitioning | PySpark | Python | Query folding | SQL | Snowflake | Star Schema | Statistics
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer | Senior Data Engineer
Regions
Countries
States
Related jobs
-
Data Engineer (remote) USD 85K-100KAgile | Apache Hive | Apache Impala | Apache Spark | Artificial Intelligence401k match | Employee assistance program | Flexible schedule | Health insurance | Life insuranceMid-level Full TimeWork From Home, United States R5h ago
-
AWS | Alerting | CI/CD | Compliance | Data LakeCareer growth | Dental insurance | Medical insurance | Paid leave | Retirement plansExecutive-level Full TimeHouston, TX, United States6h ago
-
Senior Data Engineer Principal & Lead –on Site USD 165K-210KAWS Lambda | Amazon Kinesis | Amazon Redshift | Amazon S3 | Data ModelingDay 1 impact | On-site role | Own product and infrastructure | Shape technical vision | Small senior teamSenior-level Full TimeSan Francisco, United States8h ago
-
SOFTWARE ENGINEER - Big Data - 5+ yrs of Experience - TS/SCI w/Poly clearance is required - ID A USD 218K-225KAnomaly Detection | Apache Airflow | Apache Kafka | Apache Spark | Bash401k retirement plan | Dental insurance | Federal Holidays | Floating holidays | Life insuranceMid-level Full TimeFort George G Meade, United States9h ago
-
SOFTWARE ENGINEER - Apache Spark/Big Data - 7+ yrs of Experience - TS/SCI w/Poly clearance is required - ID A USD 234K-241KApache Airflow | Apache Spark | Bash | CSV | Configuration Management401k retirement plan | Dental insurance | Disability coverage | Federal Holidays | Health insuranceMid-level Full TimeFort George G Meade, United States9h ago
-
Algorithms | C++ | Computational lithography | Data Structures | Image ProcessingFinancial benefits | Health benefits | Wellness programsSenior-level Full TimeCalifornia, Sunnyvale9h ago
-
ANSYS Mechanical | Ansys Twin Builder | C++ | Controls | GazeboFinancial benefits | Health benefits | Remote work | Wellness benefitsEntry-level InternshipCalifornia, US (California) Off-Site9h ago
-
Software Engineer, Backend and Infrastructure USD 156K-316KAlerting | CI/CD | Database Design | Distributed Systems | HDFSMid-level Full TimeSan Jose, California, United States9h ago
-
Senior Software Engineer, Backend and Infrastructure USD 156K-387KAlerting | CI/CD | Cloud IDE | Database | HDFSSenior-level Full TimeSan Jose, California, United States9h ago
-
Benchmarking | Data Pipelines | Evaluation metrics | Interpretability | LLM EvaluationSenior-level Full TimeSan Jose, California, United States9h ago
-
Computer Vision | Data Processing | Deep learning | Feature Engineering | Language ModelsSenior-level Full TimeSan Jose, California, United States9h ago
-
Robotics Engineer - Autonomous Drone System USD 167K-230KAnalytics | Anomaly Detection | Autonomous Navigation | BVLOS | C++Senior-level Full TimeFremont, CA10h ago
-
Robotics Control Engineer - Manipulation USD 162K-240KABB Rapid | C++ | Calibration | Cause analysis | CommissioningSenior-level Full TimeMenlo Park, CA | Fremont, CA10h ago
-
Robotics Firmware & Electrical Engineer USD 170K-240KC# | C++ | CAN | Electrical layout | Embedded SystemsSenior-level Full TimeFremont, CA10h ago
-
Production Engineer USD 147K-208KAI workflow | AI workflow automation | Agent Orchestration | C++ | CDNSenior-level Full TimeMenlo Park, CA10h ago
-
Agent Orchestration | Benchmarking | Data Generation | Data Pipelines | EvaluationSenior-level Full TimeBellevue, WA | Menlo Park, CA …10h ago
-
Abuse prevention | Adversarial Machine Learning | Agentic Models | Benchmarks | Code reviewMid-level Full TimeMenlo Park, CA10h ago
-
Technical Lead Manager, AI/ML Networking USD 207K-300KArtificial Intelligence | C++ | Compute Technologies | Dataplane Encryption | Deep Learning Execution ProviderSenior-level Full TimeRaleigh, NC, USA; Durham, NC, USA10h ago
-
Senior Research Software Engineer, Labs, AI/ML USD 174K-252KC++ | Data Structures | Data Structures and Algorithms | Deep learning | Distributed ComputingSenior-level Full TimeMountain View, CA, USA; Zürich, Switzerland10h ago
-
Software Engineer III, AI/ML, Google Cloud AI USD 147K-211KC++ | Data Processing | Debugging | GenAI | Google CloudSenior-level Full TimeSunnyvale, CA, USA10h ago
-
AI Agents | AppScript | Artificial Intelligence | Business Intelligence | Change ManagementSenior-level Full TimeSan Bruno, CA, USA10h ago
-
Staff Software Engineer, On-Device Machine Learning USD 207K-300KAndroid | Data Processing | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeSunnyvale, CA, USA10h ago
-
Senior Engineering Analyst, AI, Safety USD 159K-231KAbuse detection | C++ | Data Analysis | Fine Tuning | Fraud DetectionEquity compensation | Health insurance | Mentorship | Paid time off | Retirement benefitsSenior-level Full TimeKirkland, WA, USA; Seattle, WA, USA10h ago
-
Staff Software Engineer, Biglakes, BigQuery USD 207K-300KApache Arrow | Apache Flink | Apache Spark | Big Data | Big data analyticsSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA10h ago
-
Senior Software Engineer, ML Performance Infrastructure USD 174K-252KC# | C++ | Compute technology | Data Storage | Data StructuresSenior-level Full TimeSunnyvale, CA, USA10h ago