Senior Lead Data Engineer (R4680)
San Francisco, California
USD 121K-194K (estimate) Senior-level Full Time
Tasks
- Apply governance controls for compliance
- Architect and implement ELT ETL pipelines
- Build secure automated ingestion frameworks
- Design Medallion Architecture
- Design orchestration and monitoring frameworks
- Develop production-grade data models
- Implement data quality validation and reconciliation
- Mentor engineers and lead engineering standards
- Optimize Microsoft Fabric compute usage
- Productionize ML enabled workflows
Perks/Benefits
- N/A
Skills/Tech-stack
Analytics engineering | Anomaly Detection | Azure Data | Azure Data Factory | Azure Synapse | CI/CD | Data Factory | Data Governance | Data Modeling | Data Quality | Data Reconciliation | Databricks | Dimensional Modeling | ELT | ERP | ETL | FP and A | Feature Engineering | Financial Reporting | Forecasting | GitHub | IAM | Indexing | Lakehouse | Machine Learning | Microsoft Fabric | Model Evaluation | Monitoring | Networking | Orchestration | Partitioning | PySpark | Python | Query folding | SQL | Snowflake | Star Schema | Statistics
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer | Senior Data Engineer
Regions
Countries
States
Related jobs
-
Senior-level Full TimeSan Jose, CA, United States8h ago
-
Senior Machine Learning Engineer - Cybersecurity USD 80K-200KAnomaly Detection | Behavioral analytics | Cyber Threat | Cyber Threat Detection | CybersecuritySenior-level Full TimeSan Jose, CA, United States8h ago
-
Lead AI Engineer - AI & Credit Analytics USD 156K-234KAWS | CI/CD | Data Governance | Generative AI | LLMOpsFlexible time off | Flexible work environment | Hybrid work option | Matching 401k | Medical/Dental/Vision insuranceSenior-level Full TimeCosta Mesa, CA, United States R9h ago
-
Head of AI Advisory / AI Advisory Lead – Private Equity USD 188K-260KAI strategy | Artificial Intelligence | Business value | Business value assessment | Competitive AnalysisExecutive-level Full TimeChicago, IL, United States9h ago
-
Sr. Delivery Acceleration AI Engineer USD 137K-241KA/B | A/B Testing | AI Agents | API Design | Artificial IntelligenceSenior-level Full TimeAtlanta, Georgia , United States10h ago
-
Energy Market Optimization Engineer USD 84K-128KBacktesting | Battery Energy Storage | Data Pipelines | Energy market | Energy market simulationDental insurance | Health insurance | Life insurance | Paid time off | Paid volunteeringMid-level Full TimeBoothwyn, PA, United States11h ago
-
Generative AI Consultant USD 105K-105KAWS | Azure | CI/CD | Chroma | Cloud platform401k match | Flexible spending account | Healthcare coverage | Paid time off | Parental leaveMid-level Full TimeSan Francisco, CA, United States12h ago
-
Mid-level Full TimeKing George, VA, United States14h ago
-
Data Engineer USD 130K-145KApache Spark | CI/CD | Cloud platform | Containerization | Data GovernancePublic trust clearance support | Remote workSenior-level Full TimeWork from home, VA, United States R14h ago
-
Apache Airflow | BigQuery | Cloud platform | Data Governance | Data ModelingFlexible work environment | Open office environment | Remote work | Team building eventsSenior-level Full TimeMinnesota R14h ago
-
Apache Airflow | BigQuery | Cloud platform | Data Governance | Data ModelingCollaborative open office environment | Flexible work environment | Team building eventsMid-level Full TimeMassachusetts R14h ago
-
Apache Airflow | BigQuery | Business Intelligence | Cloud platform | Data GovernanceFlexible work environment | Open office environment | Team building eventsSenior-level Full TimeIdaho R14h ago
-
Apache Airflow | BigQuery | Cloud platform | Data Governance | Data ModelingCollaborative open office environment | Flexible work environment | Remote work | Team building eventsSenior-level Full TimeIllinois R14h ago
-
Apache Airflow | BigQuery | Cloud platform | Data Governance | Data ModelingCollaborative work environment | Flexible work atmosphere | Team building eventsSenior-level Full TimeColumbia R14h ago
-
Apache Airflow | BigQuery | Cloud platform | Data Governance | Data ModelingCollaborative work culture | Flexible work environment | Open office environment | Team building eventsMid-level Full TimeColorado R14h ago
-
Airflow | BigQuery | Cloud platform | Data Governance | Data ModelingCollaborative work culture | Flexible work environment | Team building eventsSenior-level Full TimeFlorida R14h ago
-
Apache Airflow | BigQuery | Business Intelligence | Cloud platform | Data ConsistencyCollaborative work environment | Remote work flexibility | Team building eventsMid-level Full TimeCalifornia R14h ago
-
Airflow | BigQuery | Cloud platform | Data Modeling | Database ManagementFlexible work environment | Open office environment | Team building eventsSenior-level Full TimeArizona R14h ago
-
Apache Airflow | BigQuery | Business Intelligence | Cloud platform | Data GovernanceCollaborative open office | Flexible work environment | Team building eventsSenior-level Full TimeConnecticut R14h ago
-
DNS | FC | Fibre Channel | Isilon | LinuxRemote work | Unlimited growthSenior-level Full TimeUnited States, United States R16h ago
-
AI Application Developer USD 119K-258KAPI Design | API Management | Azure Blob | Azure Blob Storage | Azure CognitiveHybrid work environment | Training and knowledge transferSenior-level Contract Full TimeHouston, TX, United States16h ago
-
Research Scientist – TikTok Recommendation(NextGen LLM) - Global Frontier Tech Recruitment Program - 2027 Start (PhD) USD 136K-237KAgentic AI | Computer Vision | Deep learning | Language Models | Language ProcessingEntry-level Full TimeSan Jose, California, United States18h ago
-
Senior Engineer, Big Data USD 90K-140KAmbari | Apache HBase | Apache Hive | Apache Impala | Apache KafkaSenior-level Full TimeUnited States18h ago
-
Senior Software Engineer, Generative AI, Ads Safety USD 174K-252KAI Agents | Algorithms | C++ | Computer Vision | Context learningSenior-level Full TimeMountain View, CA, USA19h ago
-
Senior Staff Software Engineer, AI/ML, Security USD 262K-365KAdversarial Machine Learning | Artificial Intelligence | Cloud Architecture | Cloud Computing | Data PrivacySenior-level Full TimeKirkland, WA, USA; Seattle, WA, USA19h ago