Senior Lead Data Engineer (R4680)
San Francisco, California
USD 121K-194K (estimate) Senior-level Full Time
Tasks
- Apply governance controls for compliance
- Architect and implement ELT ETL pipelines
- Build secure automated ingestion frameworks
- Design Medallion Architecture
- Design orchestration and monitoring frameworks
- Develop production-grade data models
- Implement data quality validation and reconciliation
- Mentor engineers and lead engineering standards
- Optimize Microsoft Fabric compute usage
- Productionize ML enabled workflows
Perks/Benefits
- N/A
Skills/Tech-stack
Analytics engineering | Anomaly Detection | Azure Data | Azure Data Factory | Azure Synapse | CI/CD | Data Factory | Data Governance | Data Modeling | Data Quality | Data Reconciliation | Databricks | Dimensional Modeling | ELT | ERP | ETL | FP and A | Feature Engineering | Financial Reporting | Forecasting | GitHub | IAM | Indexing | Lakehouse | Machine Learning | Microsoft Fabric | Model Evaluation | Monitoring | Networking | Orchestration | Partitioning | PySpark | Python | Query folding | SQL | Snowflake | Star Schema | Statistics
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer | Senior Data Engineer
Regions
Countries
States
Related jobs
-
AI Data Platform Lead USD 164K-229KAWS | Airflow | Audit Logging | DBT | Data GovernanceFloating holidays | Wellness daySenior-level Full TimeUnited States2h ago
-
Senior-level Full TimeSan Jose, CA, United States9h ago
-
Senior Machine Learning Engineer - Cybersecurity USD 80K-200KAnomaly Detection | Behavioral analytics | Cyber Threat | Cyber Threat Detection | CybersecuritySenior-level Full TimeSan Jose, CA, United States9h ago
-
Lead AI Engineer - AI & Credit Analytics USD 156K-234KAWS | CI/CD | Data Governance | Generative AI | LLMOpsFlexible time off | Flexible work environment | Hybrid work option | Matching 401k | Medical/Dental/Vision insuranceSenior-level Full TimeCosta Mesa, CA, United States R9h ago
-
Head of AI Advisory / AI Advisory Lead – Private Equity USD 188K-260KAI strategy | Artificial Intelligence | Business value | Business value assessment | Competitive AnalysisExecutive-level Full TimeChicago, IL, United States9h ago
-
Mid-level Full TimeOmaha, NE10h ago
-
Sr. Delivery Acceleration AI Engineer USD 137K-241KA/B | A/B Testing | AI Agents | API Design | Artificial IntelligenceSenior-level Full TimeAtlanta, Georgia , United States11h ago
-
Energy Market Optimization Engineer USD 84K-128KBacktesting | Battery Energy Storage | Data Pipelines | Energy market | Energy market simulationDental insurance | Health insurance | Life insurance | Paid time off | Paid volunteeringMid-level Full TimeBoothwyn, PA, United States12h ago
-
Generative AI Consultant USD 105K-105KAWS | Azure | CI/CD | Chroma | Cloud platform401k match | Flexible spending account | Healthcare coverage | Paid time off | Parental leaveMid-level Full TimeSan Francisco, CA, United States13h ago
-
Mid-level Full TimeKing George, VA, United States15h ago
-
Data Engineer USD 130K-145KApache Spark | CI/CD | Cloud platform | Containerization | Data GovernancePublic trust clearance support | Remote workSenior-level Full TimeWork from home, VA, United States R15h ago
-
Apache Airflow | BigQuery | Cloud platform | Data Governance | Data ModelingFlexible work environment | Open office environment | Remote work | Team building eventsSenior-level Full TimeMinnesota R15h ago
-
Apache Airflow | BigQuery | Cloud platform | Data Governance | Data ModelingCollaborative open office environment | Flexible work environment | Team building eventsMid-level Full TimeMassachusetts R15h ago
-
Apache Airflow | BigQuery | Business Intelligence | Cloud platform | Data GovernanceFlexible work environment | Open office environment | Team building eventsSenior-level Full TimeIdaho R15h ago
-
Apache Airflow | BigQuery | Cloud platform | Data Governance | Data ModelingCollaborative open office environment | Flexible work environment | Remote work | Team building eventsSenior-level Full TimeIllinois R15h ago
-
Apache Airflow | BigQuery | Cloud platform | Data Governance | Data ModelingCollaborative work environment | Flexible work atmosphere | Team building eventsSenior-level Full TimeColumbia R15h ago
-
Apache Airflow | BigQuery | Cloud platform | Data Governance | Data ModelingCollaborative work culture | Flexible work environment | Open office environment | Team building eventsMid-level Full TimeColorado R15h ago
-
Airflow | BigQuery | Cloud platform | Data Governance | Data ModelingCollaborative work culture | Flexible work environment | Team building eventsSenior-level Full TimeFlorida R15h ago
-
Apache Airflow | BigQuery | Business Intelligence | Cloud platform | Data ConsistencyCollaborative work environment | Remote work flexibility | Team building eventsMid-level Full TimeCalifornia R15h ago
-
Airflow | BigQuery | Cloud platform | Data Modeling | Database ManagementFlexible work environment | Open office environment | Team building eventsSenior-level Full TimeArizona R15h ago
-
Apache Airflow | BigQuery | Business Intelligence | Cloud platform | Data GovernanceCollaborative open office | Flexible work environment | Team building eventsSenior-level Full TimeConnecticut R15h ago
-
DNS | FC | Fibre Channel | Isilon | LinuxRemote work | Unlimited growthSenior-level Full TimeUnited States, United States R16h ago
-
AI Application Developer USD 119K-258KAPI Design | API Management | Azure Blob | Azure Blob Storage | Azure CognitiveHybrid work environment | Training and knowledge transferSenior-level Contract Full TimeHouston, TX, United States17h ago
-
Research Scientist – TikTok Recommendation(NextGen LLM) - Global Frontier Tech Recruitment Program - 2027 Start (PhD) USD 136K-237KAgentic AI | Computer Vision | Deep learning | Language Models | Language ProcessingEntry-level Full TimeSan Jose, California, United States19h ago
-
Senior Engineer, Big Data USD 90K-140KAmbari | Apache HBase | Apache Hive | Apache Impala | Apache KafkaSenior-level Full TimeUnited States19h ago