Lead Platform Data Engineer
Tasks
- Align teams on shared identifiers
- Build SQL transformations
- Build data inventory
- Build dbt transformations
- Build feature stores
- Build pipelines for AI/ML models
- Build usage analytics pipelines
- Configure CI/CD pipelines
- Create semantic models
- Define data contracts
- Define event schemas
- Design entity relationships
- Design high performance data flows
- Design integration patterns
- Design relational NoSQL Lakehouse models
- Develop Go integrations
- Develop Java integrations
- Develop Python integrations
- Drive data standards adoption
- Enable observability practices
- Enforce data lifecycle policies
- Ensure CCPA compliance
- Ensure GDPR compliance
- Establish and document data topology
- Establish coding standards
- Implement data contract schema registries
- Implement data quality monitoring
- Implement dataops practices
- Implement workflow orchestration
- Mentor data engineers
- Own data architecture
- Perform cost-benefit analysis
- Run peer review processes
- Track data lineage
- Use Infrastructure as Code with CloudFormation
- Use Infrastructure as Code with Terraform
Perks/Benefits
- 401k match
- Coaching and strengths development
- Community involvement
- Employee discounts
- Health, dental, vision insurance
- Tuition reimbursement
- Unlimited PTO
- Work-life balance
Skills/Tech-stack
AI/ML | AWS | Airflow | AsyncAPI | Azure | BigQuery | CCPA | CI/CD | CloudFormation | DBT | Data Architecture | Data Contracts | Data Lineage | Data Lineage Tracking | Data Modeling | Data Quality | Data inventory | Data quality monitoring | Data topology | DataOps | Databricks | Entity Relationship Modeling | Entity relationship | Feature Store | GCP | GDPR | Go | Infrastructure as Code | Java | LLM | Lakehouse Architecture | Lineage Tracking | NoSQL | Observability | OpenAPI | Python | Quality monitoring | Relational databases | Relationship Modeling | SQL | Semantic Modeling | Snowflake | Terraform | Workflow Orchestration | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Senior Software Engineer, AI/ML, Google Public Sector USD 174K-252KAlgorithms | C++ | Cloud Object Storage | Data Structures | Distributed ComputingSenior-level Full TimeReston, VA, USA1h ago
-
C++ | Data Mining | Data Processing | Deep learning | Few-Shot LearningSenior-level Full TimeMountain View, CA, USA1h ago
-
Software Engineer III, AI/ML, Google Ads USD 147K-211KC++ | Data Processing | Debugging | Information Retrieval | Language ProcessingSenior-level Full TimeMountain View, CA, USA1h ago
-
Senior Staff Data Engineer USD 123K-185KAPI | Automated testing | Cloud platform | Data Analysis | Data GovernanceDental insurance | Health care | Paid time off | Retirement plan | Sick leaveSenior-level Full TimeResidence Based, Residence Based, US4h ago
-
Business Intelligence | Customer Experience | Customer Journey | Customer Journey Analytics | Customer experience analyticsMid-level Full TimePlainsboro, NJ, US4h ago
-
ML Engineer USD 190K-320KCost Optimization | Data Versioning | Dataset Operations | Dataset curation | Eval Frameworks401k matching | Dental insurance | Employee assistance program | Health insurance | Stock optionsSenior-level Full TimeSan Francisco6h ago
-
Senior-level Full TimeOklahoma City8h ago
-
Data Engineer USD 105K-115KBig Data | Cloud Computing | Data Modeling | Data Pipelines | Data StorageActive secret clearanceMid-level Full TimeSan Diego, CA, US8h ago
-
Principal Data Engineer USD 200K-240KAWS | Agentic Workflows | Anomaly Detection | Batch pipelines | CCPA401k plan | Commuter benefits | Flexible vacation | Life insurance | Long-term disabilitySenior-level Full TimeBoulder, Colorado or New York City, … R8h ago
-
Associate AI - Data Scientist / ML Engineer (Azure) USD 46K-110KAzure Container | Azure Container Instances | Azure Data | Azure Data Factory | Azure Data LakeDental insurance | Disability insurance | Employee assistance program | Life insurance | Medical insuranceMid-level Full TimeNashville, TN, US10h ago
-
Staff Machine Learning Engineer USD 159K-309KAWS | Airflow | Apache Spark | BigQuery | Cloud platform401k plan with company match | Commuter benefits | Disability coverage | Electric Car Charging Station | Employee assistance programSenior-level Full TimeMountain View, USA11h ago
-
Staff Machine Learning Engineer USD 152K-261KAWS | Airflow | Apache Spark | BigQuery | Cloud platform401k plan with company match | Commuter benefits | Disability insurance | Electric Car Charging Station | Employee assistance programSenior-level Full TimeMountain View, USA11h ago
-
Staff Machine Learning Engineer USD 142K-309KAWS | Deep learning | Information Retrieval | Machine Learning | Statistical modeling401k plan with company match | Electric Car Charging Station | Employee assistance program | Flexible spending accounts | Health savings accountSenior-level Full TimeMountain View, USA11h ago
-
Staff Software Engineer - AI Research Infrastructure USD 190K-270KBackend Services | C plus plus | CI/CD | Cloud infrastructure | Cluster managementSenior-level Full TimeNew York City, New York; San …12h ago
-
Senior AI Solutions Engineer, Enterprise Knowledge Work USD 260K-325KAgentic Systems | Dspy | Evaluation | LLM orchestration | LanggraphCollaborative culture | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States; …12h ago
-
Senior AI Solutions Engineer, Software Engineering USD 260K-325KAgentic Software | Agentic Software Engineering | Agentic Workflows | Benchmarking | Code generationCollaborative culture | Five days per week | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States; …12h ago
-
Analytics Solutions Lead, Pharma USD 142K-284KData Manipulation | Data Visualization | Excel | Executive Presentations | Healthcare AnalyticsOn-site workSenior-level Full TimeNew York City, NY12h ago
-
Principal, AI Platform Engineer USD 125K-187KAWS | Azure | CI/CD | Data leakage | Deterministic executionSenior-level Full TimeAtlanta, Georgia, US United States, 3034012h ago
-
AI Engineer USD 100K-143KAPI Development | AWS | Automation | Azure | Cloud platform401k | Dental insurance | Disability insurance | EAP | Gym reimbursementMid-level Full TimeOcala, Florida, United States12h ago
-
Generative AI Consultant USD 105K-105KAWS | Azure | CI/CD | Deep learning | Docker401k matching | Health insurance | Paid time off | Parental leave | Professional developmentMid-level Full TimeSan Francisco, CA, United States13h ago
-
Robotics Integration Engineer USD 170K-250KAutomation | Behavior Trees | C++ | Control Systems | GitMid-level Full TimeSan Jose, CA14h ago
-
Applied Scientist - ML/Ai USD 156K-310KComputer Vision | Convolutional Neural Networks | Data Processing | Deep Neural Networks | Deep learning401k | Dental insurance | Life insurance | Medical insurance | Unlimited PTOSenior-level Full TimeMiami, Florida, United States; Office - …15h ago
-
Astrodynamics | C++ | Conjunction analysis | Embedded Systems | Estimation TheorySenior-level Full TimeChantilly, VA or Aurora, CO15h ago
-
AI Engineer USD 150K-250KAPI Integration | Agents | Data integration | Debugging | Evaluation401k | Dental insurance | Health insurance | Vision insuranceMid-level Full TimeSan Francisco15h ago
-
Internal Systems Engineer (Applied AI) USD 140K-160KAgentic Workflows | CI/CD | DAG | Freshdesk | Gitbook401k | Catered lunch | Flexible PTO | Flexible spending accounts | Great coffeeEntry-level Full TimeColumbus15h ago