Lead Platform Data Engineer
Tasks
- Align teams on shared identifiers
- Build SQL transformations
- Build data inventory
- Build dbt transformations
- Build feature stores
- Build pipelines for AI/ML models
- Build usage analytics pipelines
- Configure CI/CD pipelines
- Create semantic models
- Define data contracts
- Define event schemas
- Design entity relationships
- Design high performance data flows
- Design integration patterns
- Design relational NoSQL Lakehouse models
- Develop Go integrations
- Develop Java integrations
- Develop Python integrations
- Drive data standards adoption
- Enable observability practices
- Enforce data lifecycle policies
- Ensure CCPA compliance
- Ensure GDPR compliance
- Establish and document data topology
- Establish coding standards
- Implement data contract schema registries
- Implement data quality monitoring
- Implement dataops practices
- Implement workflow orchestration
- Mentor data engineers
- Own data architecture
- Perform cost-benefit analysis
- Run peer review processes
- Track data lineage
- Use Infrastructure as Code with CloudFormation
- Use Infrastructure as Code with Terraform
Perks/Benefits
- 401k match
- Coaching and strengths development
- Community involvement
- Employee discounts
- Health, dental, vision insurance
- Tuition reimbursement
- Unlimited PTO
- Work-life balance
Skills/Tech-stack
AI/ML | AWS | Airflow | AsyncAPI | Azure | BigQuery | CCPA | CI/CD | CloudFormation | DBT | Data Architecture | Data Contracts | Data Lineage | Data Lineage Tracking | Data Modeling | Data Quality | Data inventory | Data quality monitoring | Data topology | DataOps | Databricks | Entity Relationship Modeling | Entity relationship | Feature Store | GCP | GDPR | Go | Infrastructure as Code | Java | LLM | Lakehouse Architecture | Lineage Tracking | NoSQL | Observability | OpenAPI | Python | Quality monitoring | Relational databases | Relationship Modeling | SQL | Semantic Modeling | Snowflake | Terraform | Workflow Orchestration | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Automation Testing | CI/CD | CSS | Cypress | Feature DevelopmentMedical, dental & vision coverage | Paid time off | Parental leave | Reimbursement programs | Retirement planMid-levelRaleigh, United States R11d ago
-
Senior-level Full TimeSalem, NH, United States5h ago
-
Senior-level Full TimeNew York, NY, United States5h ago
-
Sr. Java Full Stack Developer USD 103K-173KAPI Design | AWS | Ansible | Automated testing | BenchmarkingSenior-level Full TimeDallas, Texas, United States10h ago
-
Grid Analytics Researcher USD 86K-134KAPIs | Anomaly Detection | CAISO | Capacity expansion | Capacity expansion modeling401k employer match | Accident insurance | Commuter benefits | Education assistance | Fitness subsidyMid-level Full TimeHOUSTON(USA), HOUSTON, United States / US10h ago
-
LLM Post-Training Engineer, Research & Product USD 212K-389KData Pipelines | Deep learning | Distributed Training | Human preference learning | Instruction TuningSenior-level Full TimeSan Jose, California, United States10h ago
-
AI Specialist - Product and Applied Research USD 178K-235KArtificial Intelligence | C++ | Computer Vision | Data Mining | Data RegressionMid-level Full TimeMenlo Park, CA | New York, …11h ago
-
Image Processing Engineer USD 141K-203KASIC | C++ | Co-design | Computational imaging | Computer VisionSenior-level Full TimeSunnyvale, CA11h ago
-
QA Engineering Lead, AI Native USD 134K-158KAccuracy testing | Adversarial Testing | Analytics | Automation coverage | Automation frameworksSenior-level Full TimeMenlo Park, CA11h ago
-
Senior Software Engineer, AI/ML, AI and Infrastructure USD 174K-252KC++ | Data Processing | Debugging | Language Processing | ML InfrastructureSenior-level Full TimeSunnyvale, CA, USA11h ago
-
Software Engineer III, AI/ML, Google Workspace USD 147K-211KC++ | Data Processing | Debugging | Language Processing | ML InfrastructureSenior-level Full TimeSunnyvale, CA, USA11h ago
-
Software Engineer III, AI/ML GenAI, Google Cloud Compute USD 147K-211KAudio generation | C++ | Cloud platform | Data Preparation | Data ProcessingSenior-level Full TimeKirkland, WA, USA11h ago
-
Senior Software Engineer, AI/ML, Google Cloud Compute USD 174K-252KC++ | Data Processing | Debugging | Distributed Computing | Language ProcessingSenior-level Full TimeSunnyvale, CA, USA11h ago
-
Senior Software Engineer, AI/ML GenAI, Search USD 174K-252KAlgorithms | C++ | Code review | Computer Vision | Data ProcessingSenior-level Full TimeMountain View, CA, USA11h ago
-
Senior Software Engineer, AI/ML GenAI, Google Play USD 174K-252KC++ | Computer Vision | Data Processing | Data Storage | DebuggingSenior-level Full TimeMountain View, CA, USA11h ago
-
Software Engineer, BigQuery AI/ML USD 147K-211KArtificial Intelligence | BigQuery | C plus plus | Cloud platform | Compute TechnologiesMid-level Full TimeKirkland, WA, USA11h ago
-
Software Engineer III, AI/ML, AI and Infrastructure USD 147K-211KAlgorithms | C++ | Data Processing | Data Structures | DebuggingSenior-level Full TimeSunnyvale, CA, USA11h ago
-
Software Engineer, Cloud AI, Agent Infrastructure USD 147K-211KAgent Orchestration | C++ | Cloud platform | Data Processing | Data StorageMid-level Full TimeSunnyvale, CA, USA11h ago
-
Artificial Intelligence | C plus plus | C# | Computer Vision | Data PipelinesMid-level Full TimeNew York, NY, USA; Mountain View, …11h ago
-
Lead Data Engineer - IT USD 105K-152KApache Spark | BW/4HANA | Business Data Cloud | CDS Views | Data GovernanceAdoption Assistance | Education assistance | Health and life insurance | Paid time off | Peer recognitionSenior-level Full TimeLibertyville, IL, US, 60048-378116h ago
-
Robotics Test & Data Engineer, Mapping USD 70K-300K3D Point Cloud Processing | 3D point cloud | Bash | Cloud processing | Cloud validationMid-level Full TimeIrvine, CA19h ago
-
Senior-level Full TimeSan Francisco, US19h ago
-
Senior-level Full TimeUSA - Atlanta, GA; USA - …21h ago
-
Product Marketing Lead, GenAI USD 154K-193KAI/ML | AI/ML Fundamentals | Community building | Competitive Intelligence | Content StrategyCommuter stipend | Comprehensive health, dental and vision coverage | Generous PTO | Learning and development stipend | Retirement benefitsSenior-level Full TimeSan Francisco, CA; New York, NY21h ago
-
Senior Software Engineer - System Optimization USD 119K-258KBenchmarking | C# | C++ | Debugging | Distributed SystemsSenior-level Full TimeMountain View, CA, US; Redmond, WA, …21h ago