Lead Platform Data Engineer
Tasks
- Align teams on shared identifiers
- Build SQL transformations
- Build data inventory
- Build dbt transformations
- Build feature stores
- Build pipelines for AI/ML models
- Build usage analytics pipelines
- Configure CI/CD pipelines
- Create semantic models
- Define data contracts
- Define event schemas
- Design entity relationships
- Design high performance data flows
- Design integration patterns
- Design relational NoSQL Lakehouse models
- Develop Go integrations
- Develop Java integrations
- Develop Python integrations
- Drive data standards adoption
- Enable observability practices
- Enforce data lifecycle policies
- Ensure CCPA compliance
- Ensure GDPR compliance
- Establish and document data topology
- Establish coding standards
- Implement data contract schema registries
- Implement data quality monitoring
- Implement dataops practices
- Implement workflow orchestration
- Mentor data engineers
- Own data architecture
- Perform cost-benefit analysis
- Run peer review processes
- Track data lineage
- Use Infrastructure as Code with CloudFormation
- Use Infrastructure as Code with Terraform
Perks/Benefits
- 401k match
- Coaching and strengths development
- Community involvement
- Employee discounts
- Health, dental, vision insurance
- Tuition reimbursement
- Unlimited PTO
- Work-life balance
Skills/Tech-stack
AI/ML | AWS | Airflow | AsyncAPI | Azure | BigQuery | CCPA | CI/CD | CloudFormation | DBT | Data Architecture | Data Contracts | Data Lineage | Data Lineage Tracking | Data Modeling | Data Quality | Data inventory | Data quality monitoring | Data topology | DataOps | Databricks | Entity Relationship Modeling | Entity relationship | Feature Store | GCP | GDPR | Go | Infrastructure as Code | Java | LLM | Lakehouse Architecture | Lineage Tracking | NoSQL | Observability | OpenAPI | Python | Quality monitoring | Relational databases | Relationship Modeling | SQL | Semantic Modeling | Snowflake | Terraform | Workflow Orchestration | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Senior-level Full TimeOklahoma City3h ago
-
Principal Data Engineer USD 200K-240KAWS | Agentic Workflows | Anomaly Detection | Batch pipelines | CCPA401k plan | Commuter benefits | Flexible vacation | Life insurance | Long-term disabilitySenior-level Full TimeBoulder, Colorado or New York City, … R3h ago
-
Associate AI - Data Scientist / ML Engineer (Azure) USD 46K-110KAzure Container | Azure Container Instances | Azure Data | Azure Data Factory | Azure Data LakeDental insurance | Disability insurance | Employee assistance program | Life insurance | Medical insuranceMid-level Full TimeNashville, TN, US5h ago
-
Staff Software Engineer - AI Research Infrastructure USD 190K-270KBackend Services | C plus plus | CI/CD | Cloud infrastructure | Cluster managementSenior-level Full TimeNew York City, New York; San …6h ago
-
Generative AI Consultant USD 105K-105KAWS | Azure | CI/CD | Deep learning | Docker401k matching | Health insurance | Paid time off | Parental leave | Professional developmentMid-level Full TimeSan Francisco, CA, United States8h ago
-
Applied Scientist - ML/Ai USD 156K-310KComputer Vision | Convolutional Neural Networks | Data Processing | Deep Neural Networks | Deep learning401k | Dental insurance | Life insurance | Medical insurance | Unlimited PTOSenior-level Full TimeMiami, Florida, United States; Office - …9h ago
-
Senior Data Engineer USD 150K-165KAPIs | AWS | Automation | CI/CD | Data Pipelines401k matching | Birthday day off | Fitness stipend | Floating holidays | Health benefitsSenior-level Full TimeUnited States R10h ago
-
Robotics Software Engineer - Manufacturing Automation USD 140K-153KAI | Bazel | C++ | GRPC | KubernetesBonus | Equity | Health insurance | Paid time off | Performance bonusSenior-level Full TimeMountain View, California12h ago
-
Computer Vision Engineer USD 166K-220K3D Reconstruction | C++ | Camera Calibration | Camera systems | Computer VisionSenior-level Full TimeSeattle, Washington, United States13h ago
-
AWS | Agent systems | Apache Spark | Azure | Cloud platformConference speaking opportunities | Performance bonus eligibility | Remote work eligibilitySenior-level Full TimeUnited States13h ago
-
Manufacturing Master Data Engineer USD 90K-112KBills of Material | Cause analysis | Change Management | Compliance | Data Cleansing401k matching | Cross training | Dental insurance | Medical insurance | On-the-job trainingMid-level Full TimeWichita, KS, United States14h ago
-
Senior Data Engineer USD 95K-135KAWS | Airflow | C++ | Cassandra | Cloud platform401k matching | Community service days | Dental insurance | Disability benefits | Fertility and adoption benefitsSenior-level Full TimeChicago, IL R14h ago
-
Senior Data Engineer USD 95K-135KAWS | Airflow | C++ | Cassandra | Cloud platform401k matching | Community service days | Dental insurance | Disability benefits | Fertility and adoption benefitsSenior-level Full TimeDenver, CO R14h ago
-
Senior Data Engineer USD 137K-170KAWS | Airflow | Apache Spark | Azure | C++401k matching | Community service days | Dental insurance | Disability benefits | Fertility and adoption benefitsSenior-level Full TimeHouston, TX R14h ago
-
Senior Data Engineer USD 137K-170KAWS | Airflow | Apache Spark | C plus plus | Cassandra401k matching | Community service days | Dental insurance | Disability benefits | Fertility and adoption benefitsSenior-level Full TimeDallas, TX R14h ago
-
Forward-Deployed Data Scientist II USD 98K-183KAirflow | CI/CD | CatBoost | Cloud platform | Code DocumentationFlexible paid time off | Health, dental, vision insurance | Hybrid work | Learning stipend | Parental leaveMid-level Full TimeSan Francisco14h ago
-
Forward-Deployed Data Scientist II USD 98K-183KAirflow | CI/CD | CatBoost | Cloud platform | Code reviewDisability insurance | Donation matching | Employee resource groups | Employee stock purchase plan | Fertility benefitsMid-level Full TimeAustin14h ago
-
Forward-Deployed Data Scientist II USD 98K-183KAirflow | CatBoost | Data integration | ETL | GCPEmployee stock purchase plan | Flexible paid time off | Health, dental, vision insurance | Learning stipend | Parental leaveMid-level Full TimeChicago14h ago
-
Forward-Deployed Data Scientist II USD 98K-183KAPIs | Airflow | CI/CD | CatBoost | Cloud platformEmployee stock purchase plan | Equal Paid Parental Leave | Flexible paid time off | Health, dental, vision benefits | Hybrid workMid-level Full TimeNew York City14h ago
-
Senior Data Engineer USD 150K-180KAWS | Apache Airflow | Azure | CI/CD | Data Modeling401k | Commuter benefits | Company holidays | Dental insurance | Health insuranceSenior-level Full TimeNew York, NY14h ago
-
AI | AWS | Agile | Architecture Design | CI/CDHybrid work | Onsite 3 days per week | W2 employmentSenior-level Contract Full TimeIrvine, CA, United States R15h ago
-
Senior Data Engineer USD 155K-180KAWS | Agile | Azure | Bash | Data Lakes401k savings plan | Commuter and parking tax savings benefit | Dental insurance | Employee assistance plan | Group medical insuranceSenior-level Full TimeBoston, United States15h ago
-
Lead Machine Learning Engineer USD 220K-270KC plus plus | C# | CUDA | Camera processing | Data ProcessingDental insurance | Dependent Care Account | Disability insurance | Flexible spending account | Flexible vacationSenior-level Full TimeAnn Arbor, MI16h ago
-
Senior Data Engineer USD 160K-220KAWS | Airflow | Amazon DMS | Amazon EKS | Amazon Glue4 days in office | 401k plan | Bonus plans | Healthcare benefits | Life insuranceSenior-level Full TimeLos Angeles, California, United States16h ago
-
Senior-level Full TimeSeattle, Washington, United States16h ago