Data Engineering Team Lead
Tasks
- Aggregate features using Scala
- Build feature store for machine learning
- Build real time bidding data infrastructure
- Conduct code reviews
- Coordinate with infrastructure team on DAG execution
- Create Spark pipelines for ML inference
- Design scalable data pipelines
- Develop data quality observability frameworks
- Enforce data privacy and security policies
- Implement automated data testing and validation
- Lead data engineering teams
- Manage data pipeline lifecycle
- Monitor global production deployments
- Orchestrate workflows with Apache Airflow
- Partner with executives on machine learning roadmaps
- Troubleshoot distributed system incidents
Perks/Benefits
- Dental insurance
- Health insurance
- Learning and training
- Medical benefits
- Travel opportunities
- Vision insurance
Skills/Tech-stack
AWS | Amazon Athena | Amazon EC2 | Amazon EMR | Amazon S3 | Apache Airflow | Apache Spark | Bash | Batch Processing | Cause analysis | Data Governance | Data Observability | Data Privacy | Data Quality | Data Security | Distributed Systems | Docker | Feature Store | Git | Jenkins | Jira | Kubernetes | MySQL | Python | Redis | Root Cause Analysis | Root cause | SQL | Scala | Streaming Data
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Featured Feat. Applied AI Engineer - Bay Area USD 211K-263KArtificial Intelligence | C plus plus | C# | Embeddings | Feature Engineering401k | Comprehensive health and wellness benefits | Learning and development opportunities | Unlimited time offMid-level Full TimeHQ (San Francisco)24d ago
-
Senior Agentic AI Engineer GBP 80K-100KAgentic AI | BrightScript | C plus plus | Evaluation | Function CallingFinancial wellness resources | Flexible remote work Fridays | Hybrid work arrangement | Mental health supportSenior-level Full TimeCambridge, United Kingdom R4h ago
-
Full Stack Software Engineer USD 150K-220KAPIs | Cloud | Distributed Systems | Embeddings | JavaScriptMid-level Full TimeRemote (US) R4h ago
-
Principal Scientist, Machine Learning - Biomolecules USD 208K-286KAWS Batch | AWS ECS | AWS EKS | AWS S3 | AWS SageMakerAnnual incentive program | Healthcare coverage | Retirement benefitsSenior-level Full TimeCambridge, MA USA6h ago
-
Staff Machine Learning Engineer L5 INR 2520K-3500KAWS | Algorithms | Apache Airflow | Azure | Data StructuresSenior-level Full TimeGurugram, India6h ago
-
Principal AI Engineer INR 2000K-4500KAPI Integration | AWS Bedrock | Agent Orchestration | CI/CD | Deep learningSenior-level Full TimeBangalore, KA, IN8h ago
-
Data Engineer Data Pipelines and ETL USD 99K-147KAnomaly Detection | Apache Airflow | CDC | Cloud Composer | Data Governance401k plan | Disability benefits | Life insurance | Life insurance coverage | Medical/Dental/VisionMid-level Full TimeBurbank, CA, US, 915058h ago
-
Sr. Software Engineer, Data Streaming Systems USD 130K-195KAutoscaling | Blocking I/O | CI/CD | Concurrency | Distributed Systems401k plan | Dental insurance | Disability benefits | Life insurance | Medical insuranceSenior-level Full TimeBurbank, CA, US, 915058h ago
-
Senior-level Full TimeToronto, Canada R8h ago
-
Manager, AI Engineering USD 122K-152KAI Act | AI RMF | Agent Frameworks | Bias Testing | Data Lineage401k match | Business travel coverage | Dental insurance | Disability insurance | Employee assistance programMid-level Full TimePrinceton, New Jersey, United States; San … R8h ago
-
Senior Data Engineer - Data & AI AUD 102K-120KAWS | CI | CI/CD | DevOps | NLPConference access | Corporate discounts and vouchers | Generous parental leave | Home office setup support | Hybrid workSenior-level Full TimeBrisbane, Australia8h ago
-
Senior Data Engineer - Data & AI AUD 102K-120KAWS | CI/CD | Data Governance | Data Pipelines | Data QualityCommunity leave | Conferences and study assistance | Corporate discounts and vouchers | Home office stipend | Hybrid workSenior-level Full TimeSydney, Australia9h ago
-
Senior Data Engineer - Data & AI AUD 102K-120KCI/CD | Clean Code | Data Governance | Data Quality | Data pipelineConferences | Corporate discounts | Home office support | Hybrid workplace | In-house trainingSenior-level Full TimeMelbourne, Australia9h ago
-
Data Engineer MXN 1040K-1300KAWS Glue | AWS Step Functions | Agile | Amazon Athena | Amazon S3AI learning paths | Company-provided equipment | English lessons | Flexible working options | Learning opportunitiesSenior-level Full TimeGuadalajara, Jal., Mexico9h ago
-
Staff AI/ML Engineer USD 240K-270KAWS | Agentic Workflows | Azure | Data Curation | Deep learning401k | Commuter benefits | Dog-friendly office | Equity | FSA benefitsSenior-level Full TimeNew York City, NY9h ago
-
Staff AI/ML Engineer USD 240K-270KAWS | Agentic Workflows | Cloud platform | Deep learning | Foundation Models401k | Commuter benefits | Dog-friendly office | Equity | Flexible spending accountSenior-level Full TimeSan Francisco, CA9h ago
-
Senior AI/ML Engineer USD 240K-270KAWS | Agentic Workflows | Azure | Data Curation | Deep learning401k | Commuter benefits | Dog-friendly office | Equity | FSA benefitsSenior-level Full TimeNew York City, NY9h ago
-
Senior AI/ML Engineer USD 240K-270KAWS | Agentic Workflows | Artificial Intelligence | Azure | Cloud infrastructure401k | Commuter benefits | Dog-friendly office | Equity | Flexible spending accountSenior-level Full TimeSan Francisco, CA9h ago
-
Senior Software Engineer, Logging & Experiments CAD 176K-200KCloud Native | Cloud-native infrastructure | Design Documentation | Distributed Systems | ExperimentationCareer coaching and support | In-office culinary options | Inclusive family building benefits | Long term savings or retirement plans | Mental health wellness and fitness benefitsSenior-level Full TimeVancouver, BC R10h ago
-
Associate Director, Business Analytics USD 110K-135KAttribution | Audience Analytics | Digital optimization | Healthcare Analytics | Incrementality testing401k plan | Dental coverage | Disability coverage | Employee discount | Employee stock purchase programMid-level Full TimeNew York, New York, United States10h ago
-
Senior-level Full TimeUnited States10h ago
-
AWS | Anthropic API | CI/CD | Django | Django RESTHands-on learning | MentorshipEntry-level Contract Full TimeBuenos Aires10h ago
-
Embedded Device Firmware Engineer USD 145K-195KAutomated testing | C# | C++ | CI/CD | Circuit debuggingMid-level Full TimeSanta Clara, CA11h ago
-
大数据开发(数据挖掘、数据测试、java) CNY 25K-37KApache Kafka | Apache Spark | Data Mining | Data Modeling | Data WarehousingMid-level Full Time保定11h ago
-
Project Management Specialist - AI Products USD 83K-124KComputer Vision | Confluence | Figma | Generative AI | Human-Computer InteractionEntry-level Full Time Internship底特律11h ago