Lead Data Engineer
Tasks
- Build reusable data engineering components and frameworks
- Conduct code reviews and collaborate cross functionally
- Design scalable data pipelines and architectures
- Develop and deploy data products for analytics and AI
- Establish data governance and performance optimization
- Implement CI CD pipelines for deployment and testing
- Mentor junior data engineers and set coding standards
- Monitor troubleshoot and optimize data pipelines
- Translate requirements into technical specifications
Perks/Benefits
- N/A
Skills/Tech-stack
AWS S3 | Amazon Kinesis | Amazon RDS | Apache Spark | CI/CD | Data Governance | Data Modeling | Data Processing | Databricks | Databricks Lakehouse | Databricks Lakehouse Platform | Delta Lake | ELT | ETL | Git | Kafka | Lakehouse platform | PySpark | Real Time | Real-time Data | Real-time Data Processing | SQL
Education
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R16d ago
-
Senior-level Full TimeOrlando, FL, United States3h ago
-
AI Center | AI orchestration | Action Center | Agile | AuthenticationMid-level ContractNashville, United States R5h ago
-
Senior-level Full TimeAtlanta, Georgia6h ago
-
.NET | AWS | Agile | Angular | AzureSenior-level Full TimeGilbert, Arizona, United States; Lake Mary, …6h ago
-
Data Modeling | Database querying | Deep learning | Incrementality testing | Language ProcessingMid-level Full TimeNew York, NY, USA; Mountain View, …8h ago
-
Staff Software Engineer USD 110K-165KAWS | Airflow | Automated testing | Bedrock | CI/CDHealth insurance | Paid time off | Retirement contributionsSenior-level Full TimeSt. Louis, Missouri, US, 63103-235513h ago
-
Software Engineer, SDLC Analytics USD 175K-300KApache Airflow | Apache Spark | Data Modeling | Data Pipelines | Database technologiesSenior-level Full TimeCupertino; San Diego19h ago
-
Software Engineer, SDLC Analytics USD 175K-300KApache Airflow | Apache Spark | CI/CD | Data Ingestion | Data ModelingSenior-level Full TimeCupertino; San Diego19h ago
-
Applied AI Engineer, GTM Growth Engineering USD 230K-385KAPIs | Data Modeling | Data Pipelines | Evaluation | ExperimentationMid-level Full TimeSan Francisco19h ago
-
Staff Software Engineer, Code RL USD 405K-625KAPI Design | Async Programming | Client Libraries | Concurrency | ContainerizationSenior-level Full TimeSan Francisco, CA | New York …19h ago
-
Big Data Engineer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Hudi | Apache IcebergRemote workSenior-level Full TimeUnited States - Remote R19h ago
-
Machine Learning Data Engineer USD 100K-150KApache Beam | Apache Spark | CI/CD | Code review | Data LineageRemote workSenior-level Full TimeUnited States - Remote R19h ago
-
Robotics Engineer USD 100K-150KC++ | Concurrent programming | Control | Gazebo | Isaac SimCareer growth | Mentorship | Remote workSenior-level Full TimeUnited States - Remote R19h ago
-
Staff Software Engineer - Infrastructure, Data Platform USD 260K-350KApache Kafka | Apache Spark | Cloud infrastructure | Data Processing | Data Streaming401k matching | Collaborative work environment | Employee stock purchase plan | Hybrid work schedule | Medical, dental & vision coverageSenior-level Full TimeSan Francisco, California, United States19h ago
-
Staff Software Engineer- Foundation Model Inference USD 190K-265KCI/CD | Cloud Native | Cloud-native infrastructure | Distributed Systems | GPU OrchestrationSenior-level Full TimeSan Francisco, California20h ago
-
Data Engineer USD 112K-160KAWS | Airflow | Azure | CI Pipeline | CI/CD401k match | Family leave | Legal insurance | Life insurance | Medical, dental, vision plansMid-level Full TimeSanta Monica, CA, United States20h ago
-
Software Engineer, Product USD 150K-250KAPI Development | APIs | AWS S3 | Application development | Backend Services401k match | Catered meals | Commuter benefit | Dental insurance | Flexible PTOSenior-level Full TimeSan Francisco21h ago
-
Software Engineer, Fleet Simulation (Core Data Science) USD 160K-226KDispatch) | Distributed Systems | Git | Metrics | MicroservicesMid-level Full TimeFoster City, CA21h ago
-
Senior DataOps Engineer USD 150K-180K800-171 | AWS CloudFormation | AWS Glue | AWS GovCloud | AWS IAMRemote position | US government clearance requiredSenior-level Full TimeRemote - United States R21h ago
-
Senior Data Science Engineer I, Claims USD 170K-190KAWS | Apache Airflow | Automated testing | ClickHouse | Data Modeling401k matching | Disability and life insurance | Flexible working hours | Fully remote work | HSA & FSA optionsSenior-level Full TimeRemote R21h ago
-
Data Engineer USD 95K-129KApache Spark | Business Intelligence | Data Bricks | Data Governance | Data Modeling401k company match | Dental insurance | Employee merchandise discount | Hybrid work environment | Life insuranceMid-level Full TimePlano, TX, United States22h ago
-
Senior AI Engineer, Real-World Data USD 137K-175KAI orchestration | AWS | AWS Fargate | AWS Lambda | AWS S3401k benefits | Commuter benefits | Employee referral program | Fertility care benefits | Free testingSenior-level Full TimeUS Remote R22h ago
-
Senior AI Engineer USD 188K-258KAgentic Systems | Agile | Cloud Architecture | Code review | Configuration ManagementCell phone allowance | Comprehensive health coverage | Equity for every employee | Growth-focused environment | Home office setup allowanceSenior-level Full TimeRemote - US R22h ago
-
Amazon Redshift | Amazon SageMaker | Amazon Web Services | Azure Machine Learning | Azure SynapseDental insurance | Flexible spending account | Health insurance | Paid time off | Stock optionsEntry-level Full TimeUnited States - Remote R22h ago