Lead Data Engineer
Tasks
- Build ingestion framework
- Design automated data platform operations
- Develop self-service tools
- Drive continuous improvement through automation
- Ensure data reliability and integrity
- Improve cost efficiency
- Lead Data platform architecture
- Monitor performance and resolve issues
- Operate Databricks platform
- Optimize enterprise data lake
- Partner with data governance and delivery teams
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Glue | AWS Lambda | Amazon ECS | Amazon EventBridge | Apache Airflow | Apache Kafka | Apache Spark | CI/CD | Databricks | Delta | Delta Lake | Git | GitLab | Infrastructure as Code | Python | SQL | Terraform | “as-code”
Education
N/A
Roles
Data Engineer | Data Platform | Data Platform Engineer | Engineer | Lead | Lead Data | Lead Data Engineer | Platform Engineer
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R15d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R29d ago
-
.NET | AWS | Agile | Angular | AzureSenior-level Full TimeGilbert, Arizona, United States; Lake Mary, …3h ago
-
Agent Development | Agent Orchestration | Air-gapped | Air-gapped systems | Cloud ComputingOn-site work | Travel opportunitySenior-level Full TimeWashington D.C., DC, USA; Fort Meade, …4h ago
-
Data Modeling | Database querying | Deep learning | Incrementality testing | Language ProcessingMid-level Full TimeNew York, NY, USA; Mountain View, …4h ago
-
Benchmarking | Computer Vision | Data Mining | Deep learning | Evaluation protocolsSenior-level Full TimeMountain View, CA, USA4h ago
-
Staff Software Engineer USD 110K-165KAWS | Airflow | Automated testing | Bedrock | CI/CDHealth insurance | Paid time off | Retirement contributionsSenior-level Full TimeSt. Louis, Missouri, US, 63103-23559h ago
-
Applied AI Engineer, Investments USD 134K-183KAPIs | Cloud Computing | Data Pipelines | Data Quality | Data ValidationEmployer 401k match | Family forming benefits funding | Hybrid work onsite at least 60 percent of the time | Paid time off | Relocation supportNone Full TimeRedwood City, CA (Hybrid) R15h ago
-
Software Engineer, SDLC Analytics USD 175K-300KApache Airflow | Apache Spark | Data Modeling | Data Pipelines | Database technologiesSenior-level Full TimeCupertino; San Diego15h ago
-
Software Engineer, SDLC Analytics USD 175K-300KApache Airflow | Apache Spark | CI/CD | Data Ingestion | Data ModelingSenior-level Full TimeCupertino; San Diego15h ago
-
Applied AI Engineer, GTM Growth Engineering USD 230K-385KAPIs | Data Modeling | Data Pipelines | Evaluation | ExperimentationMid-level Full TimeSan Francisco15h ago
-
Staff Software Engineer, Code RL USD 405K-625KAPI Design | Async Programming | Client Libraries | Concurrency | ContainerizationSenior-level Full TimeSan Francisco, CA | New York …15h ago
-
Edge Computing AI Engineer USD 100K-150KC++ | DSP Toolchains | Device optimization | Device security | Edge inferenceMid-level Full TimeUnited States - Remote R15h ago
-
Generative AI Engineer USD 100K-150KBenchmarks | Dataset Construction | Direct Preference Optimization | Distributed Training | EvaluationCareer growth | Remote workMid-level Full TimeUnited States - Remote R15h ago
-
Big Data Engineer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Hudi | Apache IcebergRemote workSenior-level Full TimeUnited States - Remote R15h ago
-
Streaming Data Engineer USD 100K-150KACLs | AWS MSK | Ansible | Apache Flink | Apache KafkaRemote workSenior-level Full TimeUnited States - Remote R15h ago
-
Machine Learning Data Engineer USD 100K-150KApache Beam | Apache Spark | CI/CD | Code review | Data LineageRemote workSenior-level Full TimeUnited States - Remote R15h ago
-
Machine Learning Infrastructure Engineer USD 100K-150KAutoscaling | Batching | C++ | Caching | Capacity PlanningSenior-level Full TimeUnited States - Remote R15h ago
-
Senior-level Full TimeUnited States - Remote R15h ago
-
Robotics Engineer USD 100K-150KC++ | Concurrent programming | Control | Gazebo | Isaac SimCareer growth | Mentorship | Remote workSenior-level Full TimeUnited States - Remote R15h ago
-
Staff Software Engineer - Infrastructure, Data Platform USD 260K-350KApache Kafka | Apache Spark | Cloud infrastructure | Data Processing | Data Streaming401k matching | Collaborative work environment | Employee stock purchase plan | Hybrid work schedule | Medical, dental & vision coverageSenior-level Full TimeSan Francisco, California, United States15h ago
-
Staff Software Engineer- Foundation Model Inference USD 190K-265KCI/CD | Cloud Native | Cloud-native infrastructure | Distributed Systems | GPU OrchestrationSenior-level Full TimeSan Francisco, California16h ago
-
Senior Engineer, AI Engineering (R5450) USD 123K-216KAPI Design | API Integration | Access Control | Agents | Audit LoggingSenior-level Full TimeUnited States16h ago
-
Senior Engineer, AI Engineering (R5459) USD 137K-237KAI Governance | API Design | APIs | Access Control | Agents401k matching | Dental insurance | Health insurance | Paid time off | Relocation assistanceSenior-level Full TimeUnited States16h ago
-
Data Engineer USD 112K-160KAWS | Airflow | Azure | CI Pipeline | CI/CD401k match | Family leave | Legal insurance | Life insurance | Medical, dental, vision plansMid-level Full TimeSanta Monica, CA, United States16h ago