Lead Data Engineer (Databricks)
Tasks
- Architect for scale and reliability
- Coach through code review and pairing
- Create technical documentation and reference architectures
- Design scalable data pipelines
- Drive dataops practices
- Enforce automated testing pipeline observability and CI CD
- Identify delivery blockers
- Implement lakehouse architectures
- Lead client data engagements
- Manage technical scope and timelines
- Mentor data engineers
- Own architecture and build
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS Redshift | Amazon S3 | Apache Spark | Automated testing | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Synapse | Azure Synapse Analytics | CI/CD | Cloud Storage | Data Factory | Data Lake Storage | Data Modeling | Data Warehousing | Databricks | Databricks Workflows | Delta Lake | ELT | ETL | Google BigQuery | Google Cloud | Google Cloud Storage | Google Dataflow | Infrastructure as Code | Lakehouse Architecture | Observability | Python | Scala | Synapse Analytics | Unity Catalog | Version control | “as-code”
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R14d ago
-
Mid-Level Data Engineer USD 90K-98KAPI Development | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageContract award contingent | Remote workMid-level Full TimeWork from home, VA, United States R9h ago
-
Senior-level Full TimeWork from home, VA, United States R9h ago
-
Sr. Databricks Consultant USD 175K-250KAWS S3 | Apache Spark | Azure Data | Azure Data Lake | CI/CDRemote work | Secret clearance | Travel as neededSenior-level Full TimeWork from home, VA, United States R9h ago
-
Senior-level Full TimeWork from home, VA, United States R9h ago
-
AI Engineer USD 150K-210KEvaluation systems | LLM APIs | Language Models | Large Language Models | PostgreSQL401k plan | Flexible time off | Flexible work schedules | Health and wellness benefits | In-person offsitesMid-level Full TimeSan Francisco, CA / Remote (US) R11h ago
-
Senior DevOps Engineer (Storage) - remote, US/EU USD 202K-290KAir-gapped | Air-gapped environments | Argo CD | ArgoCD | BashConference attendance | Hackathons | Professional development and training | Remote work | Tech talksExecutive-level Full TimeAustin, TX, United States R18h ago
-
AI Engineer USD 113K-180KAngular | Apache Kafka | CI/CD | Context Management | DevOps401k matching | Charitable matching | Community outreach groups | Flexible paid time off | Life insuranceMid-level Full TimeLeawood, KS, US R20h ago
-
Machine Learning Engineer USD 131K-177KAWS | Cassandra | Classification | Cloud Migration | Computer VisionLearning opportunities | Professional development | Work from homeMid-level Full TimeRemote, NY, US R21h ago
-
Senior Data Engineer (DBA) USD 91K-163KAmazon Web Services | Ansible | Azure | Capacity Planning | Cloud platformCareer development | Comprehensive benefits package | On-call rotation | Telecommute flexibilitySenior-level Full TimeHartford, Connecticut, UNITED STATES; REMOTE R1d ago
-
Sr. Data Engineer - Remote USD 91K-163KAzure Data | Azure Data Factory | Batch Processing | CI/CD | Data Factory401k contribution | Comprehensive benefits package | Equity stock purchase | Flexible work schedule | Incentive and recognition programsSenior-level Full TimeLittle Rock, Arkansas, UNITED STATES; REMOTE R1d ago
-
Senior AI ML Software Engineer - Data Platforms - Remote Nationwide or Hybrid in MN or DC USD 120K-214KAI Agents | AWS | Artificial Intelligence | Automated testing | AzureSenior-level Full TimeEden Prairie, Minnesota, UNITED STATES; REMOTE R1d ago
-
NLP Engineer USD 72K-130KArtifactory | Artificial Intelligence | C# | CI/CD | Code review401k contribution | Comprehensive benefits | Equity stock purchase | Incentive and recognition programs | Telecommute OptionsMid-level Full TimeSan Diego, California, UNITED STATES; REMOTE R1d ago
-
Data Engineer USD 86K-165KData Vault | Data Vault 2.0 | Databricks | ETL | Erwin401k match | Dental insurance | Flexible work schedules | Health insurance | Paid time offSenior-level Full TimeUS-AZ-REMOTE, United States R1d ago
-
Senior Data Engineer USD 152K-190KAgile | CI/CD | Confluence | Data Governance | Data Lake401k match | Caregiver leave | Childcare cash | Dental insurance | Flexible spending accountSenior-level Full TimeWork From Home - California, United … R1d ago
-
AWS | Data Ingestion | Data Quality | Data Transformation | Glue401k retirement plan | Healthcare | Leave benefits | Paid time off | Retirement benefitsSenior-level Full TimePrinceton LVL - NJ, United States R1d ago
-
ADA | ARINC 429 | Agile | C# | C++401k matching | Counseling sessions | Dental insurance | Disability coverage | Employee assistance programMid-level Full TimeUS-PR-AGUADILLA-110 ~ Rd 110 N Km … R1d ago
-
Associate Director, Analytical Engineering USD 194K-226KAmazon Web Services | Azure | Classification | Cloud platform | Dash401k retirement plan | Disability insurance | Employee assistance programs | Flexible work schedule | Health insuranceMid-level Full TimePrinceton Pike - NJ, United States R1d ago
-
Senior Data Science Engineer USD 116K-198KApache Airflow | CI/CD | DBT | Databricks | Databricks AutoloaderFlexible work optionsSenior-level Full TimeRemote (United States) R1d ago
-
Senior Embedded Software Engineer - Future Forward USD 134K-201KAuthentication | C# | C++ | CAN | CUDASenior-level Full TimeSunnyvale, CA, United States R1d ago
-
Research Operations, Code USD 130K-250KData pipeline | Experiment design | LLM | Language Processing | Machine LearningDental insurance | Equity grant | Free fitness membership | Health insurance | Housing bonusSenior-level Full TimeSan Francisco R1d ago
-
Data Engineer USD 133K-159KBigQuery | Cloud platform | DBT | Data Governance | Data Ingestion401k match | Employee assistance program | Employee stock purchase program | Family planning support | Flexible vacationMid-level Full TimeSan Francisco, CA R1d ago
-
Senior SoC Power Analysis & Optimization Engineer USD 120K-600KAI workload | AI workload characterization | ASIC | Clock gating | Gate Level Analysis401k match | Company holidays | Flexible spending accounts | Health, dental, vision, and life insurance | Home tech setup reimbursementSenior-level Full TimeMountain View, CA R1d ago
-
Product Engineer – Analytics as a Service USD 65K-120KAI Assisted Development | API Development | AWS | Agile | AnalyticsMid-level Full TimeRochester, NY, United States R1d ago
-
Azure Data Engineer USD 110K-140K3NF | API Management | Agile Scrum | Azure Data | Azure Data Factory401k match | Employee resource group network | Holiday pay | Long-term disability | Medical, dental & vision coverageSenior-level Full TimeUnited States R1d ago