Lead Software Engineer - Databricks, ML, AWS
Plano, TX, United States
USD 177K-215K (estimate) Senior-level Full Time
Tasks
- Build reusable libraries frameworks and APIs
- Design secure data ingestion and transformation frameworks
- Drive AI assisted engineering adoption
- Drive Spark performance engineering
- Enforce data quality, lineage, and governance
- Establish lakehouse patterns with Delta Lake
- Implement CI/CD for data projects
- Lead architecture and delivery of data pipelines
- Orchestrate jobs with Databricks Workflows
- Own Databricks cluster strategy and setup
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS EMR | Airflow | Apache Spark | CI/CD | Databricks | Delta Lake | Delta Live Tables | Delta Live) | Git | JUnit | Java | Pytest | Python | SQL | Structured Streaming | Terraform | Unity Catalog
Education
N/A
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R16d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R29d ago
-
Computer Scientist V - Senior Software Systems Engineer USD 140K-190KAgile | Artificial Intelligence | C# | C++ | Cloud Platforms401k match | Dental insurance | Disability insurance | Flexible spending account | Health insuranceSenior-level Full TimeEdwards AFB, CA, United States6h ago
-
Senior-level Full TimeOrlando, FL, United States7h ago
-
AI Center | AI orchestration | Action Center | Agile | AuthenticationMid-level ContractNashville, United States R9h ago
-
Senior-level Full TimeAtlanta, Georgia10h ago
-
.NET | AWS | Agile | Angular | AzureSenior-level Full TimeGilbert, Arizona, United States; Lake Mary, …11h ago
-
Agent Development | Agent Orchestration | Air-gapped | Air-gapped systems | Cloud ComputingOn-site work | Travel opportunitySenior-level Full TimeWashington D.C., DC, USA; Fort Meade, …12h ago
-
Data Modeling | Database querying | Deep learning | Incrementality testing | Language ProcessingMid-level Full TimeNew York, NY, USA; Mountain View, …12h ago
-
Benchmarking | Computer Vision | Data Mining | Deep learning | Evaluation protocolsSenior-level Full TimeMountain View, CA, USA12h ago
-
Staff Software Engineer USD 110K-165KAWS | Airflow | Automated testing | Bedrock | CI/CDHealth insurance | Paid time off | Retirement contributionsSenior-level Full TimeSt. Louis, Missouri, US, 63103-235517h ago
-
Applied AI Engineer, Investments USD 134K-183KAPIs | Cloud Computing | Data Pipelines | Data Quality | Data ValidationEmployer 401k match | Family forming benefits funding | Hybrid work onsite at least 60 percent of the time | Paid time off | Relocation supportNone Full TimeRedwood City, CA (Hybrid) R23h ago
-
Software Engineer, SDLC Analytics USD 175K-300KApache Airflow | Apache Spark | Data Modeling | Data Pipelines | Database technologiesSenior-level Full TimeCupertino; San Diego23h ago
-
Software Engineer, SDLC Analytics USD 175K-300KApache Airflow | Apache Spark | CI/CD | Data Ingestion | Data ModelingSenior-level Full TimeCupertino; San Diego23h ago
-
Applied AI Engineer, GTM Growth Engineering USD 230K-385KAPIs | Data Modeling | Data Pipelines | Evaluation | ExperimentationMid-level Full TimeSan Francisco23h ago
-
Staff Software Engineer, Code RL USD 405K-625KAPI Design | Async Programming | Client Libraries | Concurrency | ContainerizationSenior-level Full TimeSan Francisco, CA | New York …23h ago
-
Edge Computing AI Engineer USD 100K-150KC++ | DSP Toolchains | Device optimization | Device security | Edge inferenceMid-level Full TimeUnited States - Remote R23h ago
-
Generative AI Engineer USD 100K-150KBenchmarks | Dataset Construction | Direct Preference Optimization | Distributed Training | EvaluationCareer growth | Remote workMid-level Full TimeUnited States - Remote R23h ago
-
Big Data Engineer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Hudi | Apache IcebergRemote workSenior-level Full TimeUnited States - Remote R23h ago
-
Streaming Data Engineer USD 100K-150KACLs | AWS MSK | Ansible | Apache Flink | Apache KafkaRemote workSenior-level Full TimeUnited States - Remote R23h ago
-
Machine Learning Data Engineer USD 100K-150KApache Beam | Apache Spark | CI/CD | Code review | Data LineageRemote workSenior-level Full TimeUnited States - Remote R23h ago
-
Machine Learning Infrastructure Engineer USD 100K-150KAutoscaling | Batching | C++ | Caching | Capacity PlanningSenior-level Full TimeUnited States - Remote R23h ago
-
Senior-level Full TimeUnited States - Remote R23h ago
-
Robotics Engineer USD 100K-150KC++ | Concurrent programming | Control | Gazebo | Isaac SimCareer growth | Mentorship | Remote workSenior-level Full TimeUnited States - Remote R23h ago
-
AI Optimization Engineer USD 100K-150KC plus plus | CUDA | Compiler optimization | Cutlass | Deep learningRemote workSenior-level Full TimeUnited States - Remote R23h ago