Senior Principal - Databricks Platform Engineering Lead (Python)
Jersey City, NJ, United States
USD 175K-205K (estimate) Senior-level Full Time
Tasks
- Build scalable data pipelines on Databricks
- Conduct code reviews and debugging
- Configure AWS account and networking for platform
- Define engineering strategy and operating standards
- Design infrastructure automation for Databricks control plane
- Develop secure production Python code
- Drive release readiness gating and incident triage
- Implement Delta Sharing onboarding offboarding
- Lead Databricks Spark platform architecture
- Mentor technical teams on software engineering practices
- Provision Databricks workspaces with Terraform
- Troubleshoot performance for distributed workloads
Perks/Benefits
- Backup childcare
- Financial coaching
- Health care coverage
- Mental health support
- Retirement savings plan
- Tuition reimbursement
Skills/Tech-stack
AWS | AWS Lambda | Agile | Apache Spark | Bitbucket | Databricks | Delta Sharing | Distributed Computing | Git | GitHub | GitHub Actions | Jenkins | Jira | Kanban | Maven | PyPI | Python | Scrum | Terraform | Unit Testing
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Entry-level Full Time InternshipWoodridge, IL, United States4h ago
-
Junior/Middle Computer Vision Engineer ID72410 USD 98K-160KCloud Computing | Computer Vision | Image Processing | Machine Learning | Object DetectionEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsEntry-level Full TimeDallas, United States6h ago
-
Senior Computer Vision Engineer ID72408 USD 160K-225KAnomaly Detection | Cameras | Clustering | Computer Vision | Data QualityEducation budget | Exciting projects | Fitness budget | Flexible schedule | MentorshipSenior-level Full TimeDallas, United States6h ago
-
Senior AI Engineer / Data Scientist USD 110K-170KApache Spark | Automated Deployment | CI/CD | Databricks | DockerRemote workSenior-level ContractChandler, United States6h ago
-
Principal Biostatistician USD 100K-148KBiostatistics | Dashboards | Data Governance | Data Infrastructure | Data QualitySenior-level Full TimeUnited States-Massachusetts-Boston-250 Washington Street7h ago
-
IT Data Engineer III USD 117K-124KANSI X12 | ARM Templates | Azure Data | Azure Data Factory | Azure Data LakeProfessional development | Remote workSenior-level Full TimeUS - Remote R8h ago
-
Machine Learning Engineer - Data Recommendation (CapCut) USD 156K-387KA/B | A/B Testing | B testing | Behavior Analysis | Data AnalysisMid-level Full TimeSan Jose, California, United States8h ago
-
Junior AI Engineer USD 100K-120KCI/CD | Document processing | Embeddings | Faiss | Function CallingEntry-level Full TimeNew York, New York, United States9h ago
-
Research Engineer, Computer Vision USD 213K-240KAlgorithms | C++ | Code profiling | Computer Vision | Data ManagementSenior-level Full TimePittsburgh, PA | Burlingame, CA9h ago
-
Data Engineer, Product Analytics USD 184K-235KAI tools | Agent Orchestration | Bias Mitigation | C# | C++Career growthSenior-level Full TimeBellevue, WA | Redmond, WA | … R9h ago
-
Design Technology Co-Optimization Engineer USD 138K-198KCMOS device physics | Datacenter IP blocks | Design Rule Manual | Design rule | Device physicsMid-level Full TimeSunnyvale, CA, USA9h ago
-
Research Quality Assurance Engineer, DeepMind USD 207K-301KC plus plus | CI/CD | Continuous Deployment | Continuous integration | Data PipelinesSenior-level Full TimeMountain View, CA, USA9h ago
-
AI/ML Data Engineer (TS/SCI with Poly Required) USD 164K-274KAPI Management | APIs | Amazon Web Services | Data Pipelines | Distributed SystemsAgile team environment | TS SCI polygraph clearanceMid-level Full TimeChantilly, Virginia, United States10h ago
-
Data Engineer I - Salesforce Data 360 USD 92K-123KAPIs | Access Control | Data Engineering | Data Governance | Data Modeling401k match | Employee resource groups | Flexible PTO | Healthcare premium coverage | Onboarding programMid-level Full TimeMorrisville, NC, US, 2756013h ago
-
Cloud Computing | Data Pipelines | Data Processing | Deep learning | Distributed dataHealth insurance | Other Perquisites | Paid time off | Retirement contributionsMid-level Full TimeBillerica, Massachusetts, US, 0182113h ago
-
Senior AI Software Engineer, Python USD 135K-175KAsync Programming | Azure | Distributed Systems | Error Tracking | Event DrivenFlexible paid time off | Manager check ins via Lattice | Medical dental and vision insurance 100 percent employer paid | Paid cell phone and service | Paid parental leaveSenior-level Full TimeRemote - United States R15h ago
-
Software Engineer - ML/Computer Vision (Battery Sorting) USD 152K-287KAPI Development | Alerting | CI/CD | Computer Vision | HMIEntry-level Full TimeSan Francisco, California, United States15h ago
-
Senior Machine Learning Engineer, Ad Serving USD 195K-510KContinuous Improvement | Experimentation | Feature Engineering | Java | Machine LearningDisability benefits | Equity awards | Financial wellness support | Health insurance | Life insuranceSenior-level Full TimeNew York, New York16h ago
-
Senior Machine Learning Engineer, Ad Serving USD 195K-435KDeep learning | Experimentation | Feature Engineering | Java | Machine LearningDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeBoston, Massachusetts16h ago
-
Senior-level Full TimeAustin, Texas16h ago
-
CAN | DNP3 | Data Visualization | Distributed Logging | DockerSenior-level Full TimeSan Francisco, California, United States17h ago
-
Staff Software Engineer, AI/ML USD 216K-271KAI Feedback | Agentic AI | Data Pipelines | Direct Preference Optimization | Experimentation platformsConference reimbursement | Education reimbursement | Employee assistance program | Employee stock purchase program | Equity compensationSenior-level Full TimeSeattle19h ago
-
AWS | AWS CDK | AWS CodeBuild | AWS CodePipeline | AWS Glue401k | Healthcare benefits | Paid time off | Phone stipend | Wellness benefitsSenior-level Full TimeSan Carlos - Hybrid R19h ago
-
Senior Analytics Engineer USD 140K-175KBusiness Intelligence | DBT | Data Modeling | Data Pipelines | Data WarehousingDental insurance | Equity compensation | Medical insurance | Paid time off | Vision insuranceSenior-level Full TimeSouth San Francisco, California, USA19h ago
-
Fullstack - Data Platform (Autonomy) USD 170K-210KAWS | Amazon RDS | Database Indexing | Django | DocumentDBDental insurance | Equity compensation | Medical insurance | Paid time off | Vision insuranceSenior-level Full TimeSouth San Francisco, California, USA19h ago