Senior Data Engineer (Databricks)
Tasks
- Build batch data pipelines
- Collaborate with stakeholders on technical decisions
- Develop production data solutions
- Implement testing monitoring and production support
- Improve pipeline reliability
- Lead technical design discussions
- Migrate legacy data pipelines to Databricks
- Optimize spark performance
- Participate in on-call rotation
- Support parallel legacy and cloud data environments
- Troubleshoot data pipeline issues
- Tune SQL queries
Perks/Benefits
- 401k match
- Employee awards
- Industry certifications support
- Recognition programs
- Remote or hybrid work
- Substantial PTO
- Training and mentorship
- Tuition reimbursement
Skills/Tech-stack
AI tools | Agile | Apache Spark | Azure Data | Azure Data Factory | Azure DevOps | Azure Synapse | Azure Synapse Analytics | CI/CD | Cosmos DB | Data Factory | Databricks | Delta Lake | Event Hubs | Git | GitHub Copilot | Jenkins | Python | SQL | Synapse Analytics | Teradata
Education
N/A
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R14d ago
-
Explosives Research Experiment Lead USD 146K-222KAerospace Engineering | Bench testing | C++ | Computational modeling | Computer Aided Design401k | Education reimbursement | Flexible schedule | Hybrid work schedule | Relocation assistanceSenior-level Full TimeLivermore, CA, United States R11h ago
-
Machine Learning Engineer USD 80K-90KDeep learning | Evaluation metrics | Generalization | Language Models | Large Language ModelsSenior-level Full TimeFremont, California R12h ago
-
Senior Software Engineer (Storage) - remote in the US USD 100K-150KArgo CD | ArgoCD | Block Storage | CSI | Cluster APISenior-level Full TimeBoston, MA, United States R13h ago
-
Applied AI Lead USD 140K-180KAPI Integration | Agents | Artificial Intelligence | Assistants | Context engineeringEquity package | Health coverage | Remote-first workplace | Unlimited PTOSenior-level Full TimeRemote - United States or Canada R13h ago
-
Principal Applied AI Engineer USD 185K-245KAgent Frameworks | Agent SDK | Anthropic Agent SDK | Context engineering | EvalsSenior-level Full TimeRedesign Health R13h ago
-
AI Forward Deployed Engineer | $120K-$150K + Hybrid + Equity | AI-Based Outage Intelligence Company A USD 120K-150KAI workflows | APIs | Automation | Backend Development | IntegrationDirect impact on company growth | Equity | Hybrid work | Significant ownership | Unlimited PTOMid-level Full TimeKing of Prussia, PA, United States R13h ago
-
Machine Learning Research Engineer USD 200K-330KAWS | Azure | Benchmarking | CUDA | DDP401k match | Dental insurance | Health insurance | Paid time off | Vision insuranceMid-level Full TimeEmeryville, California, United States; Hybrid (2-3 … R15h ago
-
Machine Learning Engineer USD 155K-228KAWS | Airflow | Argo CD | Azure | CI/CDGenerous time off | Healthcare | Paid parental leave | Paid personal time off | Paid sick timeMid-level Full TimeRemote - US R16h ago
-
Senior Software Engineer I - AI Inference Data Plane USD 139K-174KAutoscaling | Continuous batching | Data parallelism | Distributed Systems | GRPCConference reimbursement | Education reimbursement | Employee assistance program | Employee stock purchase program | Equity compensationSenior-level Full TimeAustin R16h ago
-
Senior Engineer, Inference Data Plane USD 139K-174KContinuous batching | Data parallelism | Distributed Systems | GRPC | GoEmployee assistance program | Employee stock purchase program | Equity compensation | Flexible time off | LinkedIn Learning accessSenior-level Full TimeDenver R16h ago
-
Senior Engineer, Inference Data Plane USD 139K-174KContinuous batching | Data parallelism | Distributed Systems | GRPC | GoConference reimbursement | Employee assistance program | Employee stock purchase program | Equity compensation | Flexible time offSenior-level Full TimeBoston R16h ago
-
Senior Software Engineer I - AI Inference Data Plane USD 139K-174KAutoscaling | Continuous batching | Data parallelism | Distributed Systems | GRPCConference reimbursement | Employee assistance program | Employee stock purchase program | Equity compensation | Flexible time offSenior-level Full TimeSan Francisco R16h ago
-
APIs | Artificial Intelligence | Data Engineering | Language Processing | Machine LearningEquity compensation | Health benefitsSenior-level Full TimeSan Mateo, CA, United States R17h ago
-
Sr. Forward Deployed Engineer (FDE) - Retail USD 182K-250KAWS | Apache Spark | Azure | CI/CD | Data EngineeringCustomer-facing role | Travel 20 percent of the timeSenior-level Full TimeRemote - California R17h ago
-
Staff Software Engineer - AI Data Engine USD 172K-229KAWS | Agent systems | Agentic AI | Airflow | C++401k match | Dental insurance | Health savings account | Hybrid work | Life insuranceSenior-level Full TimeBoston, Massachusetts, United States; Las Vegas, … R18h ago
-
Data Scientist II, ML Infrastructure USD 114K-235KApache Airflow | Causal Inference | Code review | Distributed Computing | Feature importanceEntry-level Full TimePalo Alto, CA, US; Remote, US R18h ago
-
Senior Staff Software Engineer, Data USD 235K-300KAccess Control | Amazon Redshift | Apache Airflow | BigQuery | Compliance401k employer match | Cell phone reimbursement | Competitive PTO | Corporate wellness program | Employee resource groupsSenior-level Full TimeUSA Remote R19h ago
-
Mid-Level Data Engineer USD 90K-98KAPI Development | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageContract award contingent | Remote workMid-level Full TimeWork from home, VA, United States R20h ago
-
Senior-level Full TimeWork from home, VA, United States R20h ago
-
Scientific Computing and Data Management SME USD 150K-185KAgile | Data Lifecycle Management | Data Security | Data lifecycle | DevOpsPublic Trust Clearance | Remote work | Security clearance based access | Travel as neededSenior-level Full TimeWork from home, VA, United States R20h ago
-
Sr. Databricks Consultant USD 175K-250KAWS S3 | Apache Spark | Azure Data | Azure Data Lake | CI/CDRemote work | Secret clearance | Travel as neededSenior-level Full TimeWork from home, VA, United States R20h ago
-
Senior-level Full TimeWork from home, VA, United States R20h ago
-
Senior DevOps Engineer (Storage) - remote in the US USD 200K-250KAir-gapped | Argo CD | ArgoCD | Bash | Cluster APIAttend conferences and working groups | Company outings | Hackathons | Professional development and training | Tech talksExecutive-level Full TimeBoston, MA, United States R21h ago
-
AI Engineer USD 150K-210KEvaluation systems | LLM APIs | Language Models | Large Language Models | PostgreSQL401k plan | Flexible time off | Flexible work schedules | Health and wellness benefits | In-person offsitesMid-level Full TimeSan Francisco, CA / Remote (US) R21h ago