Sr Databricks Engineer
(DEAI DS) US Dallas TX, United States
USD 180K-248K (estimate) Senior-level Full Time
Tasks
- Architect ETL/ELT pipelines
- Build real-time streaming solutions
- Configure optimize cluster performance and cost
- Create solution proposals architectural diagrams implementation strategies
- Define and implement Databricks data governance standards
- Define data models storage strategies integration patterns
- Design data architectures using Databricks Lakehouse Platform
- Ensure compliance with security frameworks
- Evaluate integrations with Delta Live Tables MLflow Unity Catalog streaming frameworks
- Implement access control data lineage cataloging and data quality
- Implement workspace governance
- Lead design workshops with engineering and stakeholders
- Monitor audit and manage data quality
- Perform code reviews and mentor data engineers
- Provide best practices frameworks reusable component designs
- Recommend modernization and optimization opportunities
- Stay updated on Databricks features roadmap and industry trends
- Support pre sales discovery with technical input
- Translate business requirements into technical solutions
Perks/Benefits
- Advanced training
- Certification support
- Flexible work arrangements
- Life balance
- Professional growth opportunities
Skills/Tech-stack
AWS | Azure | Azure DevOps | CI/CD | Databricks | Delta Lake | Delta Live Tables | Delta Live) | ELT | ETL | EventHub | GCP | GitHub Actions | Jenkins | Kafka | Kinesis | MLflow | Python | SQL | Spark | Structured Streaming | Unity Catalog
Education
N/A
Related jobs
-
Data Engineer USD 100K-115KCrystal Reports | Data Visualization | Data Warehouse | Data integration | ETL401k matching | Critical illness insurance | Dental insurance | Employee discount | Flexible spending accountMid-level Full TimeRomeoville, IL, United States2h ago
-
Access Control | Always On | Always On Availability | Always On Availability Groups | Auditing401k savings plan | Dental insurance | Health insurance | Long-term disability | On the job training providedMid-level Full TimePeoria, AZ, United States3h ago
-
Lead Business Intelligence Engineer USD 92K-140KAgile | Azure | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeWestchester, IL, United States3h ago
-
Analytics | Data Analysis | Data Modeling | Data Pipelines | Data WarehousingEntry-level Full Time Internship TemporaryBlue Bell, PA, United States4h ago
-
Senior-level Full TimeColumbus, GA, United States4h ago
-
Intelligent Systems Engineer II USD 98K-166KAPIs | AWS | Artificial Intelligence | Automated testing | Backend Development401k match | Community service day | Dental insurance | Flexible spending accounts | Life insuranceMid-level Full TimeWest Chester, OH, United States5h ago
-
Senior Data Integration Engineer USD 130K-160KAutomation | CSV | Data Quality | Data Validation | Data integrationTS SCI with Polygraph clearanceSenior-level Full TimeAnnapolis Junction, Maryland; Hanover, MD; Hanover, …7h ago
-
Automated Speech Recognition | CI/CD | CUDA | Computer Vision | Containerization401k matching | Company events | Dental coverage | Flexible work schedules | Internet reimbursementSenior-level Full TimeAnnapolis Junction, MD R7h ago
-
Big Data | Data Pipelines | Data cleaning | MAPE | Machine LearningMid-level Full TimeNewark, NJ, United States8h ago
-
4G | 5G | Automation | Network Analysis | Network TroubleshootingEducational assistance | Paid Holidays | Paid vacation | Sick leave | Stock purchase planMid-level Full TimePlano,Texas,United States R8h ago
-
Senior AI & Automation Engineer USD 82K-120KAgile | Azure Data | Azure Data Factory | Azure Dataverse | CopilotAbility to work independently | Contract 6 months or more | Hybrid work (3 days onsite)Senior-level ContractDeerfield Beach, United States8h ago
-
Data Engineer II USD 84K-140KAgile | Amazon Redshift | Apache Airflow | CI/CD | Cloud ComputingMentorship | Professional developmentMid-level Full TimeBaltimore, Maryland, United States; McLean, Virginia, …9h ago
-
Access Control | Alteryx | Amazon Redshift | Apache Iceberg | CDMPDiscretionary annual incentive program | Hybrid work model | Training and developmentSenior-level Full TimeAustin, Texas, United States; Dallas, Texas, …9h ago
-
Databricks Senior Consultant USD 124K-207KBusiness Intelligence | Data Governance | Data Ingestion | Data Quality | Data TransformationMentorship | Professional development | TravelSenior-level Full TimeRosslyn, Virginia, United States; Washington, District …9h ago
-
Databricks Engineering Consultant USD 97K-162KApache Spark | Data Governance | Data Lineage | Databricks | ELTMentorship programs | Professional development | Travel opportunitiesMid-level Full TimeRosslyn, Virginia, United States; Washington, District …9h ago
-
Sr Lead Software Engineer - Java, Python, AI/ML USD 170K-189KAWS | Algorithms | Auto-GPT | Automated testing | Cause analysisSenior-level Full TimeJersey City, NJ, United States9h ago
-
Senior LLM Engineer USD 195K-255KAI Foundry | AI Search | Azure AI | Azure AI Foundry | Azure AI SearchSenior-level Full TimeAustin, Texas | Fremont, California | …10h ago
-
Mid-level Full TimeUS-Georgia-Augusta10h ago
-
Automation | C# | C++ | CPU Utilization | Capacity PlanningDevelopment workshops | Hands-on learning opportunities | Industry exposure | Mentorship | Social eventsEntry-level InternshipSan Jose, California, United States11h ago
-
Machine Learning Engineer Graduate (E-Commerce Supply Chain & Logistics - LLM/Agent) - 2027 Start (PhD) USD 137K-246KAgents | Benchmarking | C++ | Deep learning | EvaluationEntry-level Full TimeSan Jose, California, United States11h ago
-
Machine Learning Engineer Graduate (E-Commerce Supply Chain & Logistics - LLM/Agent) - 2027 Start (PhD) USD 137K-246KAI Feedback | Agents | Benchmarking | C++ | DPOEntry-level Full TimeSeattle, Washington, United States11h ago
-
Agent evaluation | Classification | Clustering | Data Mining | Deep learningEntry-level Full TimeSeattle, Washington, United States11h ago
-
Apache Flink | Apache Hive | Apache Spark | Batch Processing | C++Entry-level Full TimeSan Jose, California, United States11h ago
-
Classification | Clustering | Data Mining | Deep learning | E-commerceEntry-level Full TimeSan Jose, California, United States11h ago
-
AI Workflow Orchestration | AI workflow | CD pipeline | CI Pipeline | CI/CDMid-level Full TimeSeattle, Washington, United States11h ago