Sr. Databricks Consultant - DHS Public Trust
Work from home, VA, United States
USD 175K-250K Senior-level Full Time
Tasks
- Build data pipelines for advanced analytics and machine learning
- Collaborate with stakeholders to deliver datasets and insights
- Design ETL/ELT pipelines in Databricks
- Implement data governance, security, and compliance
- Integrate Databricks with cloud platforms
- Manage Databricks environments for production analytics
- Optimize model training pipelines
- Optimize workflows and clusters for performance and cost
- Troubleshoot data infrastructure issues
Perks/Benefits
Skills/Tech-stack
AWS S3 | Agile | Amazon Kinesis | Apache Spark | Azure Data | Azure Data Lake | Azure Event | Azure Event Hubs | Azure Resource | Azure Resource Manager | CI/CD | Cloud Storage | CloudFormation | Compliance | Data Governance | Data Lake | Data Lakehouse | Data Modeling | Data Quality | Data Security | Databricks | Databricks Machine Learning | Delta Lake | DevOps | ELT | ETL | Event Hubs | FedRAMP | Git | Google Cloud | Google Cloud Storage | HIPAA | Infrastructure as Code | Kafka | Looker | MLOps | MLflow | Machine Learning | Performance Tuning | Power BI | Project Management | Python | Resource manager | SOC 2 | SQL | Streaming | Tableau | Terraform | Unity Catalog | “as-code”
Education
Related jobs
-
AWS | Automated testing | Big Data | Cloud Native | Code reviewSenior-level Full TimePlano, TX, United States1h ago
-
Business Analysis | Data Analysis | Data Modeling | Market Research | Metric developmentEntry-level Full TimeLos Angeles, California, United States2h ago
-
LLM & Agentic AI Machine Learning Software Engineer, TikTok - Content Ecology Local Services USD 145K-355KAI Agents | Causal Inference | Computer Vision | Conversion Rate | Conversion rate optimizationSenior-level Full TimeSan Jose, California, United States2h ago
-
Data Engineer Intern (E-commerce) - 2027 Summer USD 80K-90KApache Spark | ClickHouse | Data Modeling | ETL | FlinkDevelopment workshops | Industry exposure | Learning programs | Social eventsEntry-level InternshipSan Jose, California, United States2h ago
-
Senior Research Scientist/Software Engineer, LLM/Agent Platform (TikTok-Content Ecology AI Innovation & Platform) USD 160K-230KCUDA | Deep learning | DeepSpeed ZeRO | Distributed Systems | Evaluation FrameworksSenior-level Full TimeSan Jose, California, United States2h ago
-
Senior data engineer (Python) con inglés USD 57K-73KAgile | Alerting | Azure | CI/CD | Clean CodeCertifications | Online training platformSenior-level Full TimeMadrid, MD, Spain2h ago
-
Software Engineer, Databases (Technical Leadership) USD 161K-258KAI | Agent Orchestration | Automated Performance Tuning | Consensus Protocols | Data IntegritySenior-level Full TimeBellevue, WA | Menlo Park, CA2h ago
-
Research Engineer, AGI Safety and Alignment, DeepMind USD 174K-252KAdversarial Training | Fine Tuning | Language Processing | Machine Learning | Model InterpretabilityMid-level Full TimeSan Francisco, CA, USA; Mountain View, …3h ago
-
Software Engineer III, AI/ML Engineer USD 147K-210KAgentic Workflows | Alerting | Artificial Intelligence | Backend Development | Backend ServicesSenior-level Full TimeAtlanta, GA, USA; San Jose, CA, …3h ago
-
Data Engineer, Google Maps USD 106K-150KApache Spark | ArcGIS | Business Intelligence | Cloud platform | Data AnalysisMid-level Full TimeMountain View, CA, USA3h ago
-
Senior Software Engineer, AI/ML GenAI, YouTube USD 174K-252KC++ | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA3h ago
-
Tax Data Systems and Process Analyst USD 116K-166KAPI Integration | Data Warehouse | GRPC | Java | JavaScriptMid-level Full TimeChicago, IL, USA3h ago
-
Research Engineer, Gemini Code Post-training, DeepMind USD 174K-252KBenchmarking | Data Curation | Data Generation | Distributed Training | Evaluation benchmarksMid-level Full TimeMountain View, CA, USA3h ago
-
Machine Learning Co-Op (Fall 2026) USD 87K-124KDAX | Data Quality | Data Visualization | Deep learning | ForecastingNone Full TimeCanton, OH, United States3h ago
-
Sr. Systems Engineer - AI USD 98K-139KAI/ML | Alerting | Auto Scaling | Automation | Backup TechnologiesSenior-level Full TimeKansas City, KS, United States3h ago
-
Sr. Data Engineer - AI USD 99K-139KApache Airflow | Azure Data | Azure Data Factory | CI/CD | Data FactorySenior-level Full TimeKansas City, KS, United States3h ago
-
Bare Metal | Battery Management | Battery Management System | C# | C++401k match | Employee assistance program | Life insurance | Long-term disability | Paid time offSenior-level Full TimeRochester, NY, United States4h ago
-
Embedded Software Engineer - Energy Systems USD 73K-94KARM | Bare Metal | C plus plus | C# | CAN401k match | Dental insurance | Employee assistance program | Life insurance | Long-term disabilityEntry-level Full TimeRochester, NY, United States4h ago
-
Data Platform Engineer-Solutions Delivery USD 119K-160KAPI Development | API Management | Azure API | Azure API Management | Azure Functions401k match | Company holidays | Dental insurance | Employee discount | Medical insuranceSenior-level Full TimeMerriam, KS, United States4h ago
-
Senior Machine Learning Engineer USD 149K-224KAIOps | AWS | Apache Spark | Cloud platform | Data Analysis401k match | Career growth opportunities | Dental insurance | Employee resource groups | Flexible paid time offSenior-level Full TimeRemote, United States4h ago
-
Senior Data Engineer USD 120K-175K.Net Core | .Net Framework | AWS CloudFormation | Apache Airflow | Azure401k match | Career growth opportunities | Dental insurance | Employee resource groups | Life insuranceSenior-level Full TimeRemote, United States4h ago
-
Sr. Data and AI Engineer USD 180K-200KAPI Development | AWS | Agentic AI | Agile | Apache NiFiHybrid work | Public trust clearance supportSenior-level Full TimeARLINGTON, VA, United States4h ago
-
Mid-Level Data Engineer USD 90K-115KAPI Development | Azure | Azure Data | Azure Data Factory | Azure Data LakePublic trust clearance support | Remote workMid-level Full TimeWork from home, VA, United States4h ago
-
Data Engineer USD 145K-160KAWS Glue | AWS IAM | Apache Airflow | Apache Kafka | Apache SparkHybrid remote work | Public Trust eligibility requiredMid-level Full TimeFAIRFAX, VA, United States4h ago
-
Sr. Databricks Consultant - Secret Clearance USD 175K-250KAWS S3 | Agile | Amazon Kinesis | Apache Kafka | Apache SparkSenior-level Full TimeWork from home, VA, United States4h ago