Sr. Databricks Consultant - Top Secret Clearance
Tasks
- Build and manage data pipelines
- Collaborate with stakeholders to deliver datasets and insights
- Deploy data lakehouse analytics and models
- Design ETL/ELT pipelines in Databricks
- Implement CI/CD with Git
- Implement data governance security compliance
- Integrate Databricks with AWS Azure or GCP
- Optimize Databricks workflows clusters for performance cost
- Support machine learning pipeline workflows with MLflow
- Troubleshoot data platform issues
Perks/Benefits
- N/A
Skills/Tech-stack
ARM | AWS S3 | Amazon Kinesis | Apache Spark | Azure Data | Azure Data Lake | Azure Event | Azure Event Hubs | CI/CD | Cloud Storage | CloudFormation | Data Governance | Data Lake | Data Modeling | Data Quality | Data Security | Databricks | Delta Lake | DevOps | Event Hubs | FedRAMP | Git | Google Cloud | Google Cloud Storage | HIPAA | Kafka | Looker | MLOps | MLflow | Performance Tuning | Power BI | Python | SOC 2 | SQL | Tableau | Terraform | Unity Catalog
Education
Related jobs
-
AWS | Automated testing | Big Data | Cloud Native | Code reviewSenior-level Full TimePlano, TX, United States1h ago
-
Business Analysis | Data Analysis | Data Modeling | Market Research | Metric developmentEntry-level Full TimeLos Angeles, California, United States2h ago
-
LLM & Agentic AI Machine Learning Software Engineer, TikTok - Content Ecology Local Services USD 145K-355KAI Agents | Causal Inference | Computer Vision | Conversion Rate | Conversion rate optimizationSenior-level Full TimeSan Jose, California, United States2h ago
-
Data Engineer Intern (E-commerce) - 2027 Summer USD 80K-90KApache Spark | ClickHouse | Data Modeling | ETL | FlinkDevelopment workshops | Industry exposure | Learning programs | Social eventsEntry-level InternshipSan Jose, California, United States2h ago
-
Senior Research Scientist/Software Engineer, LLM/Agent Platform (TikTok-Content Ecology AI Innovation & Platform) USD 160K-230KCUDA | Deep learning | DeepSpeed ZeRO | Distributed Systems | Evaluation FrameworksSenior-level Full TimeSan Jose, California, United States2h ago
-
Senior data engineer (Python) con inglés USD 57K-73KAgile | Alerting | Azure | CI/CD | Clean CodeCertifications | Online training platformSenior-level Full TimeMadrid, MD, Spain2h ago
-
Software Engineer, Databases (Technical Leadership) USD 161K-258KAI | Agent Orchestration | Automated Performance Tuning | Consensus Protocols | Data IntegritySenior-level Full TimeBellevue, WA | Menlo Park, CA2h ago
-
Software Engineer III, AI/ML Engineer USD 147K-210KAgentic Workflows | Alerting | Artificial Intelligence | Backend Development | Backend ServicesSenior-level Full TimeAtlanta, GA, USA; San Jose, CA, …3h ago
-
Data Engineer, Google Maps USD 106K-150KApache Spark | ArcGIS | Business Intelligence | Cloud platform | Data AnalysisMid-level Full TimeMountain View, CA, USA3h ago
-
Senior Software Engineer, AI/ML GenAI, YouTube USD 174K-252KC++ | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA3h ago
-
Tax Data Systems and Process Analyst USD 116K-166KAPI Integration | Data Warehouse | GRPC | Java | JavaScriptMid-level Full TimeChicago, IL, USA3h ago
-
Machine Learning Co-Op (Fall 2026) USD 87K-124KDAX | Data Quality | Data Visualization | Deep learning | ForecastingNone Full TimeCanton, OH, United States3h ago
-
Sr. Systems Engineer - AI USD 98K-139KAI/ML | Alerting | Auto Scaling | Automation | Backup TechnologiesSenior-level Full TimeKansas City, KS, United States3h ago
-
Sr. Data Engineer - AI USD 99K-139KApache Airflow | Azure Data | Azure Data Factory | CI/CD | Data FactorySenior-level Full TimeKansas City, KS, United States3h ago
-
Bare Metal | Battery Management | Battery Management System | C# | C++401k match | Employee assistance program | Life insurance | Long-term disability | Paid time offSenior-level Full TimeRochester, NY, United States4h ago
-
Embedded Software Engineer - Energy Systems USD 73K-94KARM | Bare Metal | C plus plus | C# | CAN401k match | Dental insurance | Employee assistance program | Life insurance | Long-term disabilityEntry-level Full TimeRochester, NY, United States4h ago
-
Data Platform Engineer-Solutions Delivery USD 119K-160KAPI Development | API Management | Azure API | Azure API Management | Azure Functions401k match | Company holidays | Dental insurance | Employee discount | Medical insuranceSenior-level Full TimeMerriam, KS, United States4h ago
-
Senior Machine Learning Engineer USD 149K-224KAIOps | AWS | Apache Spark | Cloud platform | Data Analysis401k match | Career growth opportunities | Dental insurance | Employee resource groups | Flexible paid time offSenior-level Full TimeRemote, United States4h ago
-
Senior Data Engineer USD 120K-175K.Net Core | .Net Framework | AWS CloudFormation | Apache Airflow | Azure401k match | Career growth opportunities | Dental insurance | Employee resource groups | Life insuranceSenior-level Full TimeRemote, United States4h ago
-
Sr. Data and AI Engineer USD 180K-200KAPI Development | AWS | Agentic AI | Agile | Apache NiFiHybrid work | Public trust clearance supportSenior-level Full TimeARLINGTON, VA, United States4h ago
-
Mid-Level Data Engineer USD 90K-115KAPI Development | Azure | Azure Data | Azure Data Factory | Azure Data LakePublic trust clearance support | Remote workMid-level Full TimeWork from home, VA, United States4h ago
-
Data Engineer USD 145K-160KAWS Glue | AWS IAM | Apache Airflow | Apache Kafka | Apache SparkHybrid remote work | Public Trust eligibility requiredMid-level Full TimeFAIRFAX, VA, United States4h ago
-
Sr. Databricks Consultant - Secret Clearance USD 175K-250KAWS S3 | Agile | Amazon Kinesis | Apache Kafka | Apache SparkSenior-level Full TimeWork from home, VA, United States4h ago
-
AI Model Developer USD 125K-150KAWS | Angular | Azure | CI/CD | D3.jsHybrid remote onsite work | Public trust clearance support | Secret clearance supportMid-level Full TimeFAIRFAX, VA, United States4h ago
-
Senior Databricks Migration Engineer USD 130K-158KActive Directory | Azure Active Directory | Column-Level Security | Data Quality | Data SkippingSenior-level Full TimeArlington, VA, United States4h ago