Databricks Data Engineer
Manassas, VA, United States
USD 150K-215K (estimate) Mid-level Full Time
Tasks
- Automate CI/CD workflows
- Build data pipelines
- Create feature pipelines
- Deploy data pipelines
- Deploy model scoring pipelines
- Design data pipelines
- Develop Delta Lake datasets
- Document architecture and runbooks
- Enable fine grained access control
- Evaluate machine learning models
- Implement batch pipelines
- Implement data governance
- Implement data quality validation
- Implement model monitoring
- Implement schema evolution
- Implement streaming pipelines
- Maintain data pipelines
- Modernize SSIS logic to Databricks
- Optimize pipeline performance
- Train machine learning models
Perks/Benefits
- 401k
- Dental insurance
- Disability insurance
- Health insurance
- Life insurance
- Paid time off
- Profit sharing
- Vision insurance
- Wellness benefits
Skills/Tech-stack
Automated retraining | Azure Databricks | Azure DevOps | Azure Key Vault | Batch Processing | CI/CD | Caching | Data Quality | Data Validation | Databricks Model Registry | Databricks Workflows | Delta Lake | Delta Live Tables | Delta Live) | Drift Detection | Git | GitHub Actions | Key Vault | Lineage | MLOps | MLflow | Machine Learning | Model Drift | Model Drift Detection | Model Monitoring | Model Registry | Observability | Pandas | Partitioning | Photon | PySpark | Python | SQL | Stored Procedures | Streaming | Time Travel | Unity Catalog | Z-ordering
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
AI | Algorithms | Android | Audio codecs | Board SupportSenior-level Full TimeCambridge, MA, USA2h ago
-
Architectural components | C plus plus | CSS | Convolutional Neural Networks | Generative AISenior-level Full TimeSan Francisco, CA, USA; Sunnyvale, CA, …2h ago
-
Staff Research Engineer, Gemini Audio, DeepMind USD 207K-300KData Preparation | Machine Learning | Model Evaluation | Model Training | Multimodal modelingSenior-level Full TimeMountain View, CA, USA; New York, …2h ago
-
C++ | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA; Pittsburgh, PA, …2h ago
-
BigQuery | Cloud platform | Data Processing | Data Warehousing | DebuggingSenior-level Full TimeKirkland, WA, USA2h ago
-
Senior Software Engineer, AI/ML, Google Cloud USD 174K-252KC++ | Code review | Data Processing | Data Structures | Data structures algorithmsSenior-level Full TimeKirkland, WA, USA2h ago
-
Software Engineer III, AI/ML, Google Cloud Storage USD 147K-211KArtificial Intelligence | C++ | Cloud Object Storage | Cloud Storage | Code reviewSenior-level Full TimeSeattle, WA, USA; Sunnyvale, CA, USA2h ago
-
Senior Software Engineer - Production Control Plane USD 200K-287KAmazon Web Services | Azure | C++ | CI/CD | Cloud platformSenior-level Full TimeUS-CA-Menlo Park11h ago
-
Staff Systems Analyst – Robotic Algorithms and Control USD 147K-201KC# | C++ | Classical control | Control System | Control system designSenior-level Full TimeSunnyvale, CA, United States11h ago
-
Associate AI/ML Engineer USD 100K-215KAzure Data | Azure Data Lake | Azure Machine Learning | Azure Synapse | Azure Synapse AnalyticsHealthcare benefits | Hybrid work environmentMid-level Full TimeColumbia, MD, US11h ago
-
Mid-level Full TimeMentor, OH, US12h ago
-
AI Search | AWS | Azure | Azure AI | Azure AI Search401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States13h ago
-
Machine Learning Engineer, Discovery Recommendations USD 157K-230KA/B | A/B Testing | AWS | Apache Spark | B testing401k match | Dental insurance | Health insurance | Life insurance | Long-term disabilityMid-level Full TimeCary,North Carolina,United States13h ago
-
API | Angular | C# | C++ | Celery401k retirement plan | Company shuttles | Dental insurance | Employee stock purchase plan | Life insuranceSenior-level Full TimeRedmond, WA15h ago
-
Data Modeling | Deep learning | Ecommerce | Fine Tuning | Human-in-the-loopEquity | Health benefits | Hybrid work flexibility | Remote work up to 4 weeks per yearSenior-level Full TimeSan Francisco, CA R15h ago
-
Deployment Engineer - Commercial Site Team USD 120K-180KConfluence | Industrial Automation | Jira | Linux | Project ManagementCustomer site work experience | Travel opportunitiesMid-level Full TimeReno, NV15h ago
-
Software Engineer – Surgical Robot Manufacturing USD 125K-192KHTML | JSON | JavaScript | Linux | MATLABMid-level Full TimeSunnyvale, CA, United States15h ago
-
Senior Data Engineer USD 115K-145KAWS S3 | Airflow | Azure Blob | Azure Blob Storage | Blob Storage401k | Dental insurance | Discounts | Medical insurance | Paid leaveSenior-level Full TimeNew York, NEW YORK, United States R15h ago
-
Senior Software Engineer, GenAI Platform USD 164K-259KAgent Engineering | Architectural Design | Backend Development | Code review | Language Models401k match | Backup child elder and pet care | Community time off stipend | Company-paid days off | Dental insuranceSenior-level Full TimeSan Francisco, CA, USA15h ago
-
Robotics ML Expert, AI USD 60K-60KControl Systems | Dm_control | Domain Randomization | Gymnasium Robotics | JAXAsync collaboration | Flexible schedule | Remote workSenior-level Full TimeMiami R15h ago
-
BI Data Engineer (Remote WA, OR, ID & CA) USD 88K-116KAzure Synapse | C# | DAX | Data Governance | Data Modeling401k match | Health insurance | Paid Holidays | Paid vacation | Sick timeMid-level Full TimeBellevue, Washington R15h ago
-
AWS | Airflow | Amazon S3 | Artificial Intelligence | Cloud ComputingCareer progression | Collaborative environment | Ongoing learningExecutive-level Full TimeDallas, Texas, United States15h ago
-
Senior ML Engineer USD 198K-291K3D Vision | AWS | Agile | Cloud ML | Computer Vision401k | Dental insurance | Health insurance | Mental health program | Paid breaksSenior-level Full TimeCary,North Carolina,United States15h ago
-
Artificial Intelligence | Confluence | Dashboards | Electronic Hardware | Electronic Hardware ValidationBenefits package | Flexible schedule | MentorshipEntry-level ContractFoster City, CA15h ago
-
Senior-level Full TimeUS-CA-Menlo Park16h ago