Databricks Data Engineer
Manassas, VA, United States
USD 150K-215K (estimate) Mid-level Full Time
Tasks
- Automate CI/CD workflows
- Build data pipelines
- Create feature pipelines
- Deploy data pipelines
- Deploy model scoring pipelines
- Design data pipelines
- Develop Delta Lake datasets
- Document architecture and runbooks
- Enable fine grained access control
- Evaluate machine learning models
- Implement batch pipelines
- Implement data governance
- Implement data quality validation
- Implement model monitoring
- Implement schema evolution
- Implement streaming pipelines
- Maintain data pipelines
- Modernize SSIS logic to Databricks
- Optimize pipeline performance
- Train machine learning models
Perks/Benefits
- 401k
- Dental insurance
- Disability insurance
- Health insurance
- Life insurance
- Paid time off
- Profit sharing
- Vision insurance
- Wellness benefits
Skills/Tech-stack
Automated retraining | Azure Databricks | Azure DevOps | Azure Key Vault | Batch Processing | CI/CD | Caching | Data Quality | Data Validation | Databricks Model Registry | Databricks Workflows | Delta Lake | Delta Live Tables | Delta Live) | Drift Detection | Git | GitHub Actions | Key Vault | Lineage | MLOps | MLflow | Machine Learning | Model Drift | Model Drift Detection | Model Monitoring | Model Registry | Observability | Pandas | Partitioning | Photon | PySpark | Python | SQL | Stored Procedures | Streaming | Time Travel | Unity Catalog | Z-ordering
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Automation Testing | CI/CD | CSS | Cypress | Feature DevelopmentMedical, dental & vision coverage | Paid time off | Parental leave | Reimbursement programs | Retirement planMid-levelRaleigh, United States R19d ago
-
Senior AI Engineer USD 130K-245KAnomaly Detection | CI/CD | Classification | DataRobot | DatabricksSenior-level Full TimeMorristown, NJ, United States12h ago
-
Adobe Campaign | Automated testing | Azure | Azure Data | Azure Data FactorySenior-level ContractSan Francisco, United States15h ago
-
Software Engineer, Architecture and Infrastructure USD 136K-359KAlgorithm Optimization | Continuous Delivery | Deep learning | Disaster Recovery | Distributed SystemsSenior-level Full TimeSan Jose, California, United States16h ago
-
ANSYS | CAD | Git | NVIDIA Omniverse | PipEntry-level InternshipPennsylvania, Canonsburg16h ago
-
ANSYS Mechanical | Ansys Twin Builder | C++ | Control Systems | DrakeFinancial benefits | Health benefits | Internship program | Remote work | Wellness benefitsEntry-level InternshipCalifornia, US (California) Off-Site16h ago
-
Software Engineer, Data License Monitoring & Resiliency USD 160K-240KAIOps | Anomaly Detection | C# | C++ | Capacity Planning401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceMid-level Full TimeNew York16h ago
-
Senior Software Engineer - Data & Analytics Federation USD 160K-240KApache Arrow | Asynchronous frameworks | C++ | Distributed Systems | Linux401k match | Dental insurance | Life insurance | Medical insurance | Paid HolidaysSenior-level Full TimeNew York16h ago
-
API Design | Agentic Workflows | C plus plus | Code review | Context ManagementSenior-level Full TimeRedmond, WA17h ago
-
Business Engineer, Business AI USD 147K-203KAgent Orchestration | Agentic AI | Agile | Bias Mitigation | Context engineeringCross-functional collaboration | Mentorship | Travel opportunitySenior-level Full TimeMenlo Park, CA | Seattle, WA …17h ago
-
Data Engineer, Product Analytics USD 192K-235KCompliance | Data Privacy | Data Quality | Data Security | Data WarehousingSenior-level Full TimeMenlo Park, CA17h ago
-
Data Engineer USD 185K-196KData Modeling | Data Warehousing | Dimensional Modeling | ETL | Object-OrientedMid-level Full TimeMenlo Park, CA17h ago
-
Data Engineer USD 183K-203KAnomaly Detection | Data Drift | Data Quality | Data Visualization | Feature DriftEntry-level Full TimeMenlo Park, CA18h ago
-
Data Engineer USD 185K-196KC++ | Data Migration | Data Modeling | Data Warehousing | Dimensional dataMid-level Full TimeMenlo Park, CA18h ago
-
Software Engineer, Compiling, Quantum AI USD 147K-211KC++ | Classical coding theory | Coding theory | Compiler architecture | Compiler designMid-level Full TimeLos Angeles, CA, USA; Mountain View, …18h ago
-
C++ | Data Processing | Debugging | Information Retrieval | Language ModelsSenior-level Full TimeMountain View, CA, USA18h ago
-
Senior Staff Software Engineer, AI/ML, IAM USD 262K-365KAccess Control | Access Management | Authentication | Authorization | C++Senior-level Full TimeSan Francisco, CA, USA; Seattle, WA, …18h ago
-
Algorithms | C++ | Capacity Planning | Code Reviews | Data StructuresSenior-level Full TimeSeattle, WA, USA18h ago
-
Staff Software Engineer, AI/ML GenAI, Google Cloud USD 207K-300KComputer Vision | Data Preparation | Data Processing | Distributed Systems | Fine TuningSenior-level Full TimeSunnyvale, CA, USA; San Francisco, CA, …18h ago
-
Senior Software Engineer, Google Cloud AI USD 174K-252KArtificial Intelligence | C++ | Data Structures | Data Structures and Algorithms | Design and ArchitectureSenior-level Full TimeSunnyvale, CA, USA18h ago
-
Senior Staff Software Engineer, AI/ML, Google Cloud USD 262K-365KAlgorithms | Data Processing | Data Structures | Debugging | Distributed SystemsSenior-level Full TimeSunnyvale, CA, USA18h ago
-
AI Engineer/ Forward Deployed Engineer USD 115K-160KAPI Integration | Artificial Intelligence | Cloud Platforms | Cloud platform | Containerization401k matching | Basic life insurance | Dental insurance | Disability coverage | Medical insuranceMid-level Full TimeNew York, NY, US21h ago
-
Lead SAP Data Engineer - IT USD 105K-152KCDS Views | Data Governance | Data Lineage | Data Modeling | Data PipelinesAdoption Assistance | Education assistance | Health and life insurance | Paid Holidays | Paid time offSenior-level Full TimeLibertyville, IL, US, 60048-378122h ago
-
A/B | A/B Testing | B testing | C++ | Content Understanding401k match | Commuter benefits | Disability insurance | Life insurance | Medical/Dental/Vision insuranceSenior-level Full TimeSunnyvale, CA1d ago
-
Forward Deployed AI Engineer/Data Scientist USD 78K-195KA/B | A/B Testing | B testing | Chatbot Platforms | Clustering401k matching | Basic life insurance | Employee stock purchase plan | Health, dental, vision coverage | Long-term disabilityMid-level Full TimeUnited States (Remote) R1d ago