Databricks Engineer, Mid
USA, VA, McLean (8283 Greensboro Dr, Hamilton), United States
USD 62K-141K Mid-level Full Time
Tasks
- Build ELT/ETL pipelines
- Document data pipelines and models
- Ensure data quality and governance
- Implement data ingestion and transformation
- Implement medallion architecture
- Monitor pipeline performance
- Optimize Databricks notebooks
- Optimize data platform costs
- Troubleshoot data pipeline issues
Perks/Benefits
Skills/Tech-stack
ACID | AWS | Airflow | Apache Airflow | Azure | Azure Data | Azure Data Lake | Azure Data Lake Storage | Caching | DBT | Data Governance | Data Ingestion | Data Lake Storage | Data Processing | Data Transformation | Databricks | Delta Lake | Delta Live Tables | Delta Live) | Distributed data | Distributed data processing | ELT | ETL | GCP | Git | Incremental processing | Object storage | Partitioning | PySpark | Python | S3 | SCD | SQL | Shuffle | Spark SQL | Unity Catalog
Education
Bachelor of Engineering | Bachelor of Science | Bachelor of Science in Computer Science | Bachelor of Science in Information Systems | Bachelor of Science in Mathematics
Roles
Regions
Countries
States
Cities
Related jobs
-
Lead Analytics Manager USD 120K-150KAffiliate Marketing | Business Intelligence | Dashboard Design | Data Ingestion | Data LiteracySenior-level Full TimeAustin, TX (remote); Dallas, TX (remote); … R9h ago
-
Perception Engineer USD 170K-275K2D vision | 3D Vision | C plus plus | Camera Calibration | Computer Vision401k | Dental insurance | End-of-year shutdown | Medical insurance | Mental health supportSenior-level Full TimeNew York, NY10h ago
-
Security Engineer (Embedded & Networking) USD 130K-175KApplication Firewall | C# | C++ | Cloud Security | GoExtended hours weekends as needed | Onsite work requirementMid-level Full TimeCape Canaveral, FL11h ago
-
Security Engineer (Embedded & Networking) USD 130K-180KAPI | Access Control | Access Management | Application Firewall | Authentication401k plan | Dental coverage | Disability insurance | Employee stock purchase plan | Life insuranceMid-level Full TimeHawthorne, CA11h ago
-
Senior Quantitative Developer USD 165K-240KAWS | Alerting | Amazon Kinesis | Cloud platform | Data Transformation401k match | Dental insurance | Hardware provided | Health insurance | Unlimited PTOSenior-level Full TimeNew York11h ago
-
Security Engineer (Embedded OT) USD 130K-180KAccess Control | Access Management | Application Firewall | Automation | Best practices401k retirement plan | Employee stock purchase plan | Health, dental, and vision insurance | Life insurance | Long-term disability insuranceMid-level Full TimeCape Canaveral, FL11h ago
-
Security Engineer (Embedded OT) USD 130K-180KAccess Control | Application Firewall | Authentication | Authorization | C#401k plan | Dental coverage | Disability insurance | Life insurance | Medical coverageMid-level Full TimeHawthorne, CA11h ago
-
Senior Analytics Engineer USD 140K-195KAccess Control | Audit trails | Census | Cloud Data | Cloud Data Warehouse401k | Dental insurance | Fitness stipend | Health insurance | Meal stipendSenior-level Full TimeMcLean, VA11h ago
-
Senior Data Engineer USD 140K-180KAccess Control | Alerting | Audit Logging | Cloud Data | Cloud Data WarehouseDental insurance | Fitness stipend | Health insurance | Meals covered | Paid time offSenior-level Full TimeMcLean, VA11h ago
-
C++ | Cloud Computing | Code Reviews | Deployment Automation | Distributed Systems401k match | Caregiving support | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - United States R12h ago
-
Machine Learning Operations Engineer USD 133K-167KAWS SageMaker | Docker | GitHub Actions | Machine Learning | NumPyCareer development | Communities | Commuting cost coverage | Corporate giving programs | Daily free lunchMid-level Full TimeBoston, Massachusetts, United States R13h ago
-
Senior Software Engineer, Robotic Solutions Development USD 174K-237KBazel | C++ | CAD | GRPC | GazeboSenior-level Full TimeMountain View, California13h ago
-
Embedded Software Engineer USD 170K-190KC++ | CAN | CI/CD | Cellular | Cloud Storage401k matching | Dental insurance | Health insurance | Paid Holidays | Paid parental leaveMid-level Full TimeHayward, CA13h ago
-
Data Engineer Associate USD 75K-85KASM | Amazon Web Services | Azure | Cloud platform | Container Orchestration401k matching | Dental insurance | Health insurance | Life insurance | On-call supportEntry-level Full TimeRoseville, CA, United States14h ago
-
Senior Machine Learning Engineer USD 188K-282KAdversarial Training | Calibration monitoring | Continuous batching | DPO | Deep learningSenior-level Full TimePalo Alto, CA14h ago
-
Senior-level Full TimeRemote - United States R14h ago
-
Analytics Engineer - Music Creator Growth USD 116K-167KAmazon Redshift | BigQuery | Cloud Data | Cloud Data Platforms | DBT401k retirement plan | Flexible holidays | Health insurance | Meal allowance | Paid parental leaveMid-level Full TimeNew York, NY14h ago
-
Senior ML Engineer, Manipulation USD 150K-265KComputer Vision | Data Augmentation | Data pipeline | Dataset curation | Diffusion ModelsOnsite five days a weekSenior-level Full TimeSan Francisco14h ago
-
Senior ML Engineer, Foundation Models USD 150K-260KBehavior Cloning | Data Augmentation | DeepSpeed | Diffusion Models | Distributed TrainingHigh ownership team | Onsite work five days per week | Startup environmentSenior-level Full TimeSan Francisco14h ago
-
Go-To-Market AI Engineer USD 115K-170KAI Agents | AI workflows | API Integration | Automation | Clay401k with company match | Company equity | Free product subscription | Medical, dental, and vision | Paid HolidaysMid-level Full TimeSalt Lake City, UT15h ago
-
Anomaly Detection | Automated testing | CI/CD | Confluence | Data ModelingSenior-level Full TimeLos Angeles; New York; San Francisco15h ago
-
A/B | A/B Testing | Auction optimization | B testing | Causal InferenceCommute subsidy | Disability insurance | Employee assistance program | Employee resource groups | Employee stock ownershipEntry-level Full TimeNew York, NY, USA15h ago
-
A/B | A/B Testing | B testing | Causal Inference | Human FeedbackCommute subsidy | Comprehensive health insurance | Disability insurance | Employee assistance program | Employee resource groupsEntry-level Full TimeBellevue, WA, USA15h ago
-
A/B | A/B Testing | B testing | Causal Inference | Experimentation infrastructureCommute subsidy | Employee resource groups | Employee stock ownership | Generous vacation | Global employee assistance programEntry-level Full TimeMountain View, CA, USA15h ago
-
AI/ML Software Engineer USD 83K-83KAWS | Angular | Azure | CI/CD | Deep learning401k matching | Flex PTO | Hybrid work | Life insurance | Medical/Dental/Vision insuranceMid-level Full TimeBay Area, CA16h ago