Databricks Engineer, Mid
USA, VA, McLean (8283 Greensboro Dr, Hamilton), United States
USD 62K-141K Mid-level Full Time
Tasks
- Build ELT/ETL pipelines
- Document data pipelines and models
- Ensure data quality and governance
- Implement data ingestion and transformation
- Implement medallion architecture
- Monitor pipeline performance
- Optimize Databricks notebooks
- Optimize data platform costs
- Troubleshoot data pipeline issues
Perks/Benefits
Skills/Tech-stack
ACID | AWS | Airflow | Apache Airflow | Azure | Azure Data | Azure Data Lake | Azure Data Lake Storage | Caching | DBT | Data Governance | Data Ingestion | Data Lake Storage | Data Processing | Data Transformation | Databricks | Delta Lake | Delta Live Tables | Delta Live) | Distributed data | Distributed data processing | ELT | ETL | GCP | Git | Incremental processing | Object storage | Partitioning | PySpark | Python | S3 | SCD | SQL | Shuffle | Spark SQL | Unity Catalog
Education
Bachelor of Engineering | Bachelor of Science | Bachelor of Science in Computer Science | Bachelor of Science in Information Systems | Bachelor of Science in Mathematics
Roles
Regions
Countries
States
Cities
Related jobs
-
Lead Analytics Manager USD 120K-150KAffiliate Marketing | Business Intelligence | Dashboard Design | Data Ingestion | Data LiteracySenior-level Full TimeAustin, TX (remote); Dallas, TX (remote); … R8h ago
-
Perception Engineer USD 170K-275K2D vision | 3D Vision | C plus plus | Camera Calibration | Computer Vision401k | Dental insurance | End-of-year shutdown | Medical insurance | Mental health supportSenior-level Full TimeNew York, NY8h ago
-
Security Engineer (Embedded & Networking) USD 130K-175KApplication Firewall | C# | C++ | Cloud Security | GoExtended hours weekends as needed | Onsite work requirementMid-level Full TimeCape Canaveral, FL9h ago
-
Security Engineer (Embedded & Networking) USD 130K-180KAPI | Access Control | Access Management | Application Firewall | Authentication401k plan | Dental coverage | Disability insurance | Employee stock purchase plan | Life insuranceMid-level Full TimeHawthorne, CA9h ago
-
Senior Quantitative Developer USD 165K-240KAWS | Alerting | Amazon Kinesis | Cloud platform | Data Transformation401k match | Dental insurance | Hardware provided | Health insurance | Unlimited PTOSenior-level Full TimeNew York9h ago
-
Security Engineer (Embedded OT) USD 130K-180KAccess Control | Access Management | Application Firewall | Automation | Best practices401k retirement plan | Employee stock purchase plan | Health, dental, and vision insurance | Life insurance | Long-term disability insuranceMid-level Full TimeCape Canaveral, FL9h ago
-
Security Engineer (Embedded OT) USD 130K-180KAccess Control | Application Firewall | Authentication | Authorization | C#401k plan | Dental coverage | Disability insurance | Life insurance | Medical coverageMid-level Full TimeHawthorne, CA9h ago
-
Senior Analytics Engineer USD 140K-195KAccess Control | Audit trails | Census | Cloud Data | Cloud Data Warehouse401k | Dental insurance | Fitness stipend | Health insurance | Meal stipendSenior-level Full TimeMcLean, VA10h ago
-
Senior Data Engineer USD 140K-180KAccess Control | Alerting | Audit Logging | Cloud Data | Cloud Data WarehouseDental insurance | Fitness stipend | Health insurance | Meals covered | Paid time offSenior-level Full TimeMcLean, VA10h ago
-
C++ | Cloud Computing | Code Reviews | Deployment Automation | Distributed Systems401k match | Caregiving support | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - United States R10h ago
-
Machine Learning Operations Engineer USD 133K-167KAWS SageMaker | Docker | GitHub Actions | Machine Learning | NumPyCareer development | Communities | Commuting cost coverage | Corporate giving programs | Daily free lunchMid-level Full TimeBoston, Massachusetts, United States R11h ago
-
Senior Software Engineer, Robotic Solutions Development USD 174K-237KBazel | C++ | CAD | GRPC | GazeboSenior-level Full TimeMountain View, California11h ago
-
Data Engineer Associate USD 75K-85KASM | Amazon Web Services | Azure | Cloud platform | Container Orchestration401k matching | Dental insurance | Health insurance | Life insurance | On-call supportEntry-level Full TimeRoseville, CA, United States12h ago
-
Senior Machine Learning Engineer USD 188K-282KAdversarial Training | Calibration monitoring | Continuous batching | DPO | Deep learningSenior-level Full TimePalo Alto, CA12h ago
-
Analytics Engineer - Music Creator Growth USD 116K-167KAmazon Redshift | BigQuery | Cloud Data | Cloud Data Platforms | DBT401k retirement plan | Flexible holidays | Health insurance | Meal allowance | Paid parental leaveMid-level Full TimeNew York, NY12h ago
-
Senior ML Engineer, Manipulation USD 150K-265KComputer Vision | Data Augmentation | Data pipeline | Dataset curation | Diffusion ModelsOnsite five days a weekSenior-level Full TimeSan Francisco12h ago
-
Senior ML Engineer, Foundation Models USD 150K-260KBehavior Cloning | Data Augmentation | DeepSpeed | Diffusion Models | Distributed TrainingHigh ownership team | Onsite work five days per week | Startup environmentSenior-level Full TimeSan Francisco13h ago
-
Anomaly Detection | Automated testing | CI/CD | Confluence | Data ModelingSenior-level Full TimeLos Angeles; New York; San Francisco13h ago
-
NYC Sr. AI Engineer: Assets, Formats & Placements USD 139K-229KA/B | A/B Testing | Apache Lucene | Apache Solr | B testingFlexible work hybrid option | Health and wellness programs | Time away from workSenior-level Full TimeNew York, NY, United States14h ago
-
AI Developer Experience Engineer USD 180K-250KAPI Development | Anthropic | Automation | Benchmarking | Data PipelinesSenior-level Full TimeNew York City14h ago
-
Forward Deployed AI Engineer, West USD 125K-175KAWS | Azure | Docker | GCP | Generative AI401k plan | Dental insurance | Medical insurance | Parental leave | Unlimited paid time offMid-level Full TimeRemote (San Francisco) R15h ago
-
Senior Machine Learning Engineer, Reinforcement Learning USD 150K-250KDomain Randomization | Embedded Systems | Gazebo | Isaac-Gym | Mujoco401k retirement plan | Dental insurance | Employee referral bonus | Flexible PTO | Free lunchSenior-level Full TimeColumbus, Ohio or Remote R15h ago
-
Senior Data Platform Engineer USD 140K-220KApache Hudi | Apache Spark | CI/CD | Delta Lake | Distributed StorageSenior-level Full TimePittsburgh, PA or Remote R15h ago
-
Senior AI Engineer, Ads Ai USD 139K-229KA I | A I Data Science | A/B | A/B Testing | B testingFlexible work | Health and wellness programs | Time away from workSenior-level Full TimeNew York, NY, United States16h ago
-
Senior Software Engineer - Analytics Front Office USD 200K-250KAlgorithms | Asynchronous programming | C# | C++ | CI/CD401k | Dental insurance | Disability insurance | Flexible spending account | Health insuranceSenior-level Full TimeChicago, Greenwich, New York, Austin, Houston16h ago