Databricks Data Engineer
GH Office: Arlington, VA, United States
USD 139K-247K (estimate) Senior-level Full Time
Tasks
- Conduct data quality analysis
- Develop CI/CD pipelines for notebooks and jobs
- Develop ETL pipelines using PySpark and Databricks
- Ensure data governance and security standards
- Implement Delta Lake for ACID transactions
- Optimize data ingestion from APIs streaming and batch sources
- Organize lead and document meetings
- Present reports and make recommendations
- Support data pipelines and ML workflows
Perks/Benefits
- Bonuses
- Community outreach
- Dental & vision insurance
- Disability insurance
- Employee referral program
- Health savings account
- Learning opportunities
- Life insurance
- Medical insurance
- Paid Holidays
- Parental leave
- Retirement plan
- Tuition reimbursement
Skills/Tech-stack
Apache Spark | CI/CD | Container Orchestration | Data Modeling | Databricks | Delta Lake | Event Hub | Kubernetes | Performance Tuning | PySpark | Python | Streaming Technologies | Streaming technologies Kafka | Terraform
Education
Roles
Related jobs
-
Automation Testing | CI/CD | CSS | Cypress | Feature DevelopmentMedical, dental & vision coverage | Paid time off | Parental leave | Reimbursement programs | Retirement planMid-levelRaleigh, United States R7d ago
-
Senior Machine Learning Engineers USD 160K-200KAWS | AWS S3 | Cloud Storage | CloudWatch | Computer VisionCareer growth opportunities | Community involvement | Diversity and equity focus | Inclusive culture | Learning and development resourcesSenior-level Full TimeNew York, NY, United States5h ago
-
Summer Internship - Data Engineer USD 50K-86KData Analysis | Data Storytelling | Data Visualization | Non-relational | Non-relational DatabasesCareer development | Job stabilityEntry-level Internship Part TimeMurrysville, PA, United States5h ago
-
Senior-level Full TimeFAIRFAX, VA, United States6h ago
-
AI Engineer-Machine Learning Platform USD 89K-150KAPI Design | Airflow | CI/CD | Cloud Computing | Computer VisionCareer development | Flexible working | Health insurance | Paid parental leave | Retirement planMid-level Full TimeUS-Arizona-Phoenix9h ago
-
Mid-level Full TimeUS-NY-New York9h ago
-
Machine Learning Engineer USD 116K-194KContainerization | Data analytics | Docker | Kubernetes | MLOpsSenior-level Full TimeUSA-VA-Arlington9h ago
-
AWS | Azure | Bash | CI/CD | CLIFlexible work arrangements | Professional development opportunitiesSenior-level Full TimeAustin, TX9h ago
-
Lead Data Engineer Analyst USD 113K-188KData Pipelines | Data Visualization | ETL | Python | SQLFlexible work hours | Health insurance | Professional development opportunitiesSenior-level Full TimeArlington/Rosslyn, Virginia, United States10h ago
-
Geospatial Engineer USD 102K-179KArcGIS | Data Documentation | Data Pipelines | GDAL | Geospatial DataMid-level Full TimeArlington/Rosslyn, Virginia, United States10h ago
-
Data Engineer/Cloud Engineer USD 119K-198KApache Airflow | Data Warehousing | Kubeflow | MLflow | PythonInclusive culture | Professional developmentEntry-level Full TimeAtlanta, Georgia, United States10h ago
-
Senior-level Full TimeSan Jose, California, United States10h ago
-
C++ | Distributed Systems | Networking | Python | Software developmentBenefitsMid-level Full TimeKirkland, WA, USA; Sunnyvale, CA, USA11h ago
-
Software Engineer, Generative AI, Google Meet, Workspace USD 147K-211KC++ | Data Pipelines | Data Privacy | Data privacy and security | Generative AIBenefits | Bonus | EquityMid-level Full TimeKirkland, WA, USA11h ago
-
Software Engineer, Docs AI, Workspace USD 147K-211KAI | Application development | C++ | Distributed Computing | Full StackBenefitsMid-level Full TimeNew York, NY, USA11h ago
-
Software Engineer III, Quantum (multiple openings) USD 147K-211KC++ | Cirq | Compiler development | Concurrency | Device Driver DevelopmentEquity | Flexible schedule | Health benefitsSenior-level Full TimeGoleta, CA, USA11h ago
-
Senior Software Engineer, BigQuery, Agentic AI USD 174K-252KCloud services | Data Warehousing | Distributed Systems | Generative AI | GoBenefitsSenior-level Full TimeNew York, NY, USA11h ago
-
Software Engineer, BigQuery AI Developer Experience USD 147K-211KAPI Design | Cloud infrastructure | Distributed Systems | Go | JavaBenefits | Bonus | EquityMid-level Full TimeNew York, NY, USA11h ago
-
Software Engineer - AI Data Platform USD 130K-180KAWS | Azure | Big Data | C# | C++Health insurance | Life insurance | Paid time off | Performance incentives | Retirement plansMid-level Full TimeSan Jose, CA, US, 9512815h ago
-
Machine Learning Engineer, Integrity USD 266K-555KAlgorithms | Data Structures | Deep learning | Machine Learning | PyTorchMid-level Full TimeSan Francisco16h ago
-
Machine Learning Infrastructure Engineer - #4694 USD 190K-255KAWS | Bazel | C# | C++ | Distributed ComputingFlexible time off | Medical, dental & vision coverage | Mindfulness programs | Retirement planSenior-level Full TimeMenlo Park, CA17h ago
-
Staff Backline Engineer - Platform USD 255KAWS | Azure | Bash | Black-box | Black-box troubleshootingFlexible work hours | Health insurance | Professional development opportunitiesSenior-level Full TimeMountain View, California; San Francisco, California17h ago
-
Machine Learning Engineer, Infrastructure USD 160K-210KAWS | Airflow | Ansible | Azure | CloudFormation401k | Company offsite | Equipment stipend | Flexible PTO | HSA FSA DCFSASenior-level Full TimeSan Francisco17h ago
-
Staff ML Engineer, Frontier AI USD 250KDeep learning | Language Processing | Machine Learning | Model Optimization | Natural Language401k match | Flexible time off | Medical/Dental/Vision | Parental leave | Remote workSenior-level Full TimeSan Francisco17h ago
-
Deep learning | Generative Models | JAX | PyTorch | PythonBonuses | Onsite workSenior-level Full TimeSouth San Francisco, CA18h ago