Data Engineer - Databricks
Tasks
- Architect enterprise data platforms
- Assess ETL workflows and data marts
- Develop data pipelines in Databricks
- Implement data lakehouse architecture in Databricks
- Lead and architect data migrations
- Manage ETL workflows using Databricks Workflows and Airflow
- Optimize SQL queries
- Support CI CD in dev test prod environments
- Support agile software development lifecycle
- Support data pipeline customization and integration
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Step Functions | Agile | Alation | Amazon EC2 | Amazon RDS | Amazon S3 | Apache Airflow | Apache Iceberg | Apache Spark | CI/CD | Data Governance | Databricks | Databricks Workflows | Delta Lake | Delta Lakehouse | Informatica EDC | Microsoft Purview | MySQL | PostgreSQL | PySpark | Python | SQL | Step Functions | T-SQL | Unity Catalog
Education
N/A
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R5d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R18d ago
-
Mid-level Full TimeUS-FL-Tampa5h ago
-
Software Engineer (Leadership) - Infrastructure USD 160K-210KAI workflow | AI workflow automation | Agent Orchestration | Bias Mitigation | C plus plusSenior-level Full TimeSunnyvale, CA | Bellevue, WA | …6h ago
-
Software Engineer, Sensors & Computer Vision USD 146K-208K3D Reconstruction | C++ | Camera | Clustering | Convolutional Neural NetworksMid-level Full TimeSunnyvale, CA6h ago
-
C++ | Computer Vision | Data Processing | Debugging | Distributed ComputingSenior-level Full TimeSunnyvale, CA, USA6h ago
-
AI Engineer, Advanced Solutions Lab, Google Cloud USD 152K-222KApache Beam | Apache Hive | Artificial Intelligence | C++ | Cloud ComputingSenior-level Full TimeChicago, IL, USA; Atlanta, GA, USA7h ago
-
Senior Software Developer, Computer Vision, XR USD 174K-253KAugmented Reality | C++ | Computer Vision | Data Processing | DebuggingSenior-level Full TimeSan Jose, CA, USA; Waterloo, ON, …7h ago
-
Software Engineer III, AI/ML, gUP Customer Support USD 147K-211KAgile | C++ | Code review | Data Processing | DebuggingSenior-level Full TimeSunnyvale, CA, USA7h ago
-
Business Data Scientist, Applied Machine Learning, GCS USD 138K-198KA/B | A/B Testing | B testing | Causal Inference | Causal MLMid-level Full TimeMountain View, CA, USA; New York, …7h ago
-
AWS Data Engineering Advisor USD 117K-179KAWS | AWS Batch | AWS Glue | AWS Secrets | AWS Secrets Manager401k retirement savings plan | ESPP | Employer-paid disability insurance | Health, dental, and vision insurance | HolidaysSenior-level Full TimeHOUSTON, US, 770569h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Bonus | Equity | Friendly atmosphere | Remote-friendly environmentMid-level Full TimeSeattle, WA, USA12h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Portfolio and LinkedIn application support | Remote-friendlyMid-level Full TimeChicago, IL, USA12h ago
-
.NET | Accessibility APIs | Algorithms | App SDK | Asynchronous programmingAutonomy | Cross-functional collaboration | Flexible work setting | Mentorship opportunitiesSenior-level Full TimeAnchorage, AK, USA13h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Flexible, hands-off management | Opportunity to build accessible learning products | Remote or distributed teamMid-level Full TimeSan Francisco, CA, USA13h ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Bonus opportunities | Flexible management approach | Remote workMid-level Full TimeDallas, TX, USA13h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Bonus | Competitive compensation | Equity | Remote-friendlyMid-level Full TimeWashington, DC, USA13h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Friendly work environmentMid-level Full TimeRedmond, WA, USA13h ago
-
Bash | Data Processing | Docker | GCP | LinuxAsynchronous culture | Bonus | Equity | Friendly work environment | Remote/distributed workMid-level Full TimeScottsdale, AZ, USA13h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous work culture | Career growth | Collaborative team | Remote-friendlyMid-level Full TimePlano, TX, USA13h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeMid-level Full TimeSan Antonio, TX, USA13h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Laid-back atmosphere | Remote-friendly, distributed teamMid-level Full TimeSan Mateo, CA, USA13h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Hands off management approach | Portfolio and LinkedIn sharing during application | Remote distributed settingMid-level Full TimeSacramento, CA, USA13h ago
-
Bash | Data Processing | Docker | GCP | Large Scale DataAsynchronous culture | Friendly laid-back atmosphere | Opportunity to make impactMid-level Full TimeCulver City, CA, USA13h ago
-
Artificial Intelligence | Bash | Cloud platform | Data Ingestion | Data Ingestion PipelinesAsynchronous work culture | Bonus | Equity | Friendly work environment | Remote or distributed workMid-level Full TimePasadena, CA, USA13h ago