Data Engineer - Databricks
Tasks
- Architect enterprise data platforms
- Assess ETL workflows and data marts
- Develop data pipelines in Databricks
- Implement data lakehouse architecture in Databricks
- Lead and architect data migrations
- Manage ETL workflows using Databricks Workflows and Airflow
- Optimize SQL queries
- Support CI CD in dev test prod environments
- Support agile software development lifecycle
- Support data pipeline customization and integration
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Step Functions | Agile | Alation | Amazon EC2 | Amazon RDS | Amazon S3 | Apache Airflow | Apache Iceberg | Apache Spark | CI/CD | Data Governance | Databricks | Databricks Workflows | Delta Lake | Delta Lakehouse | Informatica EDC | Microsoft Purview | MySQL | PostgreSQL | PySpark | Python | SQL | Step Functions | T-SQL | Unity Catalog
Education
N/A
Roles
Related jobs
-
Senior-level Full TimeRemote, Canada; Computer/Software; Canada, Canada; Remote, … R6h ago
-
ANSI SQL | Amazon Redshift | Analytical modeling | Cloud Data | Cloud Data PlatformsCareer growth | Onsite work | Possible contract extension | Successful Completion Bonus | Support from consultantsMid-level Full TimeJuno Beach, FL; Juno Beach, FL; …6h ago
-
AWS | Bitbucket | Confluence | Data Analysis | Eclipse401k employer contribution | Direct contribution to 401k vesting | Educational assistance | Federal Holidays | Healthcare benefitsSenior-level Full TimeAnnapolis Junction, Maryland; Annapolis Junction, Maryland; …7h ago
-
Software Engineer 1 - (Python, UI/UX, LLM) USD 169K-207KAWS | Argo CD | CI/CD | Containerization | Docker401k match | Educational assistance | Federal Holidays | Healthcare coverage | PTOMid-level Full TimeAnnapolis Junction, Maryland7h ago
-
Senior Applied AI Engineer 3 - (Python, LLMs, RAG) USD 241K-295KAI Agents | APIs | Backend Development | Data Pipelines | Docker401k matching | Education assistance | Healthcare coverage | Paid time offSenior-level Full TimeAnnapolis Junction, Maryland7h ago
-
Cloud Software Engineer 3 - (Cloud, Hadoop, Java) USD 228K-278KAnsible | Apache Kafka | Apache Lucene | Apache Solr | Avro401k matching | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offSenior-level Full TimeFort Meade, Maryland R7h ago
-
Software Engineer III, AI/ML, Platforms and Devices USD 147K-210KAndroid | C++ | Data Processing | Debugging | Language ProcessingSenior-level Full TimeSeattle, WA, USA12h ago
-
AI Strategy Lead USD 192K-278KAgentic AI | Artificial Intelligence | As-a-Service | Business Intelligence | Data AnalysisSenior-level Full TimeChicago, IL, USA; Sunnyvale, CA, USA12h ago
-
Agents | Artificial Intelligence | Automated Evaluation | C++ | Code reviewSenior-level Full TimeSunnyvale, CA, USA12h ago
-
API Development | Artificial Intelligence | C# | C++ | Computer VisionMid-level Full TimeSunnyvale, CA, USA; Atlanta, GA, USA12h ago
-
Staff ML Engineer, Search Ads Shopping Relevance Models USD 207K-300KC++ | CI/CD | Data Analysis | Data Processing | Deep learningSenior-level Full TimeMountain View, CA, USA12h ago
-
Software Engineer, ML Accelerators, DeepMind USD 174K-252KC++ | Hardware Accelerators | JAX | Kernel development | Machine LearningMid-level Full TimeMountain View, CA, USA; San Francisco, …12h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous work culture | Flexible management approach | Professional growth opportunities | Remote or distributed workMid-level Full TimePalo Alto, CA, USA16h ago
-
Bash | Cloud infrastructure | Data Ingestion | Data Ingestion Pipelines | Data ProcessingAsynchronous culture | Career growth | Impactful mission | Remote-friendly cultureMid-level Full TimeLos Angeles, CA, USA16h ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Friendly work environment | Remote workMid-level Full TimeBellevue, WA, USA17h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Bonus | Equity | Remote-friendlyMid-level Full TimeDenver, CO, USA17h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Friendly laid-back atmosphere | Opportunity for career growthMid-level Full TimeAnaheim, CA, USA17h ago
-
Bash | Data Ingestion | Data Ingestion Pipelines | Data Processing | DockerAsynchronous culture | Flexible management approach | Mission driven product impact | Supportive team environmentMid-level Full TimeProvo, UT, USA17h ago
-
Bash | Data Processing | Docker | GCP | Large Scale DataAsynchronous culture | Competitive benefits | Flexible management | Remote workMid-level Full TimeFort Worth, TX, USA17h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Career growth | Remote workMid-level Full TimeHouston, TX, USA17h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerMid-level Full TimeCollege Park, MD, USA17h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerMid-level Full TimeSaint Paul, MN, USA17h ago
-
Bash | Cloud platform | Data Processing | Data Processing Pipelines | DockerAsynchronous culture | Competitive benefits | Flexible management | Remote-friendly | Supportive teamMid-level Full TimeDurham, NC, USA17h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Competitive bonus | Equity compensation | Flexible management approach | Remote-friendly workMid-level Full TimeCary, NC, USA17h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Flexible management | Friendly work environment | Portfolio review support | Remote-friendlyMid-level Full TimeCleveland, OH, USA17h ago