Senior Data Engineer - Databricks
Tasks
- Analyze and optimize SQL queries
- Architect data platforms services and pipelines
- Assess ETL jobs workflows data marts BI tools and reports
- Build and manage data pipelines and workflows
- Inspect existing data pipelines and re implement in Databricks
- Lead data migrations with Databricks
- Support agile software development lifecycle
- Support customization integration and enterprise architecture of data products
- Support data governance
Perks/Benefits
- N/A
Skills/Tech-stack
AWS DataZone | AWS S3 | AWS Step Functions | Agile | Alation | Amazon EC2 | Amazon RDS | Amazon Web Services | Apache Airflow | Apache Iceberg | Apache Spark | C++ | CI/CD | Collibra | Data Lakehouse | Data pipeline | Databricks | Databricks Workflows | Delta Lake | ETL | Informatica EDC | Java | JavaScript | Microsoft Purview | MySQL | Object-Oriented | Object-oriented programming | PostgreSQL | PySpark | Python | SQL | Scala | Step Functions | T-SQL | Unity Catalog | Web Services
Education
N/A
Roles
Related jobs
-
Featured Feat. Applied AI Engineer - Bay Area USD 211K-263KArtificial Intelligence | C plus plus | C# | Embeddings | Feature Engineering401k | Comprehensive health and wellness benefits | Learning and development opportunities | Unlimited time offMid-level Full TimeHQ (San Francisco)23d ago
-
Forward Deployed Engineer USD 120K-180KCloud infrastructure | Language Processing | Machine Learning | Natural Language | Natural Language ProcessingCustomer collaboration | Frontier technology | Technical mentorshipEntry-level Full TimeSan Francisco, CA, US3h ago
-
Senior-level Full TimeHerdon, VA, US4h ago
-
Data Engineer – Senior USD 140K-180KABAC | AWS | AWS Glue | AWS IAM | AWS Lake FormationActive MBI required | IRS contract experience preferred | U.S. citizenship requiredSenior-level Full TimeHyattsville, MD, US4h ago
-
Staff Software Engineer, Data Cloud Memorystore USD 207K-301KC++ | Cache | Compute Technologies | Data Structures | Data Structures and AlgorithmsBonus | Equity | Health insurance | Learning and development | Paid time offSenior-level Full TimeKirkland, WA, USA6h ago
-
Senior Software Developer, Embedded Systems/Firmware USD 100K-253KAlgorithms | Android | Artificial Intelligence | C# | C++Senior-level Full TimeKirkland, WA, USA; New York, NY, …6h ago
-
AI/ML Engineer II USD 93K-179KAmazon EC2 | Amazon S3 | Apache Airflow | CI/CD | CSS401k | Adoption Assistance | Career path planning | Continuing education | Employee referral programMid-level Full TimePhoenix Campus (Main), United States17h ago
-
Senior Software Engineer, Agentic Engineering USD 184K-356KAgent Orchestration | Autonomous Search | CI/CD | CUDA | Code generationEquity | Health benefits | Paid time off | Relocation assistanceSenior-level Full TimeUS, CA, Santa Clara, United States17h ago
-
MES Software Engineer/Data Analyst USD 109K-175K.NET | AWS | Artificial Intelligence | Azure | Cloud Platforms401k match | Employee assistance program | Employee stock purchase program | Medical/Dental/Vision | Paid HolidaysSenior-level Full TimeUSA-Pennsylvania-Breinigsville-9999 Hamilton Blvd, United States17h ago
-
Senior Systems Engineer, Storage - DGX Cloud USD 208K-414KAlerting | Algorithms | Ansible | Argo CD | CI/CDSenior-level Full TimeUS, CA, Remote, United States R17h ago
-
Director, Precision Medicine Data Science & AI USD 194K-361KAWS | Apache Spark | Azure | CPT | Claims data401-k match | Comprehensive benefits package | Hybrid work | Paid time off | Travel 10 percentExecutive-level Full TimeEast Hanover, United States17h ago
-
Quantum Error Correction Theorist USD 155K-185KDecoder algorithms | Error correction | Fault Tolerance | Git | Neutral Atom Qubits401k matching | Catered team lunches | Dental insurance | Dependent care benefits | FSAEntry-level Full TimeBerkeley, CA21h ago
-
Apache Airflow | DBT | Data Modeling | ETL | Embedded Analytics401k matchSenior-level Full TimeOrlando, Florida, United States - Remote R1d ago
-
Data Engineering | Distributed Computing | Language Models | Language Processing | Large Language ModelsHybrid work | Onsite customer support | Travel opportunitiesMid-level Full TimeJacksonville, Florida, United States1d ago
-
Apache Spark | Distributed Computing | Language Models | Language Processing | Large Language ModelsHybrid work | On-site customer support | Travel opportunityMid-level Full TimeConnecticut, Connecticut, United States1d ago
-
Apache Spark | Data Processing | Distributed Computing | Large Scale Data | Large-scaleHybrid work | Travel opportunityMid-level Full TimeMassachusetts, Massachusetts, United States1d ago
-
AIP | Distributed Computing | Language Models | Large Language Models | Machine LearningHybrid work | Travel 10 to 33 percentMid-level Full TimeNew York Mills, New York, United …1d ago
-
Distributed Systems | Language Models | Large Language Models | Machine Learning | Palantir AIPHybrid work | Travel opportunitiesMid-level Full TimeSan Francisco, California, United States1d ago
-
Data Engineering | Data Processing | Distributed Computing | Full Stack | Full-Stack DevelopmentHybrid work | Onsite customer support | Travel opportunitiesMid-level Full TimeFlorida, Florida, United States1d ago
-
AWS | Artificial Intelligence | Asynchronous programming | Context engineering | Distributed Systems401k matching | Dental insurance | Health insurance | Learning opportunities | Relocation assistanceSenior-level Full TimeSan Antonio, Texas, United States1d ago
-
Machine Learning Engineer USD 140K-220KApache Spark | Azure | Azure Machine Learning | CI/CD | Cloud StorageCareer development opportunities | High responsibilitySenior-level Full TimeUnited States - Remote R1d ago
-
API Integration | AWS | Automation | Business Intelligence | Cloud ArchitectureMid-level Full TimeSan Mateo, California, United States1d ago
-
Machine Learning Engineer USD 142K-215KBayesian Inference | Code review | Deep learning | Error correction | GitMid-level Full TimeBoston, MA, US1d ago
-
Staff Algorithm Engineer / Data Scientist USD 150K-180KData Mining | MATLAB | Machine Learning | Python | R401k plan | Dental insurance | Flexible spending account | Flexible work environment | Health savings accountSenior-level Full TimeSan Diego, CA, US1d ago
-
AI Model Deployment | AI model | AI model development | Data-Driven Decision Making | Data-drivenSenior-level Full TimeSan Francisco, California, United States1d ago