Senior Data Engineer - Databricks
Tasks
- Assess ETL jobs and data workflows
- Build and optimize data pipelines
- Collaborate on Agile SDLC
- Lead and architect data migrations in Databricks
- Manage data processing and extraction
- Reimplement existing pipelines in Databricks
- Support dev test prod deployments
- Support technical inquiries for data products
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Step Functions | Alation | Amazon EC2 | Amazon RDS | Amazon S3 | Apache Airflow | Apache Iceberg | Apache Spark | CI/CD | Collibra | Data Governance | Data Lakehouse | Databricks | Databricks Workflows | Delta Lake | Delta Lakehouse | Informatica EDC | Microsoft Purview | MySQL | PostgreSQL | PySpark | Python | SQL | Step Functions | T-SQL | Unity Catalog
Education
N/A
Roles
Related jobs
-
Software Engineer, Applied AI USD 130K-500KData Pipelines | Data Quality | Evaluation Frameworks | Experimental Design | GoDental insurance | Equity grant | Free Equinox Membership | Health insurance | Housing bonusMid-level Full TimeSan Francisco3h ago
-
Staff Machine Learning Engineer USD 188K-221KAWS | Amazon Redshift | Amazon SageMaker | Apache Airflow | Apache FlinkGenerous time off | Healthcare | Paid parental leave | Paid personal time off | Paid sick timeSenior-level Full TimeRemote - US R6h ago
-
Staff Software Engineer, Data & AI USD 183K-214KAWS | Airflow | Analytics | Artificial Intelligence | BI AnalyticsSenior-level Full TimeCA - San Francisco; WA - …7h ago
-
ASR | Automatic Speech Recognition | CTC | Data Augmentation | Knowledge Distillation401k matching | Annual offsites | Dental insurance | Free snacks and drinks | Health insuranceSenior-level Full TimeSan Francisco, CA8h ago
-
Application Software Engineer, Data USD 150K-225KAngular | C# | CI/CD | Continuous integration | DeploymentSenior-level Full TimeStarbase, TX9h ago
-
Deployed Engineer (Denver) USD 150K-250KAI Agent | AI agent deployment | AWS | Agent deployment | Agent-based401-k plan | Dental coverage | Flexible vacation | Meals on in office days | Medical coverageSenior-level Full TimeDenver, CO9h ago
-
Deployed Engineer (Las Vegas) USD 150K-250KAWS | Azure | Docker | Failure handling | GCP401k plan | Dental insurance | Flexible vacation | Meals on in office days | Medical insuranceSenior-level Full TimeLas Vegas, NV9h ago
-
Deployed Engineer (Phoenix) USD 150K-250KAWS | Agent Frameworks | Azure | Cloud Computing | Containers401k plan | Dental insurance | Flexible vacation | Meals on in office days | Medical insuranceSenior-level Full TimePhoenix, AZ9h ago
-
Full Stack AI Developer USD 146K-222KAgile | Angular | Auto-tagging | CI/CD | Chunking401k | Education reimbursement program | Flexible schedule | Hybrid schedule | MentorshipSenior-level Full TimeLivermore, CA, United States R9h ago
-
Senior Data Engineer USD 239K-271KAirflow | Alerting | Amazon Redshift | Automated testing | Cost OptimizationFamily planning support | Flexible time off | Lifestyle stipend | Mental health support | Paid parental leaveSenior-level Full TimeSan Francisco, CA R9h ago
-
Machine Learning Researcher, Audio USD 140K-250KAgent Design | Data Engineering | Deep learning | Experiment design | Fine TuningDental insurance | Health insurance | High autonomy | High impact | Remote workSenior-level Full TimeSan Francisco11h ago
-
Infrastructure Data Engineer USD 140K-180KApache Iceberg | Cloud Computing | Containers | Data Governance | Data LineageMid-level Full TimeBoston, MA12h ago
-
Governance Data Engineer USD 140K-180KAccess Control | Access Management | Analytics engineering | Data Access Management | Data ArchitectureSenior-level Full TimeBoston, MA12h ago
-
Reinsurance Data Engineer USD 150K-220KAWS Glue | Amazon Redshift | Amazon S3 | Azure Synapse | Azure Synapse AnalyticsSenior-level Full TimeBoston, MA12h ago
-
Senior-level Full TimePalo Alto12h ago
-
Senior-level Full TimePalo Alto12h ago
-
ARM Cortex | ARM Cortex-M | Audio Processing | C# | C++Entry-level InternshipAustin, Texas12h ago
-
Senior AI Engineer USD 170K-225KAPIs | AWS | Agent systems | Azure | CI/CDCross-functional team | Fast-paced environment | Healthcare innovation focus | In-office collaborationSenior-level Full TimePalo Alto12h ago
-
Staff Marketing Data Scientist, Machine Learning USD 153K-240KA/B | A/B Testing | B testing | Experimentation | Feature StoreSenior-level Full TimeCA - San Francisco12h ago
-
Senior-level Full TimeRemote in USA R13h ago
-
Sr. Staff Embedded AI Engineer USD 140K-170KBare Metal | C plus plus | C# | CMSIS NN | Code generationEmployee resource groups | Flexible work environment | Remote Work Hybrid ScheduleSenior-level Full TimeColumbia, MARYLAND, United States R13h ago
-
AI Engineer, Quality (Evals) USD 170K-220KArtificial Intelligence | Cost Optimization | Embeddings | Embeddings Model | Evaluation401k | Flexible PTO | Flexible work schedules | Therapy sessions | Wellness benefitsSenior-level Full TimeSan Francisco, CA or Remote (USA) R13h ago
-
Software Engineer USD 150K-175KChemoinformatics | Databases | Docker | Flask | GCPIn office minimum 3 days per week | Work from homeEntry-level Full TimeSomerville, MA13h ago
-
Access Control | Amazon Web Services | Apache Airflow | C++ | CI/CD401k match | Employee wellness programs | Family leave | Health care benefits | Parental leaveSenior-level Full TimeUnited States13h ago
-
Data Engineer USD 100K-113KAmazon S3 | DBT | Dataiku | Dremio | Iceberg401k match | Career growth | Generous paid time off | Global inclusive culture | Medical, dental, and vision insuranceSenior-level Full TimeAustin14h ago