Senior Data Engineer – Databricks - 1613
Tasks
- Build scalable data models
- Design and build data ingestion and transformation pipelines
- Develop ETL and ELT frameworks
- Ensure data governance data quality and observability
- Implement orchestration for data workflows
- Lead data migration efforts
- Monitor data pipelines and resolve production issues
- Optimize SQL queries for performance
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Clustering | Data Ingestion | Data Ingestion Pipelines | Data Modeling | Data Observability | Data migrations | Databricks | ELT | ETL | Ingestion pipelines | Medallion Architecture | Partitioning | PySpark | Python | Query Tuning | SCD Type-2 | SQL | Snowflake | Snowflake Schema | Star Schema | Type 2) | Workflow Orchestration
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Applied AI Engineer - Bay Area USD 211K-263KArtificial Intelligence | C plus plus | C# | Embeddings | Feature Engineering401k | Comprehensive health and wellness benefits | Learning and development opportunities | Unlimited time offMid-level Full TimeHQ (San Francisco)23d ago
-
AI Research Engineer – Agentic AI USD 165K-180KAblation Studies | Agentic AI | Edge Computing | Error Analysis | Evaluation401k matching | Disability insurance | Health insurance | Life insurance | Paid time offMid-level Full TimeSunnyvale, CA, United States7h ago
-
Lead Analytics Engineer USD 123K-175KCI/CD | DBT | Data Governance | Data Modeling | NetsuiteFull-time telecommuting | Remote work optionSenior-level Full TimePalo Alto, California8h ago
-
Staff Software Engineer, AI Data Platform USD 250K-280KCloud platform | Google Cloud | Google Cloud Platform | GraphQL | KafkaSenior-level Full TimeSan Francisco Bay Area R10h ago
-
BEV | Bayesian Methods | CUDA | Machine Learning | Metrics OptimizationSenior-level Full TimeFoster City, CA11h ago
-
Continual Learning | Data Processing | Deep learning | JAX | Language ModelsBonus program | Company benefits program | Equity incentive planEntry-level Full TimeMountain View, CA USA; San Francisco, …12h ago
-
Staff Machine Learning Engineer, Multi-Modal Perception USD 251K-310KC plus plus | Computer Vision | Data Analysis | Deep learning | JAXSenior-level Full TimeMountain View, CA USA; San Francisco, …12h ago
-
Sr. Software Development Engineer, MLOPs USD 168K-227KAlerting | Amazon EKS | CI/CD | Checkpointing | Data IngestionSenior-level Full TimeBellevue, Washington, USA12h ago
-
Data Platform Engineer USD 182K-240KAWS | Amazon Kinesis | Apache Airflow | Apache Flink | Apache Kafka401k | Dental insurance | Family leave | Flexible paid time off | Free food and snacksSenior-level Full TimeOrlando, Florida, United States - Remote R12h ago
-
Senior Data Engineer IS - Remote USD 122K-208KAPI | API Integration | Access Control | Alerting | BashRemote work | Rotational on-call supportSenior-level Full TimeRenton, WA, United States R12h ago
-
Staff Systems Engineer - Perception USD 170K-223KComputer Vision | DOORS | Field of view | Functional Safety | Hazard AnalysisSenior-level Full TimeAustin, TX or Sunnyvale, CA13h ago
-
Data Engineer USD 85K-107KAWS Glue | AWS Lambda | AWS S3 | Access Control | DBT401k match | Career growth | DashPass membership | Gym reimbursement | Medical/Dental/VisionMid-level Full TimeProvo, UT14h ago
-
Senior-level Full TimeUnited States - Remote R14h ago
-
Sr Data Engineer USD 115K-145KAWS S3 | Apache Airflow | Azure Blob | Azure Blob Storage | BigQuery401k | Dental insurance | Discounts | Fully remote | Health insuranceSenior-level Full TimeNew York, NEW YORK, United States R14h ago
-
Senior Quality Engineer, Performance and Analytics USD 113K-156KAPI Testing | AWS | Automated testing | Azure | Cause analysisEducational reimbursement | Employee insurance plans | Unlimited vacation | Wellness reimbursementSenior-level Full TimeNew York, NY; Reno, NV; San …14h ago
-
Data Engineer USD 119K-168KAI Agents | Azure Data | Azure Data Factory | Azure Functions | Azure Lakehouse401k | Dental coverage | Health coverage | Paid parental leave | Paid time offMid-level Full TimeSterling Heights14h ago
-
Staff Software Engineer, AI Runtime USD 190K-265KCUDA | Checkpointing | Data parallelism | DeepSpeed | Distributed SystemsSenior-level Full TimeMountain View, California; San Francisco, California15h ago
-
Senior Software Engineer, AI Runtime USD 160K-225KAlgorithms | Checkpointing | Collective communication | Data Structures | Data parallelismSenior-level Full TimeMountain View, California; San Francisco, California15h ago
-
Senior Staff Software Engineer, Data Platform USD 253K-298KAI Agents | Agent systems | Batch Processing | Change Data Capture | Compliance401k | Quarterly in person surges | Remote-firstSenior-level Full TimeRemote - USA R15h ago
-
Senior Software Engineer, Data Systems (Python) USD 170K-200KAPI Design | API Keys | Apache Airflow | Authentication | BigQuery12 Company Paid Holidays | 401k | Company-Paid Holidays | Flexible PTO | Healthcare benefitsSenior-level Full TimeRemote - USA R15h ago
-
AI/ML Security Engineer USD 102K-163KAPI Integration | AWS | Azure | Benchmarking | EvaluationCorporate holidays | Flexible time off | Group dental insurance | Group health insurance | Pet benefit optionMid-level Full TimeRemote R15h ago
-
Mid-level Full TimeBethesda, MD - TS/SCI clearance required16h ago
-
Principal AI Engineer USD 265K-285KAWS | Amazon SageMaker | Apache Airflow | CI/CD | DBT401k match | Company-provided phone | Extended leave | Full insurance coverage | Observed holidaysSenior-level Full TimeAustin, Texas, United States; Denver, Colorado, …16h ago
-
Data Engineer USD 95K-135KAzure | Azure DevOps | Bulk API | CI/CD | Data Governance401k | Dental insurance | ESOP | Health insurance | Paid time offMid-level Full TimeCarmel, IN, US16h ago
-
Senior Staff Engineer - Senior Data Engineer USD 135K-165KAmazon Web Services | Apache Airflow | Apache Kafka | Apache Spark | DatabricksRemote workSenior-level Full TimeRemote, REMOTE, United States R16h ago