Senior Data Engineer
North Hollywood, CA, United States
USD 140K-160K Senior-level Full Time
Tasks
- Build and operate batch and real time ingestion pipelines
- Collaborate on ML workflows and model lifecycle
- Create CI CD pipelines and orchestration workflows
- Design and implement lakehouse architecture using Delta Lake
- Ensure data quality, observability, and lineage
- Implement data governance and security
- Optimize Spark performance and manage costs
- Provide technical mentorship through code reviews
Perks/Benefits
Skills/Tech-stack
Airflow | Apache Spark | Auto Loader | CI/CD | Change Data Capture | Cluster Sizing | Dagster | Data Capture | Data Governance | Databricks | Databricks Auto Loader | Databricks Workflows | Delta Lake | Delta Live Tables | Delta Live) | Feature Store | FinOps | Flink | Git | MLOps | MLflow | Photon acceleration | Presto | PySpark | RBAC | SQL | Schema Enforcement | Spark Tuning | Structured Streaming | Time Travel | Unity Catalog | Workload tagging
Education
Roles
Regions
Countries
States
Related jobs
-
Enterprise Systems Engineer USD 165K-200KAnsible | As-a-Service | Chef | Configuration Management | Container OrchestrationEntry-level Full TimeMenlo Park, CA7h ago
-
API Development | Azure | Azure Data | Azure Data Factory | Azure Data LakeRemote workSenior-level Full TimeWork from home, VA, United States12h ago
-
ClaimsXM Data Engineer III USD 125K-140KAnalysis Services | Azure | Azure Data | Azure Data Factory | Data Cleansing401k employer match | Health insurance | Paid Holidays | Paid Long Term Disability | Paid Short Term DisabilitySenior-level Full TimeUnited States12h ago
-
Senior-level Full TimeUnited States18h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAI APIs | AWS | Apache Spark | Application development | Artificial IntelligenceCustomer travel 20 percent timeSenior-level Full TimeSan Francisco, California18h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAWS | Apache Spark | Application development | Artificial Intelligence | AzureCustomer-facing role | Travel 20 percent timeSenior-level Full TimeRemote - Washington D.C. R18h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAWS | Apache Spark | Azure | CI/CD | DatabricksTravel 20 percentSenior-level Full TimeNew York City, New York18h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAPI Integration | AWS | Apache Spark | Artificial Intelligence | AzureTravel 20 percent timeSenior-level Full TimeChicago, Illinois18h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAWS | Apache Spark | Artificial Intelligence | Azure | CI/CDCustomer-facing role | Travel 20 percent of the timeSenior-level Full TimeAustin, Texas; USCA18h ago
-
Data Scientist Lead-Vice President USD 166K-200KData Visualization | Experimental Design | Hypothesis Testing | Machine Learning | Predictive ModelingBackup childcare | Financial coaching | Health and wellness centers | Health insurance | Mental health supportSenior-level Full TimeJacksonville, FL, United States20h ago
-
Lead Machine Learning Engineer USD 183K-215KAmazon ECS | Apache Airflow | Apache Spark | CUDA | Cloud ComputingBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeNew York, NY, United States21h ago
-
Senior Data Science Engineer USD 160K-175KAPI Development | Apache Airflow | Apache Spark | CI/CD | DBTFlexible work optionsSenior-level Full TimeRemote (United States) R21h ago
-
Entry-level Full TimeUnited States, Washington, Redmond21h ago
-
Accounting Analytics & BI Engineer USD 220K-270KAirflow | Analytics engineering | Business Intelligence | DBT | Data ModelingFlexible working hours | Generous vacation | Health benefits | Hybrid work policy | Optional equity donation matchingMid-level Full TimeSan Francisco, CA R21h ago
-
Senior Data Engineer USD 100K-120KAWS | Agile | Azure | Cloud Architecture | Data Lake401k employer match | Career development | Dental insurance | Employee discounts | Employer Disability BenefitsSenior-level Full TimeBurnsville, MN, US21h ago
-
Senior Quantum Applications Engineer USD 125K-187KArtificial Intelligence | CI/CD | CUDA Quantum | Code review | CryptographySenior-level Full TimeNew Haven, CT22h ago
-
Senior Analytics Engineer, Marketing Sciences USD 100K-125KAmazon Kinesis | DBT | Docker | JSON | Kafka401k match | Dental insurance | Employee resource groups | Flexible time off | Life and disability insuranceSenior-level Full TimeUnited States R22h ago
-
Senior Analytics Engineer USD 111K-160KAirflow | Business Intelligence | Data Governance | Data Modeling | Data Quality401k matching | Dental insurance | Fitness Center | Health insurance | Paid time offSenior-level Full TimeLehi, Utah22h ago
-
Principal Consultant, Palantir Data & AI Engineer USD 135K-200KAPI Integration | AWS | Apache Airflow | Apache Spark | AzureSenior-level Full TimeRichmond23h ago
-
Principal Consultant, Palantir Data & AI Engineer USD 135K-200KAPI | AWS | Apache Airflow | Apache Spark | AzureSenior-level Full TimeDallas23h ago
-
Principal Consultant, Palantir Data & AI Engineer USD 135K-196KAPIs | AWS | AWS Glue | Amazon Redshift | Apache AirflowSenior-level Full TimeMinneapolis23h ago
-
AI Engineer/Scientist, Staff USD 185K-250KAPIs | Agent Frameworks | Argo CD | Attribution methods | CI/CD401k match | Comprehensive health coverage | Hybrid work environment | Paid Company Holidays | Parental leaveSenior-level Full TimeAustin, Texas, United States; Menlo Park, … R23h ago
-
Principal AI Engineer USD 182K-242KAPI | Access Control | Access Management | Air Gapped Computing | Air-gapped401k match | Dental insurance | Flexible-hybrid work | Health insurance | Life insuranceSenior-level Full TimeAustin, Texas, United States; Menlo Park, … R23h ago
-
Sr Engineer, Data Engineering USD 30K-46KAmazon Web Services | Apache Spark | Azure | Data Lake | Data WarehouseSenior-level Full TimeRoswell, GA, United States23h ago
-
AWS | Azure | Cloud Computing | Computer Vision | Data Preprocessing401k | Dental insurance | Health insurance | Paid time off | Vision insuranceSenior-level Full TimeSouth San Francisco, CA, United States23h ago