Senior Data Engineer
North Hollywood, CA, United States
USD 140K-160K Senior-level Full Time
Tasks
- Build and operate batch and real time ingestion pipelines
- Collaborate on ML workflows and model lifecycle
- Create CI CD pipelines and orchestration workflows
- Design and implement lakehouse architecture using Delta Lake
- Ensure data quality, observability, and lineage
- Implement data governance and security
- Optimize Spark performance and manage costs
- Provide technical mentorship through code reviews
Perks/Benefits
Skills/Tech-stack
Airflow | Apache Spark | Auto Loader | CI/CD | Change Data Capture | Cluster Sizing | Dagster | Data Capture | Data Governance | Databricks | Databricks Auto Loader | Databricks Workflows | Delta Lake | Delta Live Tables | Delta Live) | Feature Store | FinOps | Flink | Git | MLOps | MLflow | Photon acceleration | Presto | PySpark | RBAC | SQL | Schema Enforcement | Spark Tuning | Structured Streaming | Time Travel | Unity Catalog | Workload tagging
Education
Roles
Regions
Countries
States
Related jobs
-
API | AWS Glue | Amazon Redshift | Amazon Web Services | Apache AirflowFully remote | Mentorship opportunities | On-call supportSenior-level Full TimeOrlando, FL, United States R10h ago
-
Mid-level Full TimeMiami Lakes, FL, United States12h ago
-
Hive | Microstrategy | MySQL | Oracle | Python401k | Dental insurance | Disability insurance | Firm paid holidays | Flexible spending accountEntry-level Full TimeWashington, DC, United States12h ago
-
AWS | Autogen | Automated testing | Azure | CI/CDOnsite workSenior-level ContractDallas, United States16h ago
-
Databricks Engineer USD 97K-162KAPI Integration | Agile | Data Governance | Data Modeling | Data QualityMid-level Full TimeArlington/Rosslyn, Virginia, United States; Baltimore, Maryland, …17h ago
-
Data Scientist, Innovation Hub USD 108K-108KAudit Logging | Azure | CI/CD | Federated identity | Integration TestingCareer growth | Healthcare | On-site childcare | PTO | Paid HolidaysMid-level Full TimeTexas-Dallas-5323 Harry Hines Blvd17h ago
-
Databricks Engineer USD 107K-179KAPI Integration | Agile | Cloud Computing | Data Governance | Data ModelingTravel 10 to 15 percentMid-level Full TimeArlington/Rosslyn, Virginia, United States; Baltimore, Maryland, …17h ago
-
Senior Data Engineer USD 133K-158KAKS | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksSenior-level Full TimeCincinnati, Ohio, United States17h ago
-
AI Program Lead USD 159K-265KAI Governance | Agent-Based Artificial Intelligence | Agent-based | Artificial Intelligence | Business IntelligenceMentorship | Professional development | Travel up to 25 percentSenior-level Full TimeArlington/Rosslyn, Virginia, United States17h ago
-
Associate BI Analytics Engineer USD 98K-163KDAX | Data Modeling | Data Warehousing | Databricks | ELTMid-level Full TimeUSA-VA-Herndon17h ago
-
Data Engineer, Employee Technology Support USD 110K-130KCause analysis | Data Governance | Data Modeling | Data Monitoring | Data Quality401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceMid-level Full TimeNew York17h ago
-
AI orchestration | Alerting | Caching | Distributed Systems | DockerDental insurance | Medical insurance | Paid time off | Savings plan options | Vision insuranceSenior-level Full TimeSan Francisco, CA, United States R18h ago
-
A/B | A/B Testing | APIs | Anthropic | B testingDental insurance | Medical insurance | PTO | Remote | Savings plan optionsMid-level Full TimeSan Francisco, CA, United States R18h ago
-
Alerting | Batching | Caching | Distributed Systems | DockerDental insurance | Medical insurance | Paid time off | Remote work | Savings planMid-level Full TimeSan Francisco, CA, United States R18h ago
-
Security Engineer III - AI/ML USD 170K-215KAPI Development | AWS | Anomaly Detection | Azure | BERTSenior-level Full TimePlano, TX, United States18h ago
-
Principal Data Engineer USD 160K-170KAWS | Amazon Redshift | Apache Airflow | BigQuery | Cloud platform401k match | Dental insurance | Health insurance | Paid time off | Remote workSenior-level Full TimeRemote (United States) R1d ago
-
AI/ML Engineer - School USD 101K-163KAI Safety | AI safety evaluation | AWS Bedrock | AWS ECS | AWS LambdaMid-level Full TimeVirtual US IL, United States R1d ago
-
AI Software Engineer - Fixed Income Technology USD 110K-150KAPI Integration | AWS | Azure | CI/CD | Data PipelinesHealth insurance | Hybrid work | Life insurance | Paid time off | Retirement planSenior-level Full TimeIL01 - Chicago, United States1d ago
-
Senior Cloud Database Engineer (Hybrid - Seattle, WA) USD 142K-220KASM | AWR | AWS DMS | AWS RDS | Amazon AuroraDisability insurance | EAP Resources | Hybrid work location | Life insurance | Medical/Vision/DentalSenior-level Full TimeSeattle WA, United States R1d ago
-
Senior Machine Learning Engineer USD 159K-295KAUC-ROC | AWS | Causal Inference | Clean room | Data clean roomSenior-level Full TimeCA San Francisco 153 Kearny Street, …1d ago
-
Principal AI Platform Engineer USD 117K-206KAI | AWS | Agent workflows | Ansible | Argo CDHealth insurance | Hybrid work | Paid time off | Remote work | Retirement savings planSenior-level Full TimeUSA - MN - Minneapolis, United …1d ago
-
Apache Iceberg | Atlan | BigQuery | Cloud Composer | Cloud RunSenior-level Full TimePA, Working at Home - Pennsylvania, …1d ago
-
AWS | Ab Initio | Artificial Intelligence | Data Governance | Data Quality401k matching | Health insurance | Mental health counseling | Paid Holidays | Paid time offMid-level Full TimeHartford - Tower, United States1d ago
-
Code review | Data Governance | Data Ingestion | Data Mastering | Data SharingSenior-level Full TimePrimary location: Dublin, Franklin, OH R1d ago
-
Senior Data Platform Engineer USD 109K-156KAPI Integration | Azure Data | Azure Data Factory | Azure SQL | Azure SynapseHybrid scheduleSenior-level Full TimeOrlando Office, United States R1d ago