Senior Data Engineer
North Hollywood, CA, United States
USD 140K-160K Senior-level Full Time
Tasks
- Build and operate batch and real time ingestion pipelines
- Collaborate on ML workflows and model lifecycle
- Create CI CD pipelines and orchestration workflows
- Design and implement lakehouse architecture using Delta Lake
- Ensure data quality, observability, and lineage
- Implement data governance and security
- Optimize Spark performance and manage costs
- Provide technical mentorship through code reviews
Perks/Benefits
Skills/Tech-stack
Airflow | Apache Spark | Auto Loader | CI/CD | Change Data Capture | Cluster Sizing | Dagster | Data Capture | Data Governance | Databricks | Databricks Auto Loader | Databricks Workflows | Delta Lake | Delta Live Tables | Delta Live) | Feature Store | FinOps | Flink | Git | MLOps | MLflow | Photon acceleration | Presto | PySpark | RBAC | SQL | Schema Enforcement | Spark Tuning | Structured Streaming | Time Travel | Unity Catalog | Workload tagging
Education
Roles
Regions
Countries
States
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R21d ago
-
Data Engineer, Technical Leadership (Ranking, AI) USD 182K-235KAI workflows | Data Architecture | Data Governance | Data Modeling | Data QualitySenior-level Full TimeMenlo Park, CA2h ago
-
Automated testing | C# | C++ | CI/CD | Continuous DeploymentMid-level Full TimeMountain View, CA, USA2h ago
-
Data Engineer - Emergency Preparedness and Response USD 117K-151KAzure | Azure Data | Azure Data Factory | Azure Databricks | Big DataEmergency response availability | Health safety wellbeing focus | Hybrid work scheduleMid-level Full TimeDetroit, MI, US6h ago
-
Staff Engineer, GenAI Tooling & DevEx (R5469) USD 121K-197K*nix | AWS | Access Management | Active Directory | Azure GovSenior-level Full TimeWashington, DC11h ago
-
Staff Machine Learning Engineer, Personalization USD 152K-277KAirflow | Apache Spark | BigQuery | Contrastive Learning | Deep learning401k match | Disability insurance | Electric Car Charging Station | Employee assistance program | Flexible spending accountSenior-level Full TimeMountain View, USA12h ago
-
Senior-level Full TimeCupertino13h ago
-
2027 Technology, Data, AI & Ventures Summer Internship Program - AI Engineer (MLOps) Intern USD 60K-70KAPIs | Automated testing | CI/CD | DevOps | Generative AICapstone project | Hybrid work | Networking opportunitiesEntry-level InternshipNew York, NY, US13h ago
-
AWS Glue | Amazon Redshift | Amazon Web Services | Cloud platform | DBTAdoption Assistance | Hybrid schedule | Leave programs | Student loan repayment programEntry-level InternshipNew York, NY, US13h ago
-
Senior Data Engineer, Ads USD 220K-245KAnomaly Detection | Automated Anomaly Detection | BigQuery | DBT | DagsterSenior-level Full TimeSan Francisco Bay Area14h ago
-
Data Engineer USD 180K-200KBigQuery | CI/CD | DBT | Data Modeling | Data QualityBenefits | Equity | Inclusion and accommodationsMid-level Full TimeSan Francisco Bay Area14h ago
-
Senior AI/LLM Engineer USD 179K-201KAPI Development | CI/CD | Embeddings | Fine Tuning | Guardrails401k match | Dental insurance | Health insurance | Remote work | Vision insuranceSenior-level Full TimeRemote (US/Canada) R14h ago
-
Senior-level Full TimeNew York14h ago
-
Director, Data Engineer USD 170K-319KAmazon S3 | Apache Airflow | Apache Spark | DBT | Dagster401k match | Health insurance | Paid Holidays | Paid parental leave | Paid time offExecutive-level Full TimeMountain View, USA15h ago
-
Senior Analytics Engineer USD 157K-185KAirflow | Anonymization | BigQuery | Compliance | DBT401k match | Cellphone stipend | Commuter benefits | Company-Paid Holidays | Family planning benefitsSenior-level Full TimeRemote U.S. R15h ago
-
Senior-level Full TimeAustin, Texas, United States15h ago
-
Autonomy Algorithms Lead Software Engineer USD 173K-216KAgent coordination | Agile | Algorithms | C++ | CI/CDHybrid remote workSenior-level Full TimeWoburn, MA R15h ago
-
Autonomy Algorithms Lead Software Engineer USD 173K-216KAgent coordination | Agent systems | Agentic AI | Agile | AlgorithmsHybrid work environment | Remote work flexibilitySenior-level Full TimeArlington, VA R15h ago
-
Senior Embedded Engineer USD 150K-200KAWS IoT | AWS IoT Core | BSP | C# | C++Comprehensive health benefits | Flexible time off | Flexible work environment | Professional development opportunities | Retirement savings planSenior-level Full TimeBurlingame, CA16h ago
-
Staff Machine Learning Engineer, Personalization USD 227K-324KA/B | A/B Testing | Airflow | B testing | BigQuery401k retirement plan | Flexible holidays | Health insurance | Meal allowance | Paid parental leaveSenior-level Full TimeNew York, NY16h ago
-
Consultant – Compliance Data Science & AI USD 82K-104KAWS | Azure | Cloud platform | Dashboards | Data Pipelines401k match | College savings program | EAP | Generous PTO | HSA and FSA optionsMid-level Full TimeCharlotte, NC, United States16h ago
-
Staff Security Detection Engineer, Machine Learning USD 176K-209KAWS | Anomaly Detection | Autoencoders | Azure | CI/CDSenior-level Full TimeWA - Seattle; CA - San …16h ago
-
Consultant- Marketing Data Science & AI USD 98K-122KAWS | Azure | Cloud platform | Clustering | Data Engineering401k match | Cell phone stipend | Employee assistance program | FSA | HSAMid-level Full TimeSan Francisco, CA, United States17h ago
-
Consultant- Marketing Data Science & AI USD 82K-104KAWS | Anthropic | Azure | Cloud Computing | Data Engineering401k match | Medical/Dental/Vision | Paid parental leave | Paid time off | Professional development programsMid-level Full TimeCharlotte, NC, United States17h ago
-
Sr Data Engineer USD 130K-150KData Governance | Data Lake | Data Quality | ETL | GenAIInternational travel opportunities | Medical device industry experience | Onsite workSenior-level Full TimeIrvine, California, United States17h ago