Senior Data Engineer, Unified Platform
Tasks
- Backfill datasets
- Build data products
- Coordinate vendor changes
- Correct data gaps
- Design monitoring software
- Enable cost sharing
- Enable dataset discovery
- Enable usage tracking
- Ensure data quality
- Handle dead letter queues
- Identify self-service opportunities
- Implement access controls
- Implement data governance
- Implement data transformations
- Manage data migrations
- Manage data products
- Model data products
- Monitor data ingestion pipelines
- Monitor event throughput
- Onboard new datasets
- Own vendor ingestion pipelines
- Perform data operations
- Perform quality control
- Rerun batch jobs
- Respond to platform gaps
- Triage data quality issues
Perks/Benefits
- N/A
Skills/Tech-stack
Amazon S3 | Apache Airflow | Apache Arrow | Apache Flink | Apache Kafka | Apache Spark | Argo Workflows | Avro | Batch Processing | Cassandra | ClickHouse | Data Governance | Data Modeling | Data Pipelines | Delta Lake | GRPC | Iceberg | JSON | Java | Kubernetes | NoSQL | Parquet | Protobuf | Python | RDBMS | SQL | Streaming Data | Thrift
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
Senior Software Engineer - Production Control Plane USD 200K-287KAmazon Web Services | Azure | C++ | CI/CD | Cloud platformSenior-level Full TimeUS-CA-Menlo Park9h ago
-
Staff Systems Analyst – Robotic Algorithms and Control USD 147K-201KC# | C++ | Classical control | Control System | Control system designSenior-level Full TimeSunnyvale, CA, United States9h ago
-
AI Search | AWS | Azure | Azure AI | Azure AI Search401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States11h ago
-
Machine Learning Engineer, Discovery Recommendations USD 157K-230KA/B | A/B Testing | AWS | Apache Spark | B testing401k match | Dental insurance | Health insurance | Life insurance | Long-term disabilityMid-level Full TimeCary,North Carolina,United States11h ago
-
Staff Software Engineer, Data Platform USD 248K-279KArchitectural Design | Cost Optimization | Data Governance | Data Infrastructure | Data TransformationSenior-level Full TimeSan Francisco, CA13h ago
-
API | Angular | C# | C++ | Celery401k retirement plan | Company shuttles | Dental insurance | Employee stock purchase plan | Life insuranceSenior-level Full TimeRedmond, WA13h ago
-
Data Modeling | Deep learning | Ecommerce | Fine Tuning | Human-in-the-loopEquity | Health benefits | Hybrid work flexibility | Remote work up to 4 weeks per yearSenior-level Full TimeSan Francisco, CA R13h ago
-
Deployment Engineer - Commercial Site Team USD 120K-180KConfluence | Industrial Automation | Jira | Linux | Project ManagementCustomer site work experience | Travel opportunitiesMid-level Full TimeReno, NV13h ago
-
Software Engineer – Surgical Robot Manufacturing USD 125K-192KHTML | JSON | JavaScript | Linux | MATLABMid-level Full TimeSunnyvale, CA, United States13h ago
-
Senior Data Engineer USD 115K-145KAWS S3 | Airflow | Azure Blob | Azure Blob Storage | Blob Storage401k | Dental insurance | Discounts | Medical insurance | Paid leaveSenior-level Full TimeNew York, NEW YORK, United States R13h ago
-
Senior Software Engineer, GenAI Platform USD 164K-259KAgent Engineering | Architectural Design | Backend Development | Code review | Language Models401k match | Backup child elder and pet care | Community time off stipend | Company-paid days off | Dental insuranceSenior-level Full TimeSan Francisco, CA, USA13h ago
-
Robotics ML Expert, AI USD 60K-60KControl Systems | Dm_control | Domain Randomization | Gymnasium Robotics | JAXAsync collaboration | Flexible schedule | Remote workSenior-level Full TimeMiami R13h ago
-
BI Data Engineer (Remote WA, OR, ID & CA) USD 88K-116KAzure Synapse | C# | DAX | Data Governance | Data Modeling401k match | Health insurance | Paid Holidays | Paid vacation | Sick timeMid-level Full TimeBellevue, Washington R13h ago
-
Senior ML Engineer USD 198K-291K3D Vision | AWS | Agile | Cloud ML | Computer Vision401k | Dental insurance | Health insurance | Mental health program | Paid breaksSenior-level Full TimeCary,North Carolina,United States14h ago
-
Artificial Intelligence | Confluence | Dashboards | Electronic Hardware | Electronic Hardware ValidationBenefits package | Flexible schedule | MentorshipEntry-level ContractFoster City, CA14h ago
-
Senior-level Full TimeUS-CA-Menlo Park14h ago
-
Machine Learning Engineer USD 185K-260KAdvertising Auctions | Airflow | BigQuery | Convolutional Neural Networks | Data Pipelines401k employer match | Caregiving support programs | Comprehensive healthcare benefits | Family planning support | Flexible vacationMid-level Full TimeRemote - United States R14h ago
-
Senior Data Engineer USD 119K-161KAnalysis Services Tabular | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeDenver, CO, United States R15h ago
-
Senior Data Engineer USD 119K-161KAnalysis Services Tabular | Azure Analysis | Azure Analysis Services | Azure Analysis Services Tabular | Azure DataMentorship opportunities | Remote workSenior-level Full TimeKansas City, MO, United States R15h ago
-
Data Engineer III/Senior (AI and Gen AI) USD 130K-150KAgentic Workflows | Azure | Azure Data | Azure Data Services | Bicep401k | Dental insurance | Employee stock purchase plan | Health insurance | Life insuranceSenior-level Full TimeIrving, TX, United States R15h ago
-
Data Engineer III/Senior (AI and Gen AI) USD 130K-150KAzure | Bicep | CI/CD | Docker | Kubernetes401k retirement plan | Dental insurance | Employee stock purchase plan | Health insurance | Life insuranceSenior-level Full TimeEdison, NJ, United States R15h ago
-
Data Engineer III/Senior (AI and Gen AI) USD 130K-150KApache Kafka | Azure | Azure Data | Azure Data Factory | Azure Databricks401k | Dental insurance | Employee stock purchase plan | Life insurance | Long-term disability insuranceSenior-level Full TimeEllenwood, GA, United States R15h ago
-
Data Engineer III/Senior (AI and Gen AI) USD 130K-150KAzure | CI/CD | Compliance | Data Lineage | Data Quality401k retirement plan | Dental insurance | Employee stock purchase plan | Health insurance | Life insuranceSenior-level Full TimeRomulus, MI, United States R15h ago
-
C++ | Data pipeline | Deep learning | JAX | KinematicsBonus plan | Company benefits program | Equity incentive planSenior-level Full TimeMountain View, CA, USA; San Francisco, …16h ago
-
Principal MLOps Engineer USD 150K-200KAWS | Azure | CI/CD | Docker | Git401k match | Annual tech and gadget budget | Education and training benefits | Healthcare dental vision insurance | Paid HolidaysSenior-level Full TimeRemote, US; DMV; McLean, VA; Boston, … R16h ago