Staff Data Engineer
San Jose, California, United States
USD 170K-195K (estimate) Senior-level Full Time
Tasks
- Build data lakehouse
- Configure compaction policies
- Define table formats
- Design ingestion pipelines
- Detect data anomalies
- Enforce data contracts
- Implement partitioning strategies
- Integrate with ML feature stores
- Maintain transformation pipelines
- Optimize query performance
- Optimize training run data access
- Run data quality checks
- Support dataset versioning
- Track data lineage
- Use MLflow for dataset tracking
Perks/Benefits
Skills/Tech-stack
AWS | AWS Glue | Airbyte | Amazon EMR | Amazon S3 | Anomaly Detection | Apache Airflow | Apache Flink | Apache Iceberg | Apache Kafka | Apache Paimon | Apache Pulsar | Apache Spark | Change Data Capture | DBT | Data Capture | Data Lineage | Data Quality | Debezium | Docker | Kubernetes | Object storage | Parquet | SQL | Starrocks
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
Active Learning | Calibration | Causal Inference | Constrained optimization | Contextual BanditsSenior-level Full TimeAustin, TX6h ago
-
Staff Machine Learning Engineer USD 165K-236KClass imbalance | Docker | Error Analysis | Feature Engineering | Feature Labeling401k | Bonus | Equity | Generous vacation time | Medical/Dental/Vision insuranceSenior-level Full TimeRemote USA R7h ago
-
AWS | Azure | CI/CD | Container Networking | Containers401k match | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeSanta Clara, California, United States R8h ago
-
Senior Database Engineer USD 130K-150KAWS | AWS CDK | AWS CloudFormation | Access Control | Amazon AuroraSenior-level Full TimeLas Vegas, Nevada, United States; Seattle, … R10h ago
-
Lead / Principal Data Engineer - DBT & Databricks USD 180K-250KAzure | Azure Databricks | CI/CD | Cause analysis | DBTRemote workSenior-level Full TimeBolivia; Colombia; Costa Rica; Peru10h ago
-
Senior Data Engineer EUR 46K-51KDBT | Data Architecture | Data Governance | Data Migration | Data ModelingRemote workSenior-level Full TimeBolivia; Colombia; Costa Rica; Peru11h ago
-
Senior .NET Azure AI Developer USD 119K-258K.NET | AI Foundry | Application Insights | Authentication | Azure AISenior-level Full TimeBolivia; Colombia; Costa Rica; Peru11h ago
-
Senior-level Full TimeBolivia; Colombia; Costa Rica; Peru11h ago
-
Senior AI Automation Engineer USD 133K-200KAI Governance | API Integration | Alerting | Automation Anywhere | Azure OpenAISenior-level Full TimeBolivia; Colombia; Costa Rica; Peru11h ago
-
Senior Data Engineer EUR 46K-51KAPI Integrations | AWS | Agile | Aurora PostgreSQL | CD pipelinesRemote workSenior-level Full TimeBolivia; Colombia; Costa Rica; Peru11h ago
-
Software Engineer, Fulfillment Core Services USD 128K-160KAPI Integration | AWS | Buildkite | CI/CD | CircleCI401k company match | Childcare benefits | Commuter benefits | Dental insurance | Family building benefitsEntry-level Full TimeSeattle, WA R11h ago
-
Software Engineer, Data Infrastructure USD 155K-185KAWS | Access Control | Apache Airflow | Apache Kafka | Apache SparkMid-level Full TimeMountain View, CA12h ago
-
Junior AI Engineer - Onsite USD 54K-60KAPI | Anthropic | Docker | JSON | JavaScriptOnsite work locationEntry-level Full TimeGrand Rapids, Michigan12h ago
-
Data Engineer II (Remote US) USD 94K-118KAlerting | BigQuery | Clustering | Common table expressions | Cost Management401k matching | Annual learning budget | Dental insurance | Employee resource groups | Health insuranceMid-level Full TimeRemote - U.S. R13h ago
-
Senior Data Engineer - Azure Databricks USD 175K-248KAzure Databricks | Azure Event | Azure Event Hubs | CI/CD | DBTRemote workSenior-level Full TimeBolivia; Colombia; Costa Rica; Peru13h ago
-
Machine Learning Engineer - Azure & Databricks USD 152K-252KAlerting | Azure | CI/CD | Databricks | DockerRemote workSenior-level Full TimeBolivia; Colombia; Costa Rica; Peru13h ago
-
Cloud Solutions Engineer (Data & Platform) USD 130K-181KAWS | Ansible | Apache Spark | CI/CD | Configuration ManagementMid-level Full TimeFalls Church, Virginia13h ago
-
Senior Software Engineer, Data Infrastructure USD 243K-295KAWS | Airflow | Data Catalog | Druid | FlinkEquity compensation | Health benefitsSenior-level Full TimeSan Mateo, CA, United States R14h ago
-
Senior Machine Learning Engineer USD 150K-225KAIOps | AWS | Azure | Data Analysis | Data Visualization401k match | Career growth opportunities | Dental insurance | Employee resource groups | Flexible paid time offSenior-level Full TimeRemote, United States15h ago
-
Senior Data Engineer USD 120K-175K.Net Core | .Net Framework | Apache Airflow | Azure | Azure Data401k match | Career growth | Dental insurance | Employee resource groups | Life insuranceSenior-level Full TimeRemote, United States15h ago
-
Lead AI Engineer-Machine Learning USD 110K-198KAWS | Agile | Azure | CI/CD | Cloud platform401k match | Dental insurance | Disability insurance | Growth opportunities | Holiday paySenior-level Full TimeParsippany, NJ, United States15h ago
-
Senior Data Engineer (AWS, Azure, GCP) USD 90K-200KAWS | Ab Initio | Alteryx | Amazon Redshift | Apache Spark401k matching | Disability insurance | Employee stipend benefits | Fertility coverage | Generous PTOSenior-level Full TimeRichmond, VA, United States R15h ago
-
Data Engineer (AWS, Azure, GCP) USD 90K-200KAWS Lambda | Amazon EMR | Aurora | BigQuery | C#401k matching | Disability insurance | Employer Stipend | Fertility coverage | Health coverageMid-level Full TimeAtlanta, GA, United States R15h ago
-
Lead AI Engineer USD 180K-280KAWS SageMaker | Azure Machine Learning | CI/CD | ColBERT | DockerChildcare benefits | Onsite gym | Tuition assistanceSenior-level Full TimeQuincy, MA, United States15h ago
-
Senior Cloud Data Ops Engineer USD 140K-180KAWS | Amazon Aurora | Amazon RDS | Bash | BigQuery401k match | Bonus eligibility | Childcare benefits | Gym access | Insurance coverageSenior-level Full TimeQuincy, MA, United States15h ago