Principal Engineer - Data Platform
Santa Clara, California, United States
R
USD 221K-387K Senior-level Full Time
Tasks
- Define observability SLOs and runbooks
- Define transformation models with dbt
- Design data governance and security
- Design ingestion architecture using CDC
- Design lakehouse data warehouse architecture
- Establish engineering standards for reliability and production readiness
- Lead data platform modernization program
- Lead through technical influence and architecture reviews
- Migrate data from Cloudera to lakehouse
- Own streaming change processing
- Set data correctness validation and reconciliation
- Translate schemas and partitions to Iceberg
Perks/Benefits
- N/A
Skills/Tech-stack
Access Control | Apache Spark | Audit Logging | CDC | Compaction | DBT | Data Deduplication | Data Governance | Data Quality | Data loss | HDFS | Hadoop | Hive | Hive Metastore | Iceberg | Impala | Kafka | Merge on Read | Observability | Petabyte Scale | PostgreSQL | Python | RunBook | SLO | SQL | Schema evolution | Trino | Zero-data-loss
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R4d ago
-
Senior-level Full TimeDeerfield, IL, United States R8h ago
-
Senior-level Full TimeUS - Remote; Canada - Remote R1d ago
-
Sr. Data Engineer USD 109K-145KAWS | Agile | CI/CD | Compliance | Data Governance401k matching | Employee assistance program | Flexible working hours | Learning platform access | Medical, dental, and vision insuranceSenior-level Full TimeRemote, TX, United States R1d ago
-
Edge AI Engineer USD 100K-150KBenchmarking | Bias Evaluation | C++ | Core ML | Edge inferenceCareer growth | Direct W2 employment | Remote work | Technical coding assessmentSenior-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer USD 100K-150KAccelerator hardware | Computer Vision | Data Quality | Data quality monitoring | Deep learningCareer growthMid-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer USD 100K-150KAccelerator hardware | Computer Vision | Data Quality | Data labeling | Data quality monitoringCareer growth | Equal opportunity employment | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer USD 100K-150KAblation Studies | Accelerator hardware | Computer Vision | Data Quality | Data quality monitoringKnowledge sharing | Long-term career growth | Mentorship | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache HBase | Apache Hive | Apache Hudi100 percent remote | Career growth | Full-time W2 employmentSenior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Hudi | Apache IcebergSenior-level Full TimeUnited States - Remote R1d ago
-
AI Data Engineer USD 100K-150KActive Learning | Apache Beam | Apache Spark | CI/CD | Code reviewCareer growth | Health benefits | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
AI Data Engineer USD 100K-150KApache Beam | CI/CD | Data Ingestion | Data Lineage | Data ModelingRemote workMid-level Full TimeUnited States - Remote R1d ago
-
AI Data Engineer USD 100K-150KApache Beam | Apache Spark | CI/CD | Caching | Code review100 percent remote | Benefits | Career growth potentialMid-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Data Engineer USD 88K-102KAWS | Data Lake | Data Modeling | Data Transformation | Data WarehouseEmployee discounts | Health care options | Paid leave | Remote work option | Retirement contributionsMid-level Full TimeIthaca (Main Campus), United States R1d ago
-
Data Platform Architect USD 100K-150KAccess Management | Alation | Amazon Redshift | Apache Flink | Apache HudiBenefits package | Full-time W2 employment | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Data Platform Architect USD 100K-150KAccess Control | Alation | Amazon Redshift | Apache Flink | Apache HudiRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Data Platform Architect USD 100K-150KAccess Management | Alation | Amazon Redshift | Apache Hudi | AtlanCareer growthSenior-level Full TimeUnited States - Remote R1d ago
-
LLM Engineer USD 100K-150KAdapter-Tuning | Benchmarking | DPO | Distributed Training | Efficient AttentionCareer growth | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
LLM Engineer USD 100K-150KAdapter-Tuning | Attention Optimization | Benchmarking | DPO | Distributed TrainingMid-level Full TimeUnited States - Remote R1d ago
-
Prompt Engineer USD 100K-150KAgent Frameworks | Agent systems | Chunking | Embeddings | EvaluationCareer growth | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Prompt Engineering USD 100K-150KAgentic Workflows | Chunking | Cost Optimization | Embeddings | Evaluation FrameworksBenefits | Full-time W2 employment | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Robotics Software Engineer USD 100K-150KBehavior Tree | C++ | Concurrent Systems | Control Systems | Data collectionMid-level Full TimeUnited States - Remote R1d ago