Principal Data Engineer
Tasks
- Apply CDC patterns
- Build semantic models for reporting
- Define SLAs and failure recovery
- Define data contracts
- Define data strategy
- Design dimensional models
- Design real time and near real time pipelines
- Develop ETL and ELT pipelines
- Engineer master data patterns
- Ensure idempotent recoverable pipelines
- Ensure pipeline observability and alerting
- Implement Slowly Changing Dimensions
- Implement sensitive data controls
- Optimize incremental loads
- Own data platform end-to-end
- Own platform documentation and onboarding
- Perform code review and mentoring
- Translate business requirements into semantic models
- Tune query performance
Perks/Benefits
- 401k
- Dental & vision insurance
- Disability insurance
- Health care
- Life insurance
- Paid time off
- Training & development
- Wellness resources
Skills/Tech-stack
Alerting | Apache Kafka | Azure DevOps | Azure SQL | CDC | CI/CD | Capacity Planning | Confluent Cloud | Cross System Identity Resolution | DAX | Data Contracts | Data Management | Data Modeling | Data Pipelines | Dataflows Gen2 | Delta Lake | Dimensional Modeling | Direct Lake | ELT | ETL | Eventstreams | Golden record | HIPAA | Identity resolution | Incremental load | Kafka | Lakehouse | MDM | MDM Tooling | Master Data | Master Data Management | Microsoft Fabric | Notebooks | PII compliance | Pipeline Orchestration | Pipeline observability | PostgreSQL | Power BI | Query Optimization | SLA | SQL Server | Semantic models | Slowly Changing Dimensions | Snowflake Schema | Star Schema | Stored Procedures | Streaming
Education
N/A
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer
Related jobs
-
Common table expressions | Compiled SQL Table Functions | DB2 SQL | Db2 Table Functions | Deterministic SQLHybrid work location flexibilitySenior-level Full TimeSeattle, Washington, United States R1d ago
-
Principal Data Engineer (Python, AWS, Redshift, EMR, Airflow, Databricks, Big data) | Contract to Hire | Irvine, CA (Hybrid) | A USD 147K-170KAWS RDS | Airflow | Amazon EMR | Amazon Redshift | Amazon Web ServicesContract-to-hire | Hybrid work | Mentorship opportunitiesSenior-level Full TimeIrvine, CA R1d ago
-
Technical Lead, Machine Learning USD 172K-220KBias Evaluation | DPO | Data Pipelines | Evaluation | GPU OptimizationSenior-level Full TimeUnited States R2d ago
-
Staff Machine Learning Engineer USD 130K-200KBias Evaluation | DPO | Data Pipelines | GPU Optimization | Inference architectureSenior-level Full TimeUnited States R2d ago
-
Staff Data Engineer USD 135K-180KAI coding | AI coding tools | AWS EKS | Alerting | Amazon EC2401k match | Career development | Parental leaveSenior-level Full TimeTempe, Arizona R2d ago
-
Staff Machine Learning Engineer, Shopping Ads USD 230K-322KConversion modeling | Data Pipelines | Feature Engineering | Graph Neural Networks | Latency optimization401k employer match | Family planning support | Flexible vacation | Gender-affirming care | Global benefits programsSenior-level Full TimeRemote - United States R2d ago
-
AWS | Azure | CI/CD | Container Networking | Container networking interface401k company match | ESPP | Family leave programs | Flexible spending accounts | Flexible time away planSenior-level Full TimeSan Diego, CALIFORNIA, United States R2d ago
-
AWS | Azure | CI/CD | Container Networking | Containers401k match | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeSanta Clara, California, United States R2d ago
-
Software Engineer - AIM Virtualization USD 157K-230KData Ingestion | Data egress | Database Internals | Functional Programming | Query OptimizationSenior-level Full TimeUS-CA-Menlo Park R2d ago
-
Senior-level Full TimeDenver, CO - Hybrid; New York, … R2d ago
-
Staff+ Software Engineer, Safeguards Data USD 320K-485KAWS | Access Control | Cloud platform | Data Governance | Data LineageFlexible working hours | Generous vacation | Hybrid office policy | Optional equity donation matching | Parental leaveSenior-level Full TimeSan Francisco, CA | New York … R2d ago
-
Software Engineer, Applied AI USD 170K-300KAWS | Agents | Benchmarking | Datadog | ECSFree coachingSenior-level Full TimeNew York R2d ago
-
Senior Solution Engineer USD 138K-181KAnalytics | Cloud Computing | Data Lake | Data Warehousing | Data fabricTravel opportunitiesSenior-level Full TimeUS-GA-Remote R2d ago
-
Senior Database Engineer USD 130K-150KAWS | AWS CDK | AWS CloudFormation | Access Control | Amazon AuroraSenior-level Full TimeLas Vegas, Nevada, United States; Seattle, … R2d ago
-
Machine Learning Engineer USD 170K-300KData Lake | Data Pipelines | Data serving | Deep learning | Feature EngineeringFree access to coachingMid-level Full TimeSan Francisco R2d ago
-
Data Analyst/BI Engineer USD 85K-110KAmazon S3 | Apps Script | Azure | BigQuery | Data Lineage401k match | Dental insurance | Health insurance | Paid Holidays | Paid time offSenior-level Full TimeUnited States R2d ago
-
Software Engineer, Fulfillment Core Services USD 128K-160KAPI Integration | AWS | Buildkite | CI/CD | CircleCI401k company match | Childcare benefits | Commuter benefits | Dental insurance | Family building benefitsEntry-level Full TimeSeattle, WA R2d ago
-
Senior Analytics Engineer USD 113K-125KChurn analysis | Customer Lifetime Value | DBT | Data Architecture | Data Modeling401k matching | Dental insurance | Employee assistance program | Employer Paid Short-term Disability | Flexible time offSenior-level Full TimeDallas-Fort Worth Metroplex; Denver Metropolitan Area R2d ago
-
Data Engineer II (Remote US) USD 94K-118KAlerting | BigQuery | Clustering | Common table expressions | Cost Management401k matching | Annual learning budget | Dental insurance | Employee resource groups | Health insuranceMid-level Full TimeRemote - U.S. R2d ago
-
Senior Gen AI Software Engineer USD 172K-227KAPI Design | Automated testing | Cost Optimization | Data Modeling | Data PipelinesEquity | Health/Vision/Dental benefits | In person quarterly team gatherings | Remote work | Wellness stipendsSenior-level Full TimeUnited States (Remote) R2d ago
-
Senior MLOps Engineer II (AI Native) USD 148K-216KAWS | Apache Airflow | Apache Ray | Apache Spark | Azure Storage401k match | Employee assistance program | Health insurance | Mental wellness program | Paid parental leaveMid-level Full TimeRemote, USA ; Remote, Canada R2d ago
-
Data Engineer I USD 90K-100KAWS | Access Management | Amazon Redshift | Azure | Azure Synapse401k plan | Education assistance | Health insurance | Paid time offMid-level Full TimeCamden, New Jersey, United States R2d ago
-
Senior Software Engineer, Data Infrastructure USD 243K-295KAWS | Airflow | Data Catalog | Druid | FlinkEquity compensation | Health benefitsSenior-level Full TimeSan Mateo, CA, United States R2d ago
-
Data Engineer (Implementation & Integration) USD 80K-95KData Modeling | Data Transformation | Data Validation | Data Warehousing | Data integration401k match | Dental insurance | FSA | HSA | Internal growth opportunitiesMid-level Full TimeRemote, United States R2d ago
-
AI Engineer USD 100K-176KAWS | CI/CD | CrewAI | Data Governance | EmbeddingsCelebrations | Education | In-person collaborationMid-level Full TimeBoca Raton, FL/Nashville, TN (Preferred) or … R2d ago