Principal Data Engineer
Tasks
- Architect data platform components
- Assess data quality and schema evolution
- Break requirements into engineering tasks
- Collaborate with data science leads
- Define data models
- Define testing philosophy
- Design ingestion pipelines
- Design transformation frameworks
- Document design decisions
- Ensure production data reliability
- Establish engineering best practices
- Evaluate and adopt data tooling
- Identify downstream dependency risks
- Implement data orchestration
- Implement data validation
- Implement pipeline testing
- Instrument data systems for observability
- Lead architecture reviews
- Manage backlogs and planning
- Manage schema lifecycle
- Mentor and grow engineers
- Set SLAs for data freshness completeness accuracy
- Set code review standards
- Set data platform technical roadmap
- Translate data platform decisions to stakeholders
Perks/Benefits
- Dental insurance
- Employer-matched 401k
- Flexible paid time off
- Health insurance
- Remote work
- Vision insurance
Skills/Tech-stack
AWS | Apache Spark | Batch Processing | Cloud Data | Cloud Data Infrastructure | Cloud platform | Data Contracts | Data Engineering | Data Infrastructure | Data Modeling | Data Observability | Data Pipelines | Data Quality | Data Transformation | Data Validation | Data orchestration | Delta Live Tables | Delta Live) | Feature Engineering | Feature Stores | Google Cloud | Google Cloud Platform | Great Expectations | Ingestion pipelines | Kafka | Machine Learning | Microsoft Azure | Schema evolution | Streaming processing | Structured Streaming | Testing
Education
N/A
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer
Related jobs
-
Mid-Level Data Engineer USD 90K-98KAPI Development | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageRemote workMid-level Full TimeWork from home, VA, United States R14h ago
-
Senior Data Engineer USD 165K-180KAPIs | Anomaly Detection | Azure | Azure Data | Azure Data FactorySenior-level Full TimeWork from home, VA, United States R14h ago
-
Senior Data Engineer USD 129K-165KAWS | Airflow | CI/CD | Data Modeling | Django401k | Half-day Fridays | Medical/Dental/Vision insurance | Paid Holidays | Remote workSenior-level Full TimeChicago, IL, US R1d ago
-
Solutions Engineer USD 150K-180KAI | Apache Flink | Apache NiFi | Apache Spark | Applied ScienceContinued Career Development | Employee resource groups | Flexible work from home | Generous paid time off | Paid volunteer timeMid-level Full TimeUS-California-Remote, United States R1d ago
-
Digital Technical Specialist (Associate/Sr Associate) - Heathcare Data, Analytics & Automation - Remote USD 120K-171KAI | Automation | Data Transformation | Data integration | EHRDental insurance | Healthcare coverage | Remote work | Travel opportunity | Vision insuranceSenior-level Full TimeChicago - 550 Van Buren, United … R1d ago
-
Mid-level Full TimeReston, VA (VA30), United States R1d ago
-
API | AWS | Agile | Automation | AzureRemote work | Security Clearance Initiated Upon HireSenior-level Full TimeNationwide Remote Office (US99), United States R1d ago
-
Agile | Cloud infrastructure | DBT | Data Lakes | Data Modeling401k match | Dental insurance | Flexible work schedules | Holidays | Life insuranceSenior-level Full TimeUS-IN-REMOTE, United States R1d ago
-
Principal Data Scientist USD 162K-258KAmazon Redshift | Amazon S3 | Amplitude | Apache Spark | Causal InferenceHealthcare coverage | Hybrid work | LifeTime Membership | Parental leave | Remote workSenior-level Full TimeRemote - United States R1d ago
-
AI Solutions Engineer, East USD 125K-175KAWS | Azure | Cloud platform | Dspy | Generative AI401k plan | Dental insurance | Medical insurance | Mental wellness support | Parental leaveMid-level Full TimeRemote (New York) R1d ago
-
Senior Data Engineer, Sentinel (Pacific Time Zone) USD 153K-210KAWS | Airflow | Alerting | CI/CD | DatabricksSenior-level Full TimeUnited States R1d ago
-
Mid-level Full TimeAnywhere USA, United States R1d ago
-
Machine Learning Engineer USD 104K-131KAWS | Active Learning | Airflow | Argo | Azure401k match | Corporate discounts | Education assistance | Flexible work options | Maternity leaveSenior-level Full TimeRemote, REMOTE, United States R1d ago
-
Data Engineer I IS - Remote USD 90K-140KBig Data | Cloud Computing | Data Enrichment | Data Pipelines | Data ScienceEntry-level Full TimeRenton, WA, United States R1d ago
-
AWS EKS | Access Control | Apache Iceberg | Apache S3 | CI/CDDental and vision coverage | ESPP | Flexible spending wallets | Remote-first work | Subsidized medical coverageSenior-level Full TimeRemote US R1d ago
-
Senior Data Engineer - Agentic AI Engineering USD 138K-173KAWS | Access Control | Airflow | Azure | DBTSenior-level Full TimeUnited States of America R1d ago
-
Principal Data Engineer USD 152K-190KApache Spark | Artificial Intelligence | CI/CD | Cloud Platforms | Code Coverage401k company match | Dental insurance | Flexible paid time off | Life insurance | Long-term disabilitySenior-level Full TimeDallas, TX - Hybrid (3x in … R1d ago
-
Software / Computer Science Intern USD 42K-52KData Parsing | Data Pipelines | Debugging | Networking | PythonHybrid work flexibility | Professional developmentEntry-level InternshipMonroeville, PA R1d ago
-
Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CDCollaborative work environment | Dental benefits | Health benefits | Impactful national security projects | Professional development and trainingSenior-level Full TimeVirginia R1d ago
-
Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CDCollaborative work environment | Dental benefits | Health benefits | Impactful projects | Professional development and trainingMid-level Full TimePennsylvania R1d ago
-
Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CDCollaborative innovative work environment | Flexible remote working options | Health dental and retirement benefits | Professional development and training opportunitiesSenior-level Full TimeNew York R1d ago
-
Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CDDental insurance | Health insurance | Professional development and training | Remote work flexibility | Retirement benefitsMid-level Full TimeNew Jersey R1d ago
-
Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CDCollaborative work environment | Flexible remote working options | Health dental and retirement benefits | Professional development and training opportunitiesSenior-level Full TimeMaine R1d ago
-
Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CDCollaborative and innovative work environment | Flexible remote working options | Health dental and retirement benefits | Professional development and training opportunitiesMid-level Full TimeMinnesota R1d ago
-
Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CDCollaborative work environment | Health dental and retirement benefits | Professional development training | Remote WorkingSenior-level Full TimeIllinois R1d ago