Principal Data Engineer
Des Moines, IA, United States
USD 133K-165K (estimate) Senior-level Full Time
Tasks
- Build and maintain ETL/ELT pipelines
- Design and develop scalable data pipelines
- Develop and optimize Databricks notebooks and workflows
- Document data flows and operational procedures
- Enforce data governance and data lineage
- Implement CI CD for data engineering
- Implement Delta Lake
- Implement data validation and profiling
- Implement medallion architecture
- Implement role based access control and encryption
- Model data for analytics and reporting
- Monitor and tune Spark jobs
- Troubleshoot data pipeline failures
Perks/Benefits
- N/A
Skills/Tech-stack
Access Control | Azure Data | Azure Data Factory | Azure Databricks | CI/CD | Data Cleansing | Data Factory | Data Governance | Data Lineage | Data Modeling | Data Validation | Data profiling | Delta Lake | ELT | ETL | Encryption | Medallion Architecture | Metadata Management | PySpark | Role-Based Access | Role-Based Access Control | SQL | Snowflake Schema | Spark | Star Schema | Unity Catalog
Education
N/A
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R5d ago
-
Staff Engineer, Data Analysis (R5290) USD 121K-197KAnomaly Detection | Automated Validation | Cloud Storage | Communications | DashboardsSenior-level Full TimeUnited States12h ago
-
Batch scheduling | Batching | CI/CD | Caching | Capacity PlanningFlexible working hours | Generous vacation | Optional equity donation matching | Parental leaveSenior-level Full TimeSan Francisco, CA12h ago
-
C++ | Deep learning | Distributed Training | ETL | GoSenior-level Full TimeMountain View, CALIFORNIA, United States12h ago
-
Test Data Engineer USD 68K-131KArtificial Intelligence | Automation | Cloud | Configuration Management | Data Governance401k match | Catered lunches | Coffee tea beverages | Dental insurance | Health insuranceMid-level Full TimeBoston13h ago
-
Data Operations & Analytics Associate USD 100K-130KAutomation | DBT | Data Modeling | Data Pipelines | Data WarehousingMid-level Full TimeBoston16h ago
-
Data Engineer I - Data 360 USD 87K-129KAPIs | Calculated Insights | Data Governance | Data Modeling | Data Quality401k match | Flexible PTO | Health insurance | Parental leaveMid-level Full TimeMorrisville, United States16h ago
-
Senior Software Engineer Remote/Travel- Active Secret -Top Secret clearance(SCI-eligibility) USD 145K-200KAPI Testing | Cloud Computing | Cypher | Data Processing | Data QualityProfessional growth | Remote work | Travel opportunitiesSenior-level Full TimeReston, VA, United States R16h ago
-
Staff Analytics Engineer USD 125K-254KBusiness Logic | DBT | Data Architecture | Data Modeling | Data WarehouseSenior-level Full TimeRemote, USA R17h ago
-
Cloud Data Engineer II USD 107K-150KAWS | AWS Glue | AWS Step Functions | Amazon Athena | Amazon DynamoDBMid-level Full TimeMiami Lakes, FL, United States17h ago
-
Senior Data Engineer USD 130K-204KApache Spark | Data Governance | Data Lineage | Data Modeling | Data PipelinesSenior-level Full TimeAuburn Hills, MI, United States19h ago
-
Senior-level Full TimeMiami20h ago
-
Senior-level Full TimeSan Francisco20h ago
-
AI Engineer (Agents) USD 160KAI SDK | Adversarial Testing | Arize Phoenix | Asynchronous programming | CI/CDSenior-level Full TimeNew York20h ago
-
Okta Data Engineer USD 148K-263KAccess Gateway | Active Directory | Adaptive MFA | LDAP | Multi-FactorHealth insurance | Holiday pay | Learning and development | Life insurance | Long-term disabilityMid-level Full TimeUSA-Remote Work R21h ago
-
Full-Stack Computer Scientist (Senior-Level) USD 82K-138K.Net Core | .Net Framework | Agile | Azure PaaS | C#Certification reimbursement | Dental insurance | Life insurance | Long-term disability | Medical insuranceSenior-level Full TimeSierra Vista, AZ, United States21h ago
-
Senior-level Full TimeSan Francisco, California, United States21h ago
-
Mid-level Full TimeUS-FL-Tampa22h ago
-
Senior Software Engineer, Cross Platform Applications USD 212K-387KArtificial Intelligence | Automation | CI/CD | Code Analysis | Dynamic analysisSenior-level Full TimeSan Jose, California, United States22h ago
-
AI Engineer, Advanced Solutions Lab, Google Cloud USD 152K-222KApache Beam | Apache Hive | Artificial Intelligence | C++ | Cloud ComputingSenior-level Full TimeChicago, IL, USA; Atlanta, GA, USA23h ago
-
Business Data Scientist, Applied Machine Learning, GCS USD 138K-198KA/B | A/B Testing | B testing | Causal Inference | Causal MLMid-level Full TimeMountain View, CA, USA; New York, …23h ago
-
AWS Data Engineering Advisor USD 117K-179KAWS | AWS Batch | AWS Glue | AWS Secrets | AWS Secrets Manager401k retirement savings plan | ESPP | Employer-paid disability insurance | Health, dental, and vision insurance | HolidaysSenior-level Full TimeHOUSTON, US, 770561d ago
-
API Gateway | API Integration | AWS | CDC | CI/CDSenior-level Full TimeOakland, CA, US, 946121d ago
-
.NET | Accessibility APIs | Algorithms | App SDK | Asynchronous programmingAutonomy | Cross-functional collaboration | Flexible work setting | Mentorship opportunitiesSenior-level Full TimeAnchorage, AK, USA1d ago
-
Robotics Integration Engineer USD 150K-193KC++ | CAN bus | CAN tooling | CI/CD | Calibration workflows401k | Commuter benefits | Dental insurance | Employee assistance program | FSAMid-level Full TimeMountain View, CA1d ago