Principal Data Engineer
Des Moines, IA, United States
USD 133K-165K (estimate) Senior-level Full Time
Tasks
- Build and maintain ETL/ELT pipelines
- Design and develop scalable data pipelines
- Develop and optimize Databricks notebooks and workflows
- Document data flows and operational procedures
- Enforce data governance and data lineage
- Implement CI CD for data engineering
- Implement Delta Lake
- Implement data validation and profiling
- Implement medallion architecture
- Implement role based access control and encryption
- Model data for analytics and reporting
- Monitor and tune Spark jobs
- Troubleshoot data pipeline failures
Perks/Benefits
- N/A
Skills/Tech-stack
Access Control | Azure Data | Azure Data Factory | Azure Databricks | CI/CD | Data Cleansing | Data Factory | Data Governance | Data Lineage | Data Modeling | Data Validation | Data profiling | Delta Lake | ELT | ETL | Encryption | Medallion Architecture | Metadata Management | PySpark | Role-Based Access | Role-Based Access Control | SQL | Snowflake Schema | Spark | Star Schema | Unity Catalog
Education
N/A
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer
Related jobs
-
Senior Software Engineer, Database Internals AlloyDB USD 174K-252KC plus plus | C# | Code optimization | Compute Technologies | Concurrency ControlEntry-level Full TimeSunnyvale, CA, USA2h ago
-
Staff Software Engineer, AI-Powered GRC Automation USD 207K-300KCloud Platforms | Cloud platform | Continuous controls monitoring | Controls monitoring | Data PipelinesSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA2h ago
-
Senior Staff Software Engineer, BigQuery Core Analytics USD 262K-365KBigQuery | C plus plus | C++ | CI/CD | Distributed SystemsSenior-level Full TimeKirkland, WA, USA; Sunnyvale, CA, USA2h ago
-
AI Software Engineer (Vehicle Engineering) USD 125K-175K3D Reconstruction | Agent systems | Agentic AI | Anomaly Detection | CI/CD401k retirement plan | Dental insurance | Employee stock purchase plan | Life insurance | Life insurance coverageSenior-level Full TimeHawthorne, CA13h ago
-
Lead AI Engineer (ML Ops) USD 116K-170KAPIs | AWS | Agile Scrum | Azure | CI/CD401k match | Employee assistance program | Employee charity match | Employee stock purchase plan | Health and wellness allowanceSenior-level Full TimeIrving - 6011 Connection, United States13h ago
-
Senior Machine Learning Engineer, Computer Vision USD 150K-200KAWS | Agile | Airflow | Azure | CI/CD401-k plan | Healthcare benefits | Life insurance | Long-term disability | On-site collaborationSenior-level Full TimeSeattle, Washington, United States14h ago
-
Performance Engineer, Inference Systems USD 350K-850KAutoscaling | Cause analysis | Data Analysis | Data Modeling | Distributed SystemsSenior-level Full TimeSan Francisco, CA | New York …14h ago
-
Full Stack Engineer, Experimentation USD 145K-235KAWS | Agile | Azure | CI/CD | Design PatternsDental insurance | Health insurance | Mental health benefits | Restricted stock units | Vision insuranceSenior-level Full TimeRemote - US R15h ago
-
Senior Data Engineer, Knowledge & Information USD 153K-238KAWS | Alerting | Apache Airflow | Apache Spark | CI/CD401k company match | Dental insurance | Disability insurance | Flexible time off | Health insuranceSenior-level Full TimeUnited States R15h ago
-
Senior Software Engineer, Data USD 144K-216KAWS | Airflow | Azure | DBT | Data LineageDental insurance | Disability insurance | Family-forming benefits | Life insurance | Medical insuranceSenior-level Full TimeSan Jose, California15h ago
-
Compliance, Data Engineering, Dallas, Associate USD 148K-200KAlgorithms | Apache Spark | Batch Processing | C++ | Cloud ComputingSenior-level Full TimeDallas, TX, United States16h ago
-
AI machine learning | Agile | Application Resiliency | CI/CD | Decision supportBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeJersey City, NJ, United States16h ago
-
Staff AI Engineer USD 170K-220KAPI Development | API Integration | Anthropic API | Artificial Intelligence | Backend Development401k match | Commuter benefits | Employee assistance program | Flexible spending accounts | Gym Fitness Discount ProgramSenior-level Full TimeRemote- US R16h ago
-
Business Analytics Lead - Predictive Modeling USD 130K-140KA/B | A/B Testing | B testing | Business Intelligence | Dashboard Development401k retirement savings plan | Dental coverage | Equity participation | Flexible spending account | Health savings accountSenior-level Full TimeNew York, NY16h ago
-
Quantitative Engineer USD 140K-155KAI Assistant | API Design | AWS | CI/CD | Credit facility401k | Dental insurance | Fitness fund | Health insurance | Learning and development fundSenior-level Full TimeRemote - USA R16h ago
-
Senior, ML Engineer - Auto Tagger USD 177K-212KAWS | Apache Arrow | Apache Beam | Apache Spark | Cloud platform401k match | Company holiday office closures | Company-paid medical, dental & vision | Disability insurance | Flexible scheduleSenior-level Full TimeAnn Arbor, MI, Remote - US R16h ago
-
Data Science Senior Associate - Digiops Analytics USD 170K-201KA/B | A/B Testing | Adobe Analytics | Advanced Analytics | AlteryxBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersMid-level Full TimeWilmington, DE, United States17h ago
-
Senior Systems Engineer, Technical Solutions (US-East) USD 110K-160KAI coding | AI coding tools | API Design | Agent Frameworks | AutomationBest in class onboarding | Continuous professional development | Generous global benefits | Hybrid workplace | Inclusion guilds and talksSenior-level Full TimeBoston, Massachusetts, USA; New York, New …17h ago
-
Senior AI Engineer USD 160K-250KAPI Design | Agent Orchestration | Agent systems | Audit Logging | Authentication401k eligibility | Flexible work environment | Hybrid work option | Paid time off | Parental leave eligibilitySenior-level Full TimeUnited States (Remote) R18h ago
-
Analytics Engineer – People Data USD 116K-193KAWS | Azure | Data Modeling | Data Reconciliation | Data TransformationHybrid work flexibility | Inclusion and Belonging Culture | Training and developmentSenior-level Full TimeMountain View, CA, United States18h ago
-
Senior Analytics Engineer, GTM USD 175K-244KBigQuery | ClickHouse | DBT | LLMs | PythonFlexible time off | Flexible work environment | Global gatherings | Healthcare employer contributions | Home office setupSenior-level Full TimeSan Francisco, USA (Hybrid) R18h ago
-
Software Engineer, Data Science USD 120K-162KAutomated testing | CI/CD | Clean Code | Code review | Data Modeling401k matching | Dental insurance | Disability insurance | Employee stock purchase program | Life insuranceSenior-level Full TimeCambridge, MA, United States18h ago
-
Budgeting | Campaign analytics | Data Analysis | Data Visualization | Financial ModelingSenior-level Full TimeUnited States19h ago
-
Senior Analytics Engineer, Product USD 175K-244KAI Automation | AI automation frameworks) | Analytics engineering | Automation frameworks | BigQueryEquity stock options | Flexible time off | Flexible work environment | Global gatherings | Healthcare employer contributionsSenior-level Full TimeSan Francisco, USA (Hybrid) R19h ago
-
Software Engineer II, Computational Platform USD 124K-154KAPIs | AWS | Cloud Networking | Data Modeling | Docker401k plan | Commuter support | Company-provided laptop | Flexible paid time off | Holiday payMid-level Full TimeRemote; Watertown, Massachusetts, United States R19h ago