Sr Data Engineer
Des Moines, IA, United States
USD 130K-164K (estimate) Senior-level Full Time
Tasks
- Build and maintain ETL/ELT pipelines
- Create runbooks and documentation
- Define lakehouse architecture and medallion architecture
- Design and implement scalable data pipelines
- Design enterprise data models
- Develop Databricks notebooks and workflows
- Ensure secure data access and compliance controls
- Establish data quality observability and governance controls
- Implement Delta Lake patterns
- Lead root cause analysis and preventative fixes
- Monitor data pipelines and resolve incidents
- Optimize Spark jobs performance
- Perform code reviews mentor and improve engineering practices
Perks/Benefits
- N/A
Skills/Tech-stack
ACID | Automated testing | Azure | Azure Data | Azure Data Factory | Azure Databricks | Bronze Silver Gold | CI/CD | Caching | Data Factory | Data Governance | Data Lineage | Data Modeling | Data Observability | Data Quality | Databricks | Delta Lake | ELT | ETL | Encryption | Lakehouse | Medallion Architecture | Metadata cataloging | Partitioning | Performance Tuning | PySpark | Python | Query Optimization | RBAC | SQL | Secrets management | Snowflake Schema | Spark | Star Schema | Unity Catalog
Education
Roles
Related jobs
-
Intelligent Systems Engineer II USD 98K-166KAPIs | AWS Lambda | AWS S3 | Amazon Web Services | Artificial Intelligence401k match | Community service day | Dental insurance | Flexible spending accounts | Life insuranceMid-level Full TimeWest Chester, OH, United States8h ago
-
Intelligent Systems Engineer II USD 98K-166KAPI Gateway | APIs | AWS | Artificial Intelligence | Automated testing401k match | Community service day | Flexible spending accounts | Life insurance | Medical/Dental/Vision insuranceMid-level Full TimeWest Chester, OH, United States8h ago
-
Senior Backend Engineer USD 160K-220KAWS | Asynchronous processing | CI/CD | Cloud infrastructure | Debugging401k access | Career growth | Flexible PTO | Health, dental, vision coverage | Paid mealsSenior-level Full TimeSan Francisco, CA, US10h ago
-
AI Architect USD 111K-139KAI Search | Azure | Azure AI | Azure AI Search | Azure DevOps401k match | Employee discounts | Financial wellness planning | Great Place to Work certified | Health, dental and vision coverageSenior-level Full TimeCincinnati, Ohio, USA11h ago
-
AI Architect USD 148K-185KAI Search | Authentication | Azure | Azure AI | Azure AI Search401k match | Employee discounts | Financial wellness planning | Great Place to Work certification | Health, dental and vision coverageSenior-level Full TimeTampa, Florida, USA11h ago
-
Software Engineer III, AI/ML Machine Learning, Core USD 147K-210KAI/ML | AI/ML model development | Artificial Intelligence | C++ | CI/CDSenior-level Full TimeAustin, TX, USA13h ago
-
Imaging Machine Learning Engineer USD 132K-189K3A Tuning | Algorithm Development | Benchmarking | C++ | CalibrationMid-level Full TimeMountain View, CA, USA13h ago
-
Software Engineer III, AI/ML, AI and Infrastructure USD 147K-210KC++ | Code review | Data Processing | Data Storage | DebuggingSenior-level Full TimeSunnyvale, CA, USA13h ago
-
Senior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL15h ago
-
Algorithm Engineer, Battlespace Awareness USD 126K-167KAgile Development | C++ | Classification | Clustering | ControlsHealth benefits | Paid time off | Recovery BenefitsMid-level Full TimeBroomfield, Colorado, United States; Fort Collins, …22h ago
-
Algorithm Developer, Battlespace Awareness USD 126K-167KAgile | C++ | Clustering | Data Association | DebuggingMid-level Full TimeBroomfield, Colorado, United States; Fort Collins, …22h ago
-
Senior Algorithm Engineer, Battlespace USD 190K-252KAgile | C++ | Classification | Clustering | ControlsSenior-level Full TimeBroomfield, Colorado, United States; Fort Collins, …23h ago
-
Senior Embedded Linux Engineer, C++ USD 169K-216KAnalog electronics | Bare Metal | C Programming | C programming language | C#401k employer match | Cell phone reimbursement | Dinner provided twice weekly | EV charging | Flexible PTOSenior-level Full TimeEl Segundo, California, United States1d ago
-
Embedded Linux Engineer, C++ USD 131K-184KAnalog electronics | Bare Metal | C++ | CAN | CCSDS401k employer match | Cell phone reimbursement | EV charging | Flexible PTO | HSA employer matchEntry-level Full TimeEl Segundo, California, United States1d ago
-
Sr. Lead Software Engineer - Data Engineer USD 170K-186KAWS | Agentic AI | Agile | Apache Iceberg | Best practicesSenior-level Full TimeJersey City, NJ, United States1d ago
-
.NET | AI Foundry | Agile | Angular | App Service401 K | Employee stock ownership plan | Free hot lunches | Health, dental, vision insurance | Long-term disability insuranceSenior-level Full TimeLakeland, FL, Florida, 333 E Lemon …1d ago
-
AI Engineer USD 102K-170KArtificial Intelligence | Caching | Cloud Native | Cloud Native Services | Context window401k retirement plan | Adoption Assistance | Company-Paid Holidays | Dental insurance | Emergency back-up childcareSenior-level Full TimeHome Office: Huntsville, AL, United States1d ago
-
Senior Data Analytics Consultant USD 113K-188KData Integrity | Data Security | Data Visualization | Data pipeline | ETL401k retirement plan | Adoption Assistance | Dental insurance | Employee referral program | Flexible spending accountSenior-level Full TimeClient Office: Huntsville, AL, United States1d ago
-
Senior Data Engineer USD 28KAgentic AI | Agile | Apache Iceberg | CI/CD | Confluence401k plan | Commuter benefits | Disability benefits | Life insurance | Paid time offSenior-level Full Time142019-NC-300 South Brevard, Charlotte, United States1d ago
-
API Development | Accessibility | Apache JMeter | Apache Kafka | Apache Spark401k match | Adoption Assistance | Healthcare benefits | Life insurance | Long-term disabilitySenior-level Full TimeIrving, TX, United States R1d ago
-
Senior UX Developer (NIH Data Lakehouse Support) USD 110K-149KAWS | Azure | CI/CD | CSS | DatabricksPublic trust required clearance process | Remote workSenior-level Full TimeUSA MD Home Office (MDHOME), United … R1d ago
-
Digital Electrical Engineer – Embedded Controls USD 90K-130KADC | C# | C++ | Command Response Protocols | DAC401k plan | Dental insurance | Life insurance | Long-term disability | Medical insuranceMid-level Full TimeNatick, MA ,01760, MA1d ago
-
Machine Learning Engineer II USD 111K-231KApache Kafka | Apache Spark | Big Data | Cloud platform | Data pipeline401k | Backup childcare | Education stipends | Health insurance | Hybrid workMid-level Full TimeUS - United States of America R1d ago
-
Senior AI Engineer (Remote) USD 100K-250KAPI Integration | Agent systems | Agentic Reasoning | Automated rollback | Automated testing401k | ESPP | Health care benefits | Paid time off | Success sharing bonusSenior-level Full TimeSTORE SUPPORT CENTER, ATLANTA - 9090, … R1d ago
-
Lead Engineer - AI Engineering USD 89K-148KGPT | Git | Hugging Face | Language Models | Language Processing401k match | Disability benefits | Employee assistance program | Health Coach | Life insuranceSenior-level Full TimeNiskayuna, United States R1d ago