Sr Data Engineer
Des Moines, IA, United States
USD 120K-153K (estimate) Senior-level Full Time
Tasks
- Build ETL/ELT pipelines
- Create documentation and runbooks
- Define medallion architecture
- Design lakehouse data models
- Design scalable data pipelines
- Develop and optimize Databricks notebooks
- Ensure compliance controls validation
- Implement Delta Lake governance
- Implement data quality validation
- Implement secure data access and encryption
- Integrate on-premises and cloud systems
- Lead technical delivery and stakeholder alignment
- Monitor and optimize Spark jobs
- Perform code reviews and mentoring
- Perform root cause analysis for failures
- Set up data lineage and cataloging
Perks/Benefits
- N/A
Skills/Tech-stack
Azure | Azure Data | Azure Data Factory | Azure Databricks | CI/CD | Caching | Code review | Data Factory | Data Governance | Data Lineage | Data Modeling | Data Quality | Data Validation | Data profiling | Delta Lake | ELT | ETL | Encryption | Lakehouse | Least Privilege | Medallion Architecture | Metadata catalog | Partitioning | Performance Tuning | PySpark | Query Optimization | RBAC | SQL | Secrets management | Snowflake Schema | Spark | Star Schema | Unity Catalog
Education
Roles
Related jobs
-
Lead Data Engineer – Azure Databricks USD 150K-180KARIMA | Azure Databricks | Data Processing | Data analytics | Machine LearningOnsite workSenior-level Full TimeTampa, United States3h ago
-
HR Analytics & Technology Engineer USD 110K-204KAlteryx | Artificial Intelligence | Data Governance | Data Modeling | Data Quality401k matching | Generous time off | Onsite fitness center | Tuition reimbursementSenior-level Full TimeUS-Rhode Island-Providence4h ago
-
Cause analysis | Cloud Computing | Data Enrichment | Data Monitoring | Data Processing401k match | Dental insurance | Health insurance | Life insurance | Paid HolidaysSenior-level Full TimeNew York4h ago
-
Deloitte Technology - US Associate GenAI Engineer USD 80K-100K.Net Core | AWS | Agile | Angular | AzureMid-level Full TimeHermitage, Tennessee, United States4h ago
-
Senior-level Full TimeDallas, Texas, United States4h ago
-
AWS S3 | Almabase | Amazon Athena | Azure Data | Azure Data LakeMid-level Full TimeRemote within Texas, TX, US R8h ago
-
ALB | ALB/NLB | AWS | AWS CDK | AWS CloudSenior-level Full TimeDallas, Texas, United States13h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KCombinatorics | Graph theory | MATLAB | NumPy | Number theoryFlexible hours | Freelance opportunities | Project based workSenior-level FreelanceNew York, New York, United States … R16h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KC# | Combinatorics | Graph theory | MATLAB | NumPyFlexible hours | Part-time opportunities | Project based workSenior-level FreelanceTexas, United States - Remote R16h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KC# | MATLAB | NumPy | Pandas | PythonPart-time availability | Project based workSenior-level FreelanceMichigan, United States - Remote R16h ago
-
Technical Architect - Machine Learning USD 165K-200KAKS | AWS | Async Programming | Autogen | AzureSenior-level Full TimeUSA - Remote, United States R16h ago
-
Mid-level ContractPhoenix, AZ16h ago
-
Lead AI Engineer (Gen AI Platform Services) USD 215K-245KAWS | AWS Ultraclusters | Azure | C# | C++Senior-level Full TimeSan Jose, CA, United States16h ago
-
Associate Director of Embedded Software Engineering USD 200K-250KAMD UltraScale+ | AMD UltraScale+ MPSoC | Audio streaming | Board Support | Board Support Package401k match | Employee stock purchase plan | Hybrid work schedule | Medical/Dental/Vision | Paid HolidaysMid-level Full TimeLos Angeles, CA, United States R16h ago
-
Software Engineer I/II, Machine Learning USD 129K-190KAWS | Amazon S3 | Apache Airflow | Apache Arrow | CI/CD401k matching | Flexible spending account | Health insurance | Hybrid work | Life insuranceMid-level Full TimeBoston Office17h ago
-
API Development | AWS | Azure | Cloud platform | Compliance401k plan | Childcare discounts | Commuter benefits | Discounts at Marriott properties | Employee assistance planSenior-level Full TimeBethesda, MD, United States18h ago
-
Data Scientist Lead USD 175K-210KAWS | Apache Spark | Data Governance | Data Modeling | DatabricksBackup childcare | Financial coaching | Health care coverage | Mental health support | Onsite wellness centersSenior-level Full TimeOH, United States18h ago
-
Senior-level Full TimeSan Jose, CA, United States18h ago
-
Senior-level Full TimePalo Alto19h ago
-
Data Engineer Lead- PMS & QA USD 120K-160K21 CFR | 21 CFR part 820 | Applied statistics | CFR Part 820 | Data Integrity401k | Fertility benefits | Medical coverage | Paid time off | Parental leaveSenior-level Full TimeTrumbull, CT, United States19h ago
-
Lead AI Engineer - AI & Credit Analytics USD 156K-234KAWS | CI/CD | Data Governance | Generative AI | LLMOpsFlexible time off | Flexible work environment | Hybrid work option | Matching 401k | Medical/Dental/Vision insuranceSenior-level Full TimeCosta Mesa, CA, United States R19h ago
-
Senior-level Full TimePalo Alto19h ago
-
Software Engineer AI Data Platform - CoreAI USD 84K-180KAutomated testing | Batching | C# | C++ | CI/CDEntry-level Full TimeRedmond, WA, US19h ago
-
Software Engineer SME (TS/SCI with Poly Required) USD 187K-318KAPI | API Key | Amazon Kinesis | Amazon Web Services | Apache AirflowMid-level Full TimeChantilly, Virginia, United States19h ago
-
Software Engineer SME (TS/SCI with Poly Required) USD 187K-318KAWS | Anaconda | Apache NiFi | Azure | Azure MicroservicesMid-level Full TimeMcLean, Virginia, United States19h ago