Sr Data Engineer
Des Moines, IA, United States
USD 130K-164K (estimate) Senior-level Full Time
Tasks
- Administer Databricks using Unity Catalog and cluster policies
- Build ETL/ELT pipelines
- Create runbooks and alerts
- Define lakehouse architecture and reference patterns
- Design data models for analytics and reporting
- Design scalable data pipelines
- Develop and optimize Databricks notebooks and workflows
- Enforce secure data access with RBAC
- Ensure compliance controls validation and documentation
- Ensure data lineage and metadata governance
- Implement Delta Lake patterns
- Implement automated data validation and profiling
- Implement encryption and secrets management
- Implement ingestion and transformation frameworks
- Lead Medallion architecture implementation
- Lead troubleshooting and root cause analysis
- Maintain architecture documentation and runbooks
- Monitor and optimize Spark jobs
- Perform code reviews and automated testing
- Perform performance tuning and cost optimization
- Support CI/CD and version control
- Translate business requirements into technical designs
Perks/Benefits
- N/A
Skills/Tech-stack
Automated testing | Azure Data | Azure Data Factory | Azure Databricks | CI/CD | Data Factory | Data Lineage | Data Modeling | Data Quality | Data Validation | Data profiling | Databricks | Delta Lake | ELT | ETL | Encryption | Lakehouse | Least Privilege | Medallion Architecture | Metadata Management | Performance Tuning | PySpark | RBAC | SQL | Secrets management | Snowflake Schema | Spark | Star Schema | Unity Catalog | Version control
Education
N/A
Roles
Related jobs
-
Senior Data Engineer USD 109K-164KAI Services | Azure AI | Azure AI Services | Azure Data | Azure Data Factory401k retirement plan | Employee assistance program | Health spending account | Life insurance | Long-term disabilitySenior-level Full TimeAustin, Texas, USA R5h ago
-
ANSI SQL | Amazon Redshift | Analytical modeling | Cloud Data | Cloud Data PlatformsCareer growth | Onsite work | Possible contract extension | Successful Completion Bonus | Support from consultantsMid-level Full TimeJuno Beach, FL; Juno Beach, FL; …9h ago
-
AWS | Bitbucket | Confluence | Data Analysis | Eclipse401k employer contribution | Direct contribution to 401k vesting | Educational assistance | Federal Holidays | Healthcare benefitsSenior-level Full TimeAnnapolis Junction, Maryland; Annapolis Junction, Maryland; …9h ago
-
Software Engineer 1 - (Python, UI/UX, LLM) USD 169K-207KAWS | Argo CD | CI/CD | Containerization | Docker401k match | Educational assistance | Federal Holidays | Healthcare coverage | PTOMid-level Full TimeAnnapolis Junction, Maryland9h ago
-
Senior Applied AI Engineer 3 - (Python, LLMs, RAG) USD 241K-295KAI Agents | APIs | Backend Development | Data Pipelines | Docker401k matching | Education assistance | Healthcare coverage | Paid time offSenior-level Full TimeAnnapolis Junction, Maryland9h ago
-
Part Time Student - Robotics Engineer - Ames, IA USD 30K-80KArduino | C plus plus | Computer Vision | Data Analysis | JavaAdoption Assistance | Employee assistance programs | Fitness subsidies | Flexible work arrangements | Healthcare benefitsEntry-level Part TimeAmes, IA,Iowa,United States9h ago
-
AI Strategy Lead USD 192K-278KAgentic AI | Artificial Intelligence | As-a-Service | Business Intelligence | Data AnalysisSenior-level Full TimeChicago, IL, USA; Sunnyvale, CA, USA14h ago
-
Staff ML Engineer, Search Ads Shopping Relevance Models USD 207K-300KC++ | CI/CD | Data Analysis | Data Processing | Deep learningSenior-level Full TimeMountain View, CA, USA14h ago
-
Senior Data Engineer USD 122K-161KAPI Integration | AWS | Apache Beam | Apache Flink | Apache SparkRemote workSenior-level Full TimeUnited States R21h ago
-
Senior-level Full TimeSan Francisco, California1d ago
-
Care Innovation - Senior Solution Engineer 135-2034 USD 113K-175K.NET | App Service | Autogen | Azure App | Azure App ServiceSenior-level Full TimeTulsa, OK, US1d ago
-
AI Software Engineer USD 160K-250KAWS | Agent Orchestration | Async Python | CI/CD | Context ManagementEquity awards | Health insurance | Performance based cash bonus | Remote work opportunityMid-level Full TimeNew York, New York, United States R1d ago
-
Mid-level Full TimeUSA VA Home Office (VAHOME), United … R1d ago
-
Azure Databricks Platform Engineer USD 128K-216KApache Spark | Azure Data | Azure Data Explorer | Azure Data Lake | Azure Data Lake StorageMid-level Full TimeBerkeley Heights, New Jersey, United States1d ago
-
MLOps Automation Engineer Lead USD 77K-154KAWS | AWS EKS | Ansible | Backup | Business ContinuityFlexible work arrangement | Work from homeSenior-level Full TimeEaston Ops Cols C Oh, United … R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Data Engineer-Nordic OMOP USD 93K-163KAWS | Azure | CI/CD | Data Marts | Data ModelingChildcare discounts | Comprehensive medical, dental and vision benefits | Continued education and training | Discounts to wellness centers | Employer-funded pension planSenior-level Full TimeRemote - VA, United States R1d ago
-
Data Engineer, Senior USD 77K-176KAgile | Azure Data | Azure Data Factory | Azure DevOps | Azure FunctionsDependent care | Paid leave | Professional development | Tuition assistance | Work-life programsSenior-level Full TimeUSA, GA, Atlanta (575 Morosgo Drive … R1d ago
-
Lead Machine Learning Engineer USD 179K-204KAWS | Azure | Bias Variance | Bias-Variance Tradeoff | CI/CDSenior-level Full TimeChicago, IL, United States1d ago
-
Sr AI/ML Engineer - Remote USD 120K-214KAgent Orchestration | Agent communication | Agent to Agent | Agent-to-Agent Communication | CI/CDRemote work flexibilitySenior-level Full TimePrimary location: Minnetonka, Minnesota1d ago
-
AI/ML Engineer USD 98K-176KDatabricks | Deep learning | Docker | Embeddings | GitHub Copilot401k contribution | Comprehensive benefits package | Equity stock purchase | Incentive and recognition programs | Telecommute within USMid-level Full TimePrimary location: Minnetonka, Minnesota1d ago
-
Sr. AI Engineer - Remote or Hybrid in Eden Prairie, MN USD 120K-214KAPI Development | AWS | Agent systems | Agentic AI | Azure401k contribution | Comprehensive benefits package | Equity stock purchase | Hybrid work option | Incentive and recognition programsSenior-level Full TimePrimary location: Minnetonka, Minnesota1d ago
-
AI Solution Engineer USD 150K-170KA/B | A/B Testing | AI Foundry | Access Management | Agent OrchestrationSenior-level Full TimeRemote, FL, United States R1d ago
-
Public Health Data Engineer USD 70K-116KAWS | Azure | CI/CD | Data Modeling | Data Quality401k retirement plan | Certifications and learning opportunities | Employee assistance program | Employee referral program | Flexible spending accountsEntry-level Full TimeGH Office: San Antonio, TX (9903 …1d ago
-
Mid-level Full TimeRemote-Texas, United States R1d ago