Sr Data Engineer
Des Moines, IA, United States
USD 120K-153K (estimate) Senior-level Full Time
Tasks
- Build ETL/ELT pipelines
- Create documentation and runbooks
- Define medallion architecture
- Design lakehouse data models
- Design scalable data pipelines
- Develop and optimize Databricks notebooks
- Ensure compliance controls validation
- Implement Delta Lake governance
- Implement data quality validation
- Implement secure data access and encryption
- Integrate on-premises and cloud systems
- Lead technical delivery and stakeholder alignment
- Monitor and optimize Spark jobs
- Perform code reviews and mentoring
- Perform root cause analysis for failures
- Set up data lineage and cataloging
Perks/Benefits
- N/A
Skills/Tech-stack
Azure | Azure Data | Azure Data Factory | Azure Databricks | CI/CD | Caching | Code review | Data Factory | Data Governance | Data Lineage | Data Modeling | Data Quality | Data Validation | Data profiling | Delta Lake | ELT | ETL | Encryption | Lakehouse | Least Privilege | Medallion Architecture | Metadata catalog | Partitioning | Performance Tuning | PySpark | Query Optimization | RBAC | SQL | Secrets management | Snowflake Schema | Spark | Star Schema | Unity Catalog
Education
Roles
Related jobs
-
Data Engineer (remote) USD 85K-100KAgile | Apache Spark | Artificial Intelligence | Azure Data | Azure Data Factory401k match | Employee assistance program | Flexible schedule | Health insurance | Paid parental leaveMid-level Full TimeWork From Home, United States R9h ago
-
AWS Data | AWS Data Warehouse | Amazon Web Services | Data Warehouse | SQLContract role | On site 3 days per weekMid-level Full TimeHouston, TX, United States10h ago
-
Data Engineer ID50062 USD 148K-164KAWS | AWS SageMaker | AWS SageMaker Studio | Airflow | Apache SparkEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeBlacksburg, United States11h ago
-
Full Stack Developer - Cloud Engineer USD 107K-160KAPI Design | Agile | Amazon SageMaker | Analytical Data | Analytical Data WarehouseMid-level Full TimeColumbus, Ohio, United States12h ago
-
Sr. Tech Lead, GTM Applied AI & Analytics USD 150K-243KAirflow | Data Warehousing | Databricks | Fine Tuning | LLM APIsSenior-level Full TimeSan Francisco, CA, United States13h ago
-
Data Engineer, Analytics USD 205K-235KData Governance | Data Modeling | Data Quality | Data Security | Data VisualizationEntry-level Full TimeSeattle, WA14h ago
-
Software Engineer, Machine Learning USD 185K-200KClassification | Computer Vision | Data Mining | Data Regression | Deep learningMid-level Full TimeMenlo Park, CA14h ago
-
Data Engineer (Analytics) USD 191K-235KBig Data | Data Modeling | Data Warehousing | Data integration | Dimensional ModelingDomestic and international travel | TelecommutingMid-level Full TimeMenlo Park, CA | Remote, US R14h ago
-
AI Engineer, Professional Services, Google Cloud USD 183K-265KApache Beam | Apache Spark | C++ | Data Validation | Data WarehousingTechnical workshops | Travel opportunitiesSenior-level Full TimeAustin, TX, USA; Atlanta, GA, USA14h ago
-
Automation | C++ | CSS | Database Design | HTMLMid-level Full TimeAnn Arbor, MI, USA14h ago
-
Software Engineering - DataStage Developer USD 112K-129KAxway | Axway Secure SFTP | Azure | Azure DevOps | CA7 SchedulerHybrid work schedule | Remote workMid-level Full TimeSyracuse, New York, United States17h ago
-
Mid-level Full TimeFlorida, United States18h ago
-
Senior Data Engineer - Knowledge Platform USD 160K-260KApache Airflow | Apache NiFi | Batch Processing | BigQuery | Cloud platformEquity compensation | Fully stocked kitchen | Open office space | Team building eventsSenior-level Full TimeUS - San Francisco21h ago
-
Robotics Application & Product Security Engineer USD 90K-300KAPI Security | Adversarial analysis | Application Security | Artifact signing | AuthenticationHybrid or remote optionSenior-level Full TimeIrvine, CA22h ago
-
Senior Analytics Engineer USD 87K-161KData Lakehouse | Data mesh | Databricks | Delta Lake | ETL401k | Health insurance | Hybrid work | Paid time off | Remote workSenior-level Full TimeRemote-MO, United States R1d ago
-
Data Engineer II USD 63K-114KData Processing | ETL | Real Time | Real-time Data | Real-time Data Processing401k | Flexible work schedule | Health insurance | Paid time off | Tuition reimbursementMid-level Full TimeRemote-MN, United States R1d ago
-
Senior Geospatial Data Engineer USD 90K-189KAgile | ArcGIS Enterprise | ArcGIS Server | CI/CD | FionaFlexible time off | Learning resourcesSenior-level Full Time437 DENVER CO, United States1d ago
-
Lead, Data Platform Engineer USD 132K-150KApache Airflow | DBT | Data Pipeline Monitoring | Data Quality | Data Transformation401k retirement plan | Dental insurance | Health insurance | Holiday pay | Parental leaveSenior-level Full TimeUS063 NJ Raritan - 920 US …1d ago
-
Quantitative Analyst, Portfolio Engineering & Analytics USD 120K-135KAPI Development | AWS | Azure | Cloud platform | FastAPI401k matching | Employee stock purchase plan | Flexible paid time off | Health and wellbeing benefits | Hybrid work scheduleMid-level Full TimeBoston, United States1d ago
-
Scientist III, Data Engineer USD 161K-186KACID | API Gateway | AWS API | AWS API Gateway | AWS CodePipeline401k | Accident insurance | Commuter benefits | Dental insurance | Employee assistance programSenior-level Full TimeUS - Waltham, MA - 168 … R1d ago
-
Sr Engineer, Data Integration USD 101K-175K.NET | Azure | Cloverleaf Interface Engine | Csharp | EDIHealthcare benefits | Incentive programs | Professional development | Remote work | Retirement benefitsSenior-level Full TimeWork at Home - Ohio - … R1d ago
-
CI/CD | Experimentation | Feature Engineering | Language Models | Language ProcessingDental insurance | Income protection | Medical insurance | Paid Holidays | Paid family leaveSenior-level Full TimeLongmont, CO, United States1d ago
-
AI/ML Engineer (Senior Associate) - Remote USD 130K-188KAPI Development | AWS | Autogen | Azure | CI/CDDental insurance | Medical insurance | Remote work | Travel as needed | Vision insuranceSenior-level Full TimeChicago - 550 Van Buren, United … R1d ago
-
Lead AI Engineer USD 150K-230KAI Services | Agile | Angular | Argo CD | CI/CD401k matching | Career growth | Healthcare benefits | Online learning platform | Paid time offSenior-level Full TimeUSA - Georgia - Alpharetta - …1d ago
-
AWS | Agile | CSS | Docker | GoPerformance-Based Incentives | Remote eligibleSenior-level Full TimeMcLean, VA, United States R1d ago