Sr Data Engineer
Des Moines, IA, United States
USD 120K-153K (estimate) Senior-level Full Time
Tasks
- Build ETL/ELT pipelines
- Create documentation and runbooks
- Define medallion architecture
- Design lakehouse data models
- Design scalable data pipelines
- Develop and optimize Databricks notebooks
- Ensure compliance controls validation
- Implement Delta Lake governance
- Implement data quality validation
- Implement secure data access and encryption
- Integrate on-premises and cloud systems
- Lead technical delivery and stakeholder alignment
- Monitor and optimize Spark jobs
- Perform code reviews and mentoring
- Perform root cause analysis for failures
- Set up data lineage and cataloging
Perks/Benefits
- N/A
Skills/Tech-stack
Azure | Azure Data | Azure Data Factory | Azure Databricks | CI/CD | Caching | Code review | Data Factory | Data Governance | Data Lineage | Data Modeling | Data Quality | Data Validation | Data profiling | Delta Lake | ELT | ETL | Encryption | Lakehouse | Least Privilege | Medallion Architecture | Metadata catalog | Partitioning | Performance Tuning | PySpark | Query Optimization | RBAC | SQL | Secrets management | Snowflake Schema | Spark | Star Schema | Unity Catalog
Education
Roles
Related jobs
-
Data Engineer, Analytics USD 205K-235KData Governance | Data Modeling | Data Quality | Data Security | Data VisualizationEntry-level Full TimeSeattle, WA1h ago
-
Software Engineer, Machine Learning USD 185K-200KClassification | Computer Vision | Data Mining | Data Regression | Deep learningMid-level Full TimeMenlo Park, CA1h ago
-
Data Engineer (Analytics) USD 191K-235KBig Data | Data Modeling | Data Warehousing | Data integration | Dimensional ModelingDomestic and international travel | TelecommutingMid-level Full TimeMenlo Park, CA | Remote, US R1h ago
-
AI Engineer, Professional Services, Google Cloud USD 183K-265KApache Beam | Apache Spark | C++ | Data Validation | Data WarehousingTechnical workshops | Travel opportunitiesSenior-level Full TimeAustin, TX, USA; Atlanta, GA, USA1h ago
-
Software Engineering - DataStage Developer USD 112K-129KAxway | Axway Secure SFTP | Azure | Azure DevOps | CA7 SchedulerHybrid work schedule | Remote workMid-level Full TimeSyracuse, New York, United States4h ago
-
Senior Data Engineer - Knowledge Platform USD 160K-260KApache Airflow | Apache NiFi | Batch Processing | BigQuery | Cloud platformEquity compensation | Fully stocked kitchen | Open office space | Team building eventsSenior-level Full TimeUS - San Francisco9h ago
-
Robotics Application & Product Security Engineer USD 90K-300KAPI Security | Adversarial analysis | Application Security | Artifact signing | AuthenticationHybrid or remote optionSenior-level Full TimeIrvine, CA9h ago
-
Senior Analytics Engineer USD 87K-161KData Lakehouse | Data mesh | Databricks | Delta Lake | ETL401k | Health insurance | Hybrid work | Paid time off | Remote workSenior-level Full TimeRemote-MO, United States R13h ago
-
Data Engineer II USD 63K-114KData Processing | ETL | Real Time | Real-time Data | Real-time Data Processing401k | Flexible work schedule | Health insurance | Paid time off | Tuition reimbursementMid-level Full TimeRemote-MN, United States R13h ago
-
Applied AI ML-Senior Associate USD 177K-240KAWS | Algorithms | Azure | Data Quality | Data StructuresBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeNew York, NY, United States14h ago
-
Data Warehouse Engineer USD 46K-60KCorepoint | Data Modeling | Data Quality | Data Validation | Data Warehousing401k match | Dental insurance | Discount programs | Employee counseling | FSAEntry-level Full TimeRemote, United States R14h ago
-
Lead Machine Learning Engineer USD 157K-237KA/B | A/B Testing | Airflow | B testing | Data PipelinesSenior-level Full TimeUS TX Austin15h ago
-
C++/CUDA Systems Engineer – Surgical Robotics Platform USD 140K-160KC++ | C++17 | C++20 | CPU GPU Scheduling | CUDAEquity | Health insurance | Paid time off | Performance bonusMid-level Full TimeLos Angeles, California15h ago
-
Senior Machine Learning Engineer USD 170K-237KA/B | A/B Testing | Apache Airflow | B testing | Deep learningSenior-level Full TimeUS TX Austin15h ago
-
AWS Batch | AWS EC2 | AWS IAM | AWS Lambda | AWS S3Annual bonus | Company paid benefits | Equity | Paid time offSenior-level Full TimeLos Angeles, California15h ago
-
Principal Engineer, Data & ML Platform USD 119K-180KAPIs | Automated testing | Cloud Native | Cloud platform | Continuous DeploymentSenior-level Full TimeScottsdale, AZ15h ago
-
Market Risk Time Series Analytics - Analyst USD 165K-206KAPI Development | Data Imputation | Data Quality | Data Visualization | Distributed ComputingBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersMid-level Full TimeJersey City, NJ, United States15h ago
-
Sr Sales Engineer, West USD 160K-196KAnalytics | Apache Spark | Artificial Intelligence | Dataiku | Kubernetes401k match | Dental insurance | Employer paid disability coverage | Flexible spending accounts | Medical insuranceSenior-level Full TimeUnited States, Remote R15h ago
-
Data Engineer USD 129K-178KApache Kafka | Apache Spark | Cloud Platforms | Data Compliance | Data GovernanceMid-level Full TimeUS - Remote R16h ago
-
Data Analytics Engineer USD 150K-160KAmazon Redshift | BI | DBT | Data Marts | Data ModelingEquity package | Flexible working environment | Learning and development stipend | Paid Maternity Leave | Paid paternity leaveMid-level Full TimeNew York, NY16h ago
-
Data Engineer USD 140K-160KAI workflows | DBT | JavaScript | N8n | Python401k access | Dental insurance | Health insurance | Life insurance | Paid parental leaveMid-level Full TimeNew York, NY16h ago
-
Sr. Data Engineer USD 145K-160KAPI Development | AWS | AWS Glue | AWS Lambda | Amazon AthenaComplimentary club membership | Personal training | Pilates | Shop discounts | SpaßSenior-level Full TimeNew York, NY, United States16h ago
-
Distinguished Software Engineer, Data Infrastructure USD 248K-406KAI | Batch Processing | Data Infrastructure | Data Privacy | Data ProcessingExecutive-level Full TimeMountain View, CA, United States16h ago
-
Senior Machine Learning Engineer, Operations Research USD 173K-218KCombinatorial Optimization | Deep learning | Keras | Machine Learning | Mathematical ProgrammingAnnual refresh grants | Equity grant | Flexible work policy | Remote workSenior-level Full TimeUnited States - Remote R16h ago
-
Senior Customer Solutions Engineer - US USD 111K-176KAPI Scripting | Access Tokens | Active Directory | Airflow | Azure Active Directory401k plan | Flexible stipends | Health and wellness stipend | Healthcare coverage | Home office setup stipendSenior-level Full TimeUS - Remote R17h ago