Sr Data Engineer
Des Moines, IA, United States
USD 120K-153K (estimate) Senior-level Full Time
Tasks
- Build ETL/ELT pipelines
- Create documentation and runbooks
- Define medallion architecture
- Design lakehouse data models
- Design scalable data pipelines
- Develop and optimize Databricks notebooks
- Ensure compliance controls validation
- Implement Delta Lake governance
- Implement data quality validation
- Implement secure data access and encryption
- Integrate on-premises and cloud systems
- Lead technical delivery and stakeholder alignment
- Monitor and optimize Spark jobs
- Perform code reviews and mentoring
- Perform root cause analysis for failures
- Set up data lineage and cataloging
Perks/Benefits
- N/A
Skills/Tech-stack
Azure | Azure Data | Azure Data Factory | Azure Databricks | CI/CD | Caching | Code review | Data Factory | Data Governance | Data Lineage | Data Modeling | Data Quality | Data Validation | Data profiling | Delta Lake | ELT | ETL | Encryption | Lakehouse | Least Privilege | Medallion Architecture | Metadata catalog | Partitioning | Performance Tuning | PySpark | Query Optimization | RBAC | SQL | Secrets management | Snowflake Schema | Spark | Star Schema | Unity Catalog
Education
Roles
Related jobs
-
Automation Testing | CI/CD | CSS | Cypress | Feature DevelopmentMedical, dental & vision coverage | Paid time off | Parental leave | Reimbursement programs | Retirement planMid-levelRaleigh, United States R10d ago
-
Product Engineering, Full Sack Engineer USD 85K-142K.NET | .Net Core | AWS | Agile | AngularMentorship | Professional development | Travel opportunitiesNone Full TimeNew York, New York, United States6h ago
-
Content Safety | Data Modeling | Feature Engineering | Graph Databases | Information RetrievalSenior-level Full TimeSan Jose, California, United States6h ago
-
Partner Engineering GenAI - US USD 133K-203KAPIs | Artificial Intelligence | C plus plus | Claude | Cloud ComputingSenior-level Full TimeMenlo Park, CA | Seattle, WA …7h ago
-
Software Developer, Scaled Ops AI Acceleration Team USD 147K-203KAI infrastructure | Data Mining | Fine Tuning | Hack | JavaScriptSenior-level Full TimeSunnyvale, CA | Austin, TX | …7h ago
-
Automated testing | C++ | CSS | Debugging | GraphQLSenior-level Full TimeMenlo Park, CA7h ago
-
Code review | Contamination Checking | Data Generation | Data Pipelines | Data ProcessingEntry-level Full TimeMenlo Park, CA7h ago
-
Business Support Engineer USD 136K-197KCall Support | Cloud Computing | Data Analysis | Data Mining | Docker24x7 on-call rotationEntry-level Full TimeMenlo Park, CA7h ago
-
Business Support Engineer USD 159K-223KCloud Computing | Data Analysis | Data Mining | Distributed Systems | Docker24x7 on-call rotation | Cross-functional team collaboration | Global partner supportSenior-level Full TimeMenlo Park, CA7h ago
-
Senior-level Full TimeMenlo Park, CA | New York, …7h ago
-
Research Engineer, Media Data Research - MSL FAIR USD 170K-251KComputer Vision | Data Curation | Data Generation | Data Scaling Laws | Data mixingSenior-level Full TimeMenlo Park, CA7h ago
-
Technical Solutions Engineer, Cloud AI, Google Cloud USD 150K-218KAI Model Training | AI model | Apache Beam | Apache Hadoop | Apache SparkSenior-level Full TimeSunnyvale, CA, USA; Austin, TX, USA7h ago
-
Principal AI Engineer - Core Platform USD 250K-290KAWS | Agents SDK | Anomaly Detection | Automated testing | Classification401k match | Company-provided phone | Health insurance | Hybrid work | PTOSenior-level Full TimeNew York, New York, United States14h ago
-
Engineer, AI Dev Tools USD 90K-120KAPI Integration | Agent architecture | Artificial Intelligence | Containerization | Data Modeling401k | Dental insurance | Health insurance | Hybrid work | Paid HolidaysMid-level Full TimeMinnetonka, MN, US17h ago
-
Principal Engineer, AI Model LifeCycle USD 260K-326KAdapters | Checkpointing | DPO | DeepSpeed | Distributed TrainingCell phone stipend | Commuter benefits | Dental insurance | Health insurance | Mental health wellness supportSenior-level Full TimeSan Francisco, CA - US18h ago
-
AWS Glue | AWS Lambda | Amazon SQS | Apache Spark | Ataccama401k match | Dental insurance | Employee assistance program | Employee stock purchase plan | Health insuranceSenior-level Full TimeIrving - 6011 Connection, United States18h ago
-
Pr Data Steward, Scientific/CMC USD 137K-235KControlled vocabulary | Data Curation | Data Dictionary | Data Governance | Data ModelingMid-level Full TimeUS026 PA Spring House - 1400 …18h ago
-
Agent workflows | Audit Logging | Automated testing | CI/CD | Cloud Engineering401k retirement plan | Adoption Assistance | Dental insurance | Emergency back-up childcare | Flexible spending accountsSenior-level Full TimeHome Office: Tysons, VA, United States18h ago
-
Senior-level Full TimeSan Jose, CA, United States18h ago
-
Senior Software Engineer, Data Platform USD 164K-227KAccess Control | Airflow | Amazon Kinesis | Amazon Redshift | Apache Flink401k match | Community volunteer time | Commuter benefit | Company-paid days off | Dental insuranceSenior-level Full TimeSan Francisco, CA, USA R19h ago
-
Senior AI Solutions Builder, People USD 134K-192KAgent Development | Artificial Intelligence | Automation | Coding | Data GovernanceSenior-level Full TimeRemote, United States R19h ago
-
Data Engineer USD 100KAPIs | Apache Kafka | Apache Spark | Azure | Azure Data401k match | Dental insurance | Life insurance | Medical insurance | Paid sick leaveEntry-level Full TimeRemote, US R19h ago
-
AI Analytics Engineer (Business Analytics) USD 141K-193KAnomaly Detection | DBT | Dashboards | Data Modeling | Data PipelinesMid-level Full TimeSan Francisco, CA; Austin, TX; New …19h ago
-
AI Analytics Engineer (AI & Analytics Platform) USD 141K-193KAgent architecture | Anomaly Detection | BI Semantic Modeling | Clustering | DBTEntry-level Full TimeSan Francisco, CA; Austin, TX; New …19h ago
-
Bulk Inference | C++ | Data Mining | Data Pipelines | Data QualitySenior-level Full TimeMountain View, CA, USA19h ago