Sr Data Engineer
Des Moines, IA, United States
USD 130K-164K (estimate) Senior-level Full Time
Tasks
- Build and maintain ETL/ELT pipelines
- Create runbooks and documentation
- Define lakehouse architecture and medallion architecture
- Design and implement scalable data pipelines
- Design enterprise data models
- Develop Databricks notebooks and workflows
- Ensure secure data access and compliance controls
- Establish data quality observability and governance controls
- Implement Delta Lake patterns
- Lead root cause analysis and preventative fixes
- Monitor data pipelines and resolve incidents
- Optimize Spark jobs performance
- Perform code reviews mentor and improve engineering practices
Perks/Benefits
- N/A
Skills/Tech-stack
ACID | Automated testing | Azure | Azure Data | Azure Data Factory | Azure Databricks | Bronze Silver Gold | CI/CD | Caching | Data Factory | Data Governance | Data Lineage | Data Modeling | Data Observability | Data Quality | Databricks | Delta Lake | ELT | ETL | Encryption | Lakehouse | Medallion Architecture | Metadata cataloging | Partitioning | Performance Tuning | PySpark | Python | Query Optimization | RBAC | SQL | Secrets management | Snowflake Schema | Spark | Star Schema | Unity Catalog
Education
Roles
Related jobs
-
Senior-level Full TimeUSA-VA-Arlington4h ago
-
Sr. AI Engineer – Enterprise Agentic AI USD 191K-286KA2A | AI Copilot | AI Foundry | Agent to Agent | Agentic AIEquity compensation | Health and wellness benefits | Paid time offSenior-level Full TimeCalifornia, Sunnyvale4h ago
-
Java Python AWS Developer USD 88K-127KAPI Gateway | AWS | AWS Bedrock | AWS CloudWatch | AngularLimited travel | Remote work flexibilityEntry-level Full TimePhiladelphia, Pennsylvania, United States4h ago
-
Senior Data Engineer USD 130K-226KAzure | Azure Machine Learning | Azure Synapse | CI | CI/CD401k savings plan | Dental insurance | Employee recognition | Employee referral bonuses | HealthcareSenior-level Full TimeWashington, District of Columbia, United States5h ago
-
Data Engineer, Data Architecture and Engineering, gData USD 130K-188KC++ | Data Modeling | Data Processing | Data Warehouse | Distributed dataSenior-level Full TimeSunnyvale, CA, USA; Boulder, CO, USA5h ago
-
Staff Software Engineer, BigQuery Agentic AI USD 207K-301KAutogen | Back-end | Back-end development | BigQuery | Cloud infrastructureSenior-level Full TimeKirkland, WA, USA5h ago
-
ATA | C# | C++ | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA5h ago
-
Customer Engineer, Data Management, Retail, Google Cloud USD 152K-222KAutomation tools | Big Data | Big Data Technologies | Cloud Native | Cloud Native ArchitectureSenior-level Full TimeAustin, TX, USA; Atlanta, GA, USA5h ago
-
Software Engineer III, Perception, XR USD 147K-211KAudio Processing | Data Processing | Data analytics | Experiment frameworks | JavaSenior-level Full TimeSan Jose, CA, USA5h ago
-
Senior Software Engineer, AI/ML Infrastructure, Ads USD 174K-253KC plus plus | Data Processing | Debugging | Distributed Computing | JavaSenior-level Full TimePittsburgh, PA, USA5h ago
-
CAN | DNP3 | Data Visualization | Docker | Firmware Over The AirSenior-level Full TimeSan Francisco, California, United States10h ago
-
Senior Staff Software Engineer - AI/ML - Veza USD 171K-300KAPI Design | AWS | Access Management | Agent systems | Agentic Workflows401k plan | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeMinneapolis, Minnesota, United States11h ago
-
Software Engineer, Research Acceleration USD 350K-475KDistributed Systems | Evaluation Frameworks | Experiment tracking | JAX | Machine LearningDental insurance | Health insurance | Paid parental leave | Relocation support | Unlimited PTOSenior-level Full TimeSan Francisco11h ago
-
Senior Machine Learning Engineer, Ad Serving USD 195K-435KData Science | Experimentation | Feature Engineering | Java | Machine LearningDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeBoston, Massachusetts12h ago
-
Senior Machine Learning Engineer, Ad Serving USD 195K-510KDistributed Systems | Experimentation | Feature Engineering | Java | Machine LearningDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeNew York, New York12h ago
-
Engineer II, Embedded, Sensors, and Safety Software USD 120K-135KC# | C++ | CAN | CI/CD | Computer Vision401k retirement | Dental insurance | Flexible spending account | Flexible time off | Health insuranceSenior-level Full TimeHenderson, CO13h ago
-
Staff Software Engineer - AI/ML USD 192K-260KChurn modeling | Fine Tuning | Generative AI | Language Models | Large Language ModelsSenior-level Full TimeNew York City, New York16h ago
-
Mid-level Full TimeUnited States16h ago
-
Senior Software Engineer, Data Foundation USD 189K-256KDjango | Go | High Volume | High-volume APIs | Python401k | Enhanced parental leave | Generous vacation | Holiday Breaks | Medical, dental & vision coverageSenior-level Full TimeSan Francisco, US (Hybrid) R16h ago
-
ML/AI Engineer - Vehicle Intelligence USD 189K-261KData Privacy | Digital Twins | Digital modeling | Edge Computing | Foundation ModelsMid-level Full TimeSunnyvale, United States17h ago
-
Software Dev Engineer, Redshift Catalog Service USD 165K-223KC# | C++ | Caching | Concurrency | Database Internals401k matching | Adoption reimbursement | Employee assistance program | Flexible work hours | Health insuranceMid-level Full TimeEast Palo Alto, California, USA17h ago
-
Software Engineer - Data Platform USD 162K-216KAPI Development | Data Ingestion | Data Modeling | Data Pipelines | Data Streaming401k matching | Collaborative work environment | Comprehensive health coverage | Employee stock purchase program | Hybrid work scheduleMid-level Full TimeSan Francisco, California, United States17h ago
-
Robotics Software Engineer USD 166K-220KAI | Behavior Trees | C++ | Computer Vision | Data AnalysisTravel opportunitiesMid-level Full TimeCosta Mesa, California, United States17h ago
-
Software Engineer II - Data Platform USD 116K-162KAirflow | BigQuery | DBT | Docker | GoFlexible time off | In-office workspace | LinkedIn Learning access | Medical insurance | Paid HolidaysMid-level Full TimeUnited States (Remote) R17h ago
-
Senior Software Engineer, Computational Engineering USD 141K-194KC++ | CAD | CAM | CI/CD | Cloud NativeCompany holidays | Company-sponsored life insurance | Health insurance | Long-term disability | Paid parental leaveSenior-level Full TimeTorrance, California, United States17h ago