Principal Data Engineer
Des Moines, IA, United States
USD 133K-165K (estimate) Senior-level Full Time
Tasks
- Build and maintain ETL/ELT pipelines
- Design and develop scalable data pipelines
- Develop and optimize Databricks notebooks and workflows
- Document data flows and operational procedures
- Enforce data governance and data lineage
- Implement CI CD for data engineering
- Implement Delta Lake
- Implement data validation and profiling
- Implement medallion architecture
- Implement role based access control and encryption
- Model data for analytics and reporting
- Monitor and tune Spark jobs
- Troubleshoot data pipeline failures
Perks/Benefits
- N/A
Skills/Tech-stack
Access Control | Azure Data | Azure Data Factory | Azure Databricks | CI/CD | Data Cleansing | Data Factory | Data Governance | Data Lineage | Data Modeling | Data Validation | Data profiling | Delta Lake | ELT | ETL | Encryption | Medallion Architecture | Metadata Management | PySpark | Role-Based Access | Role-Based Access Control | SQL | Snowflake Schema | Spark | Star Schema | Unity Catalog
Education
N/A
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer
Related jobs
-
Senior-level ContractAustin, United States3h ago
-
AI Search | Agile | Angular | Azure AI | Azure AI Search100 percent onsite | Public trust clearance requiredSenior-level ContractWoodlawn, United States3h ago
-
Senior Software Engineer - DevOps & Data Engineering USD 140K-190KAgentic Workflows | Automation | CI/CD | Claude | Cloud infrastructureSenior-level ContractChandler, United States3h ago
-
AI APIs | Backend Development | Data Engineering | Data Pipelines | Frontend DevelopmentMid-level ContractChandler, United States3h ago
-
Azure Databricks Developer USD 125K-198KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeLouisville, Kentucky, United States4h ago
-
Entry-level Full TimeUS-Kansas-Wichita4h ago
-
Mid-level Full TimeUS-Kansas-Wichita4h ago
-
Data Engineer II USD 101K-176KAWS | Agile | Airflow | Azure | Azure DevOps401k matching | Health & dental insurance | Onsite fitness center | Time off | Tuition reimbursementSenior-level Full TimeUS-Rhode Island-Providence4h ago
-
Linguistic Engineer USD 103K-156KBias Mitigation | Ethical AI | Hack | Knowledge graphs | Machine LearningMid-level Full TimeRedmond, WA5h ago
-
Staff Datacloud Blackbelt Engineer, Data and AI USD 183K-266KAI/ML | AI/ML workflows | BigQuery | Cloud Architecture | Computer VisionSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA6h ago
-
Database querying | Deep learning | Language Processing | Machine Learning | Natural LanguageMid-level Full TimeNew York, NY, USA; Mountain View, …6h ago
-
AI Engineer, Advanced Solutions Lab, Google Cloud USD 152K-222KApache Beam | Artificial Intelligence | Cloud platform | ELT | ETLSenior-level Full TimeChicago, IL, USA; Atlanta, GA, USA6h ago
-
Technical Lead, Storage Distributed and Sovereign Cloud USD 207K-301KAI/ML | AI/ML Workloads | Access Control | Automated remediation | Block StorageSenior-level Full TimeRaleigh, NC, USA; Durham, NC, USA6h ago
-
Senior Embedded Flight Software Engineer USD 160K-240KAMD Xilinx | AMD Xilinx FPGAs | AMD/Xilinx SoC | Agile | Aircraft systems401k | Casual dress code | Dental insurance | FSA | Free daily lunchSenior-level Full TimeHawthorne, CA13h ago
-
Senior Data Scientist, Machine Learning USD 194K-218KAWS | Active Learning | Airflow | Amazon Redshift | Automated Labeling100% TelecommutingSenior-level Full TimeRedwood City, CA R15h ago
-
Principal Scientist, Machine Learning - Biomolecules USD 208K-286KAWS Batch | AWS ECS | AWS EKS | AWS S3 | AWS SageMakerAnnual incentive program | Healthcare coverage | Retirement benefitsSenior-level Full TimeCambridge, MA USA15h ago
-
Mid-level Full TimeSan Francisco16h ago
-
Mid-level Full TimeSan Francisco17h ago
-
Data Engineer Data Pipelines and ETL USD 99K-147KAnomaly Detection | Apache Airflow | CDC | Cloud Composer | Data Governance401k plan | Disability benefits | Life insurance | Life insurance coverage | Medical/Dental/VisionMid-level Full TimeBurbank, CA, US, 9150517h ago
-
Sr. Software Engineer, Data Streaming Systems USD 130K-195KAutoscaling | Blocking I/O | CI/CD | Concurrency | Distributed Systems401k plan | Dental insurance | Disability benefits | Life insurance | Medical insuranceSenior-level Full TimeBurbank, CA, US, 9150517h ago
-
Senior-level Full Time100 New Millennium Way, Bldg 2, …17h ago
-
Senior-level Full TimeOne Destiny Way, Westlake TX, United …17h ago
-
Principal Data Engineer USD 141K-166KAWS | Agile | Amazon Web Services | CI/CD | ConfluenceRemote work within United StatesSenior-level Full Time245 Summer St, Boston MA, United … R17h ago
-
Principal Software Engineer/Developer USD 149K-181KA/B | A/B Testing | Adobe Dynamic Tag Manager | Adobe Launch | Adobe SiteCatalystSenior-level Full Time300 New Millennium Way, Durham NC, …17h ago
-
Senior-level Full Time245 Summer St, Boston MA, United …17h ago