Principal Data Engineer
USD 133K-165K (estimate) Senior-level Full Time
Tasks
- Build and maintain ETL/ELT pipelines
- Design and develop scalable data pipelines
- Develop and optimize Databricks notebooks and workflows
- Document data flows and operational procedures
- Enforce data governance and data lineage
- Implement CI CD for data engineering
- Implement Delta Lake
- Implement data validation and profiling
- Implement medallion architecture
- Implement role based access control and encryption
- Model data for analytics and reporting
- Monitor and tune Spark jobs
- Troubleshoot data pipeline failures
Perks/Benefits
- N/A
Skills/Tech-stack
Access Control | Azure Data | Azure Data Factory | Azure Databricks | CI/CD | Data Cleansing | Data Factory | Data Governance | Data Lineage | Data Modeling | Data Validation | Data profiling | Delta Lake | ELT | ETL | Encryption | Medallion Architecture | Metadata Management | PySpark | Role-Based Access | Role-Based Access Control | SQL | Snowflake Schema | Spark | Star Schema | Unity Catalog
Education
N/A
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer
Related jobs
-
C++ | Cloud infrastructure | Computer Networking | Data Storage | Data StructuresSenior-level Full TimeSunnyvale, CA, USA1h ago
-
Data Engineer USD 76K-107KAmazon Web Services | Apache Airflow | Apache Kafka | Cause analysis | Cloud Composer401k match | Basic life insurance | Dental insurance | Disability coverage | Life insuranceMid-level Full TimePiscataway, NJ, US5h ago
-
Data Engineer USD 76K-121KAWS | Airflow | Apache Airflow | Cloud Data | Cloud Data Warehouse401k matching | Dental insurance | Disability coverage | Life insurance | Medical insuranceMid-level Full TimePiscataway, NJ, US5h ago
-
Advanced Analytics - Vet USD 109K-155KAutomation | Cloud Storage | Data Engineering | Data Governance | Data ModelingMid-level Full TimeOverland Park, KS, US5h ago
-
Advanced Analytics - Retail USD 109K-155KAWS | Cloud Computing | Cloud Storage | Data Governance | Data Pipelines401k matching | Dental insurance | Disability insurance | Life insurance | Medical insuranceMid-level Full TimeOverland Park, KS, US5h ago
-
Data Engineer, Infrastructure FinOps USD 146K-194KAPI Design | BigQuery | CI/CD | CloudFormation | DBTMid-level Full TimeCosta Mesa, California, United States12h ago
-
Senior Software Engineer, Data Platform USD 166K-220KAWS | Amazon Athena | Apache Iceberg | Apache Spark | AzureSenior-level Full TimeCosta Mesa, California, United States12h ago
-
Staff Data Scientist (Pricing) USD 179K-269KBehavioral Modeling | Causal Inference | Causal measurement | Choice Modeling | Contextual Bandits401k matching | Dental insurance | Employee learning development programs | Employee recognition programs | Financial assistance for hybrid workSenior-level Full TimeSan Francisco, CA12h ago
-
Ad Ranking | Agentic Workflows | Automl | Deep learning | Distributed Systems401k matching | Dental insurance | Employee assistance program | Health insurance | Paid time offSenior-level Full TimePalo Alto, California, USA13h ago
-
Senior Data Engineer USD 135K-168KAWS | Airflow | Amazon Redshift | Data Modeling | Data Warehousing401k | Flexible work arrangement | Health insurance | Mentorship program | Paid time offSenior-level Full TimePlano, TX14h ago
-
AI Full Stack Developer & Architect USD 140K-161KCloud Run | Kubernetes | MLOps | Machine Learning | Next.jsSenior-level Contract Full TimeSan Jose, CA, United States17h ago
-
Data & AI Platform Engineer USD 95K-155KAI Search | APIs | AWS | Airflow | ArcGIS401k matching | Dental insurance | Health insurance | Life insurance | Paid HolidaysSenior-level Full TimeRemote, United States R18h ago
-
Senior Data Engineer USD 140K-160KApache Airflow | CI/CD | Change Data Capture | Cluster Sizing | Data Capture401k | Dental insurance | Health insurance | Hybrid work | Paid leaveSenior-level Full TimeNorth Hollywood, CA, United States18h ago
-
Senior Data Engineer USD 140K-160KAirflow | Auto Loader | CI/CD | Change Data Capture | Data CaptureSenior-level Full TimeNew York, NEW YORK, United States18h ago
-
Sr Data Engineer USD 100K-120KAPIs | AWS | AWS Glue | Airflow | Amazon RedshiftFully remote | Mentorship | On-call supportSenior-level Full TimeOrlando, FL, United States R18h ago
-
Equities Data Engineer USD 175K-200KApache Iceberg | Apache Kafka | Apache Spark | CI/CD | Linux401k employer match | Dental insurance | Flexible spending account | Health insurance | Health savings accountMid-level Full TimeChicago, New York19h ago
-
Mid-level Full TimeNew York19h ago
-
Machine Learning Engineer USD 72K-131KCI/CD | Data Fusion | Data Pipelines | Data analytics | Deep learningHybrid work environment | MentorshipSenior-level Full TimeMelbourne, Florida, United States19h ago
-
Junior Machine Learning Engineer USD 64K-106KCI/CD | Data Fusion | Data analytics | Data sets | Deep learningComprehensive benefits package | Hybrid work environment | Supportive work environment | US security clearance supportedEntry-level Full TimeMelbourne, Florida, United States20h ago
-
Analytics Engineer USD 64K-140KDBT | Data Modeling | Git | Looker | Python401k match | Career advancement | Company events | Full medical, dental, and vision coverage | Generous PTO and paid holidaysMid-level Full TimeColumbia, MO (Headquarters)20h ago
-
Staff Machine Learning Systems Engineer (MLOps) USD 210K-250KAWS EKS | Alerting | Autoscaling | CI/CD | ClickHouseFlexible remote work | Healthcare industry domain experienceSenior-level Full TimeUS Remote R20h ago
-
Senior Data Engineer USD 140K-170KData Governance | Data Management | Data Modeling | Data Quality | Data sharesComprehensive benefits package | Flexible hybrid schedule | Opportunities for promotion | Supportive work community | Training and developmentSenior-level Full TimeNew York, New York, United States; … R21h ago
-
Senior Data Quality Engineer USD 134K-156KAgile | Automation frameworks | Bitbucket | CI/CD | DBTHealth benefits | Unlimited paid time offSenior-level Full TimeNeedham, MA21h ago
-
Data Engineer with Ataccama USD 120K-160KAtaccama | Data Governance | Data Quality | InformaticaHybrid work arrangement | Long-term contract | Professional growth opportunitiesSenior-level Contract Full TimeNewark, NJ, United States22h ago
-
Senior Machine Learning Platform Engineer USD 155K-215KAI Observability | AWS SageMaker | Alerting | Amazon ECS | Audio ProcessingOn-call rotationSenior-level Full TimeNew York, NY22h ago