Data Engineer Principal_3003
Tasks
- Assess and re engineer data platform
- Ensure correctness of data processing patterns
- Identify gaps defects and technical debt
- Implement governance and quality reconciliation controls
- Implement target state designs aligned to lakehouse principles
- Mentor engineers and review code and designs
- Migrate workloads to Databricks
- Reimplement ingestion transformation and orchestration pipelines
- Reverse engineer document and validate pipeline logic
- Support parallel run migrations and validate output consistency
Perks/Benefits
- 401k match
- Company bonus scheme
- Company-Paid Holidays
- Employee discounts
- Employee shares program
- Health insurance
- Hybrid work model
- International career mobility
- Paid parental leave
- Paid time off
- Paid volunteer days
- Tuition reimbursement
- Tuition reimbursement and digital learning
Skills/Tech-stack
Analysis Services | Apache Spark | Automated testing | Azure Analysis | Azure Analysis Services | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure DevOps | Azure Purview | Azure Resource | Azure Resource Manager | Azure Synapse | Azure Synapse Analytics | CI/CD | Change Data Capture | Data Capture | Data Lake Storage Gen2 | Delta Lake | Delta Lake Merge | Docker | ELT | ETL | GitHub Actions | Golden Gate | Infrastructure as Code | Oracle Golden | Oracle Golden Gate | Power BI | PySpark | Python | Resource manager | SQL | Schema Enforcement | Slowly Changing Dimensions | Spark SQL | Synapse Analytics | Terraform | Time Travel | Unity Catalog | “as-code”
Education
N/A
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer
Regions
Countries
States
Cities
Related jobs
-
Machine Learning Experts: Linear Algebra Exam Audit USD 150K-180KComponent analysis | Eigenvalues | JSON | Linear Algebra | Matrix OperationsRemote workSenior-level Full TimeUnited States R5h ago
-
Software Engineer, Embedded Systems USD 197K-270KAAC | AC3 | API Design | AV1 | Adaptive streamingCommuter benefits | Disability benefits | Health insurance | Life insurance | Paid time offSenior-level Full TimeSan Jose, California R8h ago
-
Senior Machine Learning Engineer USD 150K-241KC++ | Cloud Architecture | Computer Vision | Data Pipelines | Fine TuningDiscretionary paid time off | Emotional and mental wellness support | Employer 401k match | Fitness programs | Learning and development programsSenior-level Full TimeSeattle, Washington, United States R12h ago
-
Bioinformatics | Computational Biology | Data Pipelines | Deployment | GenomicsRemote interviewSenior-level Full TimeUnited States R13h ago
-
Senior Solution Engineer USD 165K-216KAnalytics | Cloud Computing | Data Lake | Data Warehouse | Data fabricTravelSenior-level Full TimeUS-GA-Remote R14h ago
-
AI Ops Engineer USD 160K-220KAccess Control | Agent systems | Agentic AI | Autogen | CMDB401k match | Career coaching | Employee assistance programme | Employer-paid life insurance | Flexible working hoursMid-level Full TimeRemote, United States R15h ago
-
Senior Staff Software Engineer - AI/ML - Veza USD 171K-300KAPI Integration | Agent Orchestration | Agent systems | Algorithms | C++401k plan | ESPP | Family leave programs | Flexible spending accounts | Flexible time away planSenior-level Full TimeMinneapolis, Minnesota, United States R16h ago
-
Senior Staff Machine Learning Engineer - Agentic AI USD 201K-352KAPI Development | Agent Orchestration | Agent systems | C++ | Compliance401(k) plan match | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeSanta Clara, CALIFORNIA, United States R16h ago
-
Senior Data Engineer USD 120K-180KAWS CloudFormation | AWS DynamoDB | AWS Glue | AWS Lambda | AlertingFlexible work arrangements | Professional developmentSenior-level Full TimeRemote - United States R17h ago
-
Bayesian statistics | Cloud deployment | Control Systems | Data Pipelines | Decision MakingContract-to-hire | Remote workSenior-level Contract Full TimePalo Alto, CA, United States R17h ago
-
Senior AI Engineer, Unstructured AI USD 204K-255KAPI Design | Apache Spark | Artificial Intelligence | Context engineering | Data CatalogingFlex Fund monthly stipend | Health coverage | Hybrid work | Pension/401K | Time offSenior-level Full TimeNew York, New York, USA R17h ago
-
Software Engineer, Research Data Platform USD 320K-405KAPI Design | BigQuery | Data Cataloging | Data Lineage | Data PipelinesFlexible working hours | Generous vacation | Hybrid work | Optional equity donation matching | Parental leaveMid-level Full TimeSan Francisco, CA | New York … R18h ago
-
Staff Business Analytics Engineer USD 182K-228KAttribution | Business Intelligence | Cloud Computing | Cloud Cost Management | Cloud infrastructureEducational reimbursement | Employee insurance plans | Unlimited vacation | Wellness reimbursementSenior-level Full TimeNew York, NY; San Ramon, CA; … R18h ago
-
Senior Machine Learning Engineer, Infrastructure USD 212K-318KData Validation | Distributed Systems | Feature Engineering | Feature Store | Live Inference401(k) plan matching | Commuter benefits | Company holidays | Flexible time off | HealthcareSenior-level Full TimeNew York R18h ago
-
Principal Enterprise Data Platform Architect USD 141K-211KAccess Control | Active Directory | Apache Airflow | Apache Arrow | Apache Iceberg401k retirement plan | Inclusive healthcare network | Medical insurance | Paid time off | Remote workSenior-level Full TimeMentor, OH, United States R18h ago
-
Senior Data Engineer II, Finance USD 192K-242KAirflow | Amazon Redshift | Apache Spark | Cloud Data | Cloud data warehousingFlexible work location | Remote workSenior-level Full TimeUnited States - Remote R19h ago
-
Senior Database Engineer USD 140K-160KAWS | Aurora | CI/CD | Database security | Flyway401k retirement plan | Employee assistance program | Health spending account | Life insurance | Long-term disabilitySenior-level ContractFoster City, California, USA R19h ago
-
Controls and Robot Learning Engineer GBP 100KC++ | Computed Torque | Control Systems | Direct Kinematics | Embedded SystemsMid-level Full TimeSan Francisco, CA R20h ago
-
Senior AI Engineer USD 204K-255KAgent Orchestration | Checkpointing | Concurrent Requests | Data Validation | Graph DatabasesSenior-level Full TimeNew York, New York, USA R20h ago
-
Senior AI Engineer USD 130K-200KAI Foundry | Agent workflows | Anthropic Claude | Anthropic Claude SDK | Azure AI401k retirement plan | Employee assistance program | Health spending account | Life insurance | Long-term disabilitySenior-level ContractOmaha, Nebraska, USA R20h ago
-
Analytics Engineer USD 95K-105KCloud Data | Cloud Data Warehouse | DBT | Data Contracts | Data Documentation401k | Flexible PTO | HSA contribution | Home internet reimbursement | Home office stipendSenior-level Full TimeRemote, United States R20h ago
-
Senior Consultant – Semantic Data & AI Engineering USD 146K-183KAPI Development | AWS | Agile | Amazon Neptune | Automated testing401k match | Commuter benefits | Dependent care | FSA | HSASenior-level Full TimeUS - New York R20h ago
-
Principal Consultant – Semantic Data & AI Engineering USD 146K-183KAPI Development | AWS | Agile | Automated testing | Azure401k match | Commuter benefits | Dependent care | FSA | HSASenior-level Full TimeUS - New York R20h ago
-
Software Engineer - Applied AI USD 170K-225KCI/CD | Context engineering | Evaluation | Go | GraphQL401k | Commuter stipend | Educational stipend | Health insurance | NYC Office AccessMid-level Full TimeRemote/Hybrid R20h ago
-
Senior-level Full TimeTel Aviv-Jaffa, Tel Aviv District, IL R21h ago