Principal Data Engineer
New York, New York, United States
USD 175K-220K Senior-level Full Time
Tasks
- Automate testing monitoring and alerting
- Build and maintain Snowflake data models
- Build and maintain end-to-end data pipelines
- Collaborate with technology leadership on data platform strategy
- Develop ETL and ELT transformation logic
- Develop production grade data pipelines in Databricks
- Establish data modeling and schema best practices
- Implement Delta Live Tables
- Implement data quality lineage and observability
- Lead data infrastructure projects and mentor engineers
- Manage Delta Lake tables
- Manage Unity Catalog
- Manage data pipeline infrastructure with Terraform
- Optimize Databricks clusters
- Orchestrate workflows with AWS services
Perks/Benefits
- Educational reimbursement
- Gym subsidy
- Health benefits
- Matched 401k
- Paid time off
- Parental leave
- Pension plan
- Pet-friendly office
- Recognition programs
Skills/Tech-stack
AWS | Alerting | Amazon ECS | Amazon MSK | Amazon Redshift | Amazon S3 | Amazon SQS | Apache Airflow | Automated testing | CI/CD | Databricks | Databricks Workflows | Delta Lake | Delta Live Tables | Delta Live) | Docker | ELT | ETL | Lakehouse | Lambda | MLflow | MWAA | Monitoring | Python | SQL | Snowflake | Terraform | Unity Catalog
Education
N/A
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer
Regions
Countries
States
Cities
Related jobs
-
Data Analytics & Engineering Opportunities USD 65K-105KHive | Microstrategy | MySQL | Oracle | Python401k with firm profit share | Dental insurance | Disability insurance | Firm paid holidays | Flexible spending accountEntry-level Full TimeWashington, DC, United States4h ago
-
Mid-Level Data Engineer USD 90K-98KAPI Development | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageRemote workMid-level Full TimeWork from home, VA, United States R6h ago
-
Senior Data Engineer USD 165K-180KAPIs | Anomaly Detection | Azure | Azure Data | Azure Data FactorySenior-level Full TimeWork from home, VA, United States R6h ago
-
Senior DevOps Engineer ID63545 USD 135K-185KAWS | Apache Airflow | ArgoCD | Azure | BigQueryFlextime | Growth roadmaps | Mentorship | Office work options | Remote work optionsSenior-level Full TimeMiami, United States7h ago
-
BigQuery | Curriculum Development | Data Governance | Data Lakehouse | Data ModelingAsynchronous hiring process | Part-time hoursSenior-level Part TimeBoston, US8h ago
-
Evergreen - Mathematics for Machine Learning USD 80K-300KAutodiff | JAX | Linear Algebra | Matrix Operations | NumPyAsynchronous hiring process | Flexible collaboration | Part-time hoursMid-level Full TimeBoston, US8h ago
-
Senior Director, AI / Machine Learning Software Engineer USD 136K-300KApache Flink | Apache Spark | CI/CD | Data Lineage | Data PrivacyHealth benefits | Paid leave | Paid volunteer timeSenior-level Full TimeNew York, NY, United States9h ago
-
Data Engineering | Machine Learning | Machine Learning Pipelines | Python | Recommendation SystemsSenior-level Full TimeSan Jose, California, United States9h ago
-
Data Pipelines | Full Stack | Full-Stack Development | Machine Learning | PythonSenior-level Full TimeSan Jose, California, United States9h ago
-
C++ | Data Analysis | Data Manipulation | Data Processing | Deep learningSenior-level Full TimeMountain View, CA, USA10h ago
-
Software Engineer, Machine Learning USD 207K-300KC++ | Data Processing | Experimentation | Information Retrieval | Just-in-TimeSenior-level Full TimeNew York, NY, USA; Mountain View, …10h ago
-
Software Engineer Manager II, Embedded Systems, Firmware USD 207K-300KAgile project management | Automated testing | C++ | Direct memory access | Embedded operating systemsSenior-level Full TimeSunnyvale, CA, USA10h ago
-
Artificial Intelligence | C++ | CSS | Data Storage | Distributed ComputingSenior-level Full TimeNew York, NY, USA10h ago
-
Associate Principal, Trust and Safety, GenAI USD 142K-205KAbuse prevention | Cybersecurity | Dashboards | Data Transformation | Data VisualizationMid-level Full TimeWashington D.C., DC, USA; Seattle, WA, …10h ago
-
Customer Engineer, Data Analytics, Google Cloud USD 153K-222KBatch Processing | Big Data | Cloud Architecture | Cloud platform | Customer RequirementsSenior-level Full TimeSunnyvale, CA, USA10h ago
-
C++ | Data Processing | Debugging | Information Retrieval | Language ModelsSenior-level Full TimeMountain View, CA, USA10h ago
-
Silicon Design Verification Engineer, Quantum AI USD 138K-198KARM | C-based testing | Chip verification | Constrained random | Constrained random verificationMid-level Full TimeMountain View, CA, USA; Goleta, CA, …10h ago
-
Cloud Data and AI Engineer, Professional Services USD 127K-183KC++ | Capacity Planning | Cloud Databases | Data Migration | Data PipelinesTravel up to 30 percentMid-level Full TimeReston, VA, USA10h ago
-
Data Scientist USD 67K-150KA/B | A/B Testing | B testing | Clustering | Drift monitoring401k plan | AD and D insurance | Child Life Insurance | Dental insurance | Educational Assistance PlanMid-level Full TimeUnited States12h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeDiversity and Inclusion Commitment | Flexible asynchronous culture | Laid-back atmosphere | Portfolio and LinkedIn supportMid-level Full TimeBellevue, WA, USA16h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous work culture | Flexible management | Remote-friendly, distributed teamMid-level Full TimeDenver, CO, USA16h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudMid-level Full TimePalo Alto, CA, USA16h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Flexible work environment | Remote-friendlyMid-level Full TimeLos Angeles, CA, USA16h ago
-
Bash | Data Processing | Docker | GCP | LinuxAsynchronous culture | Flexible remote workMid-level Full TimeKirkland, WA, USA16h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Flexible remote work | Work on impact driven productsMid-level Full TimeSan Jose, CA, USA16h ago