Principal Data Engineer
New York, New York, United States
USD 175K-220K Senior-level Full Time
Tasks
- Automate testing monitoring and alerting
- Build and maintain Snowflake data models
- Build and maintain end-to-end data pipelines
- Collaborate with technology leadership on data platform strategy
- Develop ETL and ELT transformation logic
- Develop production grade data pipelines in Databricks
- Establish data modeling and schema best practices
- Implement Delta Live Tables
- Implement data quality lineage and observability
- Lead data infrastructure projects and mentor engineers
- Manage Delta Lake tables
- Manage Unity Catalog
- Manage data pipeline infrastructure with Terraform
- Optimize Databricks clusters
- Orchestrate workflows with AWS services
Perks/Benefits
- Educational reimbursement
- Gym subsidy
- Health benefits
- Matched 401k
- Paid time off
- Parental leave
- Pension plan
- Pet-friendly office
- Recognition programs
Skills/Tech-stack
AWS | Alerting | Amazon ECS | Amazon MSK | Amazon Redshift | Amazon S3 | Amazon SQS | Apache Airflow | Automated testing | CI/CD | Databricks | Databricks Workflows | Delta Lake | Delta Live Tables | Delta Live) | Docker | ELT | ETL | Lakehouse | Lambda | MLflow | MWAA | Monitoring | Python | SQL | Snowflake | Terraform | Unity Catalog
Education
N/A
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer
Regions
Countries
States
Cities
Related jobs
-
Senior Full Stack AI Developer USD 145K-180KArtificial Intelligence | Cloud Computing | Continuous Delivery | Continuous integration | Language ModelsRemote workSenior-level Full TimeWork from home, VA, United States R1h ago
-
Junior Data Engineer - Intern USD 42K-60KPython | SQLContribution to AI initiatives | Exposure to real datasets | Mentorship | Professional development opportunities | Real-world experienceEntry-level Full Time InternshipFAIRFAX, VA, United States1h ago
-
Senior Embedded Software Engineer USD 142K-182KAMD Xilinx | ARM Cortex | C# | Digital Signal Processing | Embedded Linux401k match | Dental insurance | Employee assistance program | Every other Friday off | FSASenior-level Full TimeCamarillo, CA, United States2h ago
-
Senior Data Engineer USD 130K-175K.Net Core | .Net Framework | Apache Airflow | Azure | Azure Data401k match | Career growth opportunities | Dental insurance | Employee resource groups | Life insuranceSenior-level Full TimeRemote, United States R2h ago
-
Analytics Engineer USD 89K-140KAnalytics | Azure Data | Azure Data Factory | DAX | Data Factory401k match | Dental insurance | Health insurance | Health savings account | Life insuranceMid-level Full TimeMurrysville, PA, United States2h ago
-
AWS Glue | Amazon Redshift | Amazon SageMaker | Data Modeling | Data PipelinesMid-level Full TimeHouston, TX, United States3h ago
-
Data Engineer USD 90K-125KAnomaly Detection | Azure | Data Analysis | Data Migration | Data Modeling401k | Dental insurance | Disability coverage | Employee assistance program | Flexible spending accountsMid-level Full TimeSt. Louis, MO, United States4h ago
-
Agile | Automation | Azure AD | Azure Monitor | Azure SentinelKnowledge transfer opportunities | Long-term contract | Onsite in Deerfield Beach FLSenior-level ContractDeerfield Beach, United States4h ago
-
AWS S3 | Amazon Redshift | Apache Airflow | Azure Storage | Cloud PlatformsSenior-level ContractLincoln, United States R4h ago
-
Machine Learning Engineer, Physical AI USD 150K-200KAWS | CUDA | Computer Vision | Deep learning | FastAIBi-annual offsites | Dental insurance | Flexible PTO | Health insurance | Learning and development budgetMid-level Full TimeSan Francisco, CA, US4h ago
-
Robotics Systems Engineer, Physical AI USD 150K-200KCalibration | Computer Vision | Data pipeline | Deep learning | DockerDental insurance | Flexible PTO | Health insurance | Learning and development budget | Monthly socialsMid-level Full TimeSan Francisco, CA, US4h ago
-
Head of AI USD 150K-300KAPI Integration | AWS | Artificial Intelligence | Automations | ChatGPT401k with company matching | Dental insurance | Fully remote work environment | Health insurance | Vision insuranceExecutive-level Full TimeAustin, Texas, Austin HQ, Dallas, Texas, … R4h ago
-
AWS Data Architect USD 140K-216KAPI Integration | AWS CloudFormation | AWS Glue | AWS Lake Formation | AWS LambdaOnsite daily at officeSenior-level Full TimeFremont, United States5h ago
-
Data Engineer ID50062 USD 148K-164KAWS | AWS SageMaker | AWS SageMaker Studio | Apache Airflow | AvroFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeTampa, United States6h ago
-
Data Engineer ID50062 USD 148K-164KAWS | AWS SageMaker | AWS SageMaker Studio | Airflow | Apache SparkEducation budget | Fitness budget | Flexible schedule | Mentorship | Office workSenior-level Full TimeFort Lauderdale, United States6h ago
-
Data Engineer ID50062 USD 148K-164KAWS | AWS SageMaker | AWS SageMaker Studio | Airflow | Apache SparkEducation budget | Fitness budget | Flextime with remote and office options | Mentorship | Personalized growth roadmapsSenior-level Full TimeJacksonville, United States6h ago
-
Data Engineer ID50062 USD 148K-164KAWS | Airflow | Amazon SageMaker | Apache Spark | AvroEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeOrlando, United States6h ago
-
Data Engineer ID50062 USD 148K-164KAWS | AWS SageMaker | Airflow | Apache Spark | AvroFlexible schedule | Mentorship | Personalized growth roadmaps | Remote and office options | TechtalksSenior-level Full TimeTallahassee, United States6h ago
-
Data Engineer ID50062 USD 148K-164KAWS | Airflow | Apache Spark | Avro | DuckDBFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote optionsSenior-level Full TimeBaltimore, United States6h ago
-
Data Engineer ID50062 USD 148K-164KAWS | Airflow | Apache Spark | Avro | Data LakeEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeRichmond, United States6h ago
-
Data Engineer ID50062 USD 148K-164KAWS SageMaker | Amazon Web Services | Apache Airflow | Apache Spark | AvroFlexible schedule | Mentorship | Remote and office options | TechtalksSenior-level Full TimeMiami, United States6h ago
-
Data Engineer ID50062 USD 148K-164KAWS | AWS SageMaker | Airflow | Apache Spark | AvroEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeAustin, United States6h ago
-
Data Engineer ID50062 USD 148K-164KAWS | Airflow | Apache Spark | Avro | Big DataFlexible schedule | Mentorship | Personalized growth roadmaps | Remote work options | TechtalksSenior-level Full TimeHouston, United States6h ago
-
Data Engineer ID50062 USD 148K-164KAWS | Airflow | Apache Spark | Avro | Data LakehouseFlextime | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeBlacksburg, United States6h ago
-
Data Engineer ID50062 USD 148K-164KAWS | Airflow | Avro | Data Lake | Data LakehouseFlextime | Mentorship | Office work options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeWest Palm Beach, United States6h ago