Senior Data Engineer
New York, New York, United States
USD 170K-200K (estimate) Senior-level Full Time
Tasks
- Build production grade datasets
- Coordinate with data science and engineering teams
- Debug pipeline performance and memory issues
- Design data pipelines at scale
- Implement validation and production rollout
- Model analytics curated gold datasets
- Optimize distributed data systems
- Own datasets end-to-end
- Translate requirements into tech specs
- Validate and reconcile data quality
Perks/Benefits
- 401k
- Catered lunches
- Commuter benefits
- Continued education benefit
- Equity compensation
- FSA
- Health insurance
- Hybrid work
- Sick days
- Snacks & drinks
- Team building events
- Unlimited PTO
- Wellness day off
Skills/Tech-stack
Apache Airflow | Apache Spark | ClickHouse | Data Contracts | Data Modeling | Data Quality | Data Reconciliation | Data Validation | Databricks | Delta Lake | Distributed Systems | Memory Optimization | Partitioning | Performance Tuning | PySpark | Python | SQL | Schema Design
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Software Engineer 2 - (Python, LLM, Machine Learning) USD 201K-246KAPI Integration | AWS | Agentic Workflows | Azure | CrewAI401k match | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offMid-level Full TimeAnnapolis Junction, Maryland R2h ago
-
AWS | CI/CD | Docker | Kubernetes | LLM401k match | Health insurance | Paid time offMid-level Full TimeAnnapolis Junction, MD2h ago
-
Senior Data Engineer USD 114K-164KAzure DevOps | Azure Synapse | CI/CD | Data Governance | Data QualitySenior-level Full TimeSan Diego5h ago
-
Analytics and Insights Engineer II USD 84K-140KAlgorithm Development | DAX | Databricks | Entity Resolution | Language ProcessingEntry-level Full TimeRosslyn, Virginia, United States6h ago
-
Palantir AI and Data Science Engineer USD 84K-121KAgile | Cloud Computing | Data Engineering | Data Modeling | Data VisualizationEntry-level Full TimeHuntsville, Alabama, United States6h ago
-
Alert Tuning | Bash | Change Management | Go | Incident ResponseOnboarding support | Professional development opportunities | Rotational on-callEntry-level Full TimeSan Jose, California, United States6h ago
-
Sr Data Engineer USD 130KAmazon Kinesis | Automation | Data Governance | Data Lake | Data PipelinesSenior-level Full TimeEstero, FL, United States6h ago
-
Production Systems Engineer, AI Systems USD 147K-208KAutomated Provisioning | Automated remediation | DAC | Data Visualization | DriversSenior-level Full TimeMenlo Park, CA7h ago
-
Senior Software Engineer, AI/ML, YouTube USD 174K-252KC++ | Data Processing | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeMountain View, CA, USA7h ago
-
Senior Software Engineer, Agentic AI, AIR USD 174K-252KComputer Vision | Data Processing | Data Structures | Data structures algorithms | DebuggingSenior-level Full TimeMountain View, CA, USA; New York, …7h ago
-
Cause analysis | Computer Vision | Data Processing | Debugging | Distributed SystemsSenior-level Full TimePittsburgh, PA, USA; Mountain View, CA, …7h ago
-
C++ | Computer Vision | Data Processing | Debugging | Distributed ComputingSenior-level Full TimeBoulder, CO, USA7h ago
-
ATA | Algorithms | C# | C++ | Data StructuresSenior-level Full TimeSunnyvale, CA, USA7h ago
-
Staff Software Engineer, AI/ML, Search Ads USD 207K-300KAgentic AI | C++ | Data Processing | Data Quality | Deep learningSenior-level Full TimeMountain View, CA, USA7h ago
-
Agent systems | Apache Beam | Artificial Intelligence | Autonomous Agents | Autonomous ReasoningMid-level Full TimeLondon, UK; Mountain View, CA, USA7h ago
-
Software Engineer, AI/ML, Full Stack, Search Ads USD 147K-210KA/B | A/B Testing | Agentic AI | B testing | C++Mid-level Full TimeMountain View, CA, USA7h ago
-
Staff Software Engineer, Network Health USD 207K-300KAnomaly Detection | Automated remediation | Data Processing | Debugging | Distributed ComputingSenior-level Full TimeSunnyvale, CA, USA7h ago
-
Customer Engineer, Databases, Google Public Sector USD 152K-221KAnalytical workloads | Cloud Computing | Cloud Native | Cloud Native Architecture | Cloud platformSenior-level Full TimeReston, VA, USA; Washington D.C., DC, …7h ago
-
Novel AI Lead Methodologist USD 171K-247KAutomation | Data Analysis | Data Manipulation | Experiment design | Language ProcessingSenior-level Full TimeWashington D.C., DC, USA; Atlanta, GA, …7h ago
-
AI machine learning | Algorithms | C++ | Data Analysis | Data StructuresSenior-level Full TimeRaleigh, NC, USA; Durham, NC, USA7h ago
-
Senior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL7h ago
-
Analyst, Business Insights & Execution USD 68K-115KAPI Integration | Automation | CI/CD | Data Ingestion | Data ModelingMid-level Full TimeMcLean, VA, US9h ago
-
Staff Machine Learning Engineer USD 180K-209KAI | AWS Kinesis | Apache Beam | Apache Flink | Apache SparkChallenging projects | Collegial culture | Flex workSenior-level Full TimeAtlanta, US11h ago
-
Machine Learning Experts: Linear Algebra Exam Audit USD 150K-180KComponent analysis | Eigenvalues | JSON | Linear Algebra | Matrix OperationsRemote workSenior-level Full TimeUnited States R12h ago
-
Senior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R12h ago