Senior Data Engineer
Manhattan, New York, United States
USD 121K-161K Senior-level Full Time
Tasks
- Architect data models for analytics
- Automate CI/CD pipelines
- Build batch data pipelines
- Collaborate with data scientists and analysts
- Deliver reliable data products
- Design real-time data pipelines
- Drive unit integration testing practices
- Implement Spark and Airflow workflows
- Improve data platform and pipeline processes
- Maintain documentation and engineering best practices
- Mentor team members
- Optimize SQL queries
- Perform code reviews
- Run end to end project delivery from design to production support
Perks/Benefits
Skills/Tech-stack
API Design | Airflow | Apache Spark | Azure | CI/CD | CI/CD automation | Code review | Data Modeling | Data Pipelines | Data Warehousing | Data pipeline | Data pipeline orchestration | Databricks | Delta Lake | Docker | Integration Testing | Kubernetes | Near Real Time Data Pipelines | Near-Real-Time data | Near-real-time | Pipeline Orchestration | Python | Query Optimization | REST API | REST API design | RESTful APIs | Real Time | Real-time Data | Real-time data pipelines | SQL | Snowflake | Unit Testing | Unity Catalog
Education
N/A
Roles
Related jobs
-
Automation Testing | CI/CD | CSS | Cypress | Feature DevelopmentMedical, dental & vision coverage | Paid time off | Parental leave | Reimbursement programs | Retirement planMid-levelRaleigh, United States R14d ago
-
Ansible | CI/CD | Cloud Native | Cloud-native technologies | Data Pipelines401k match | Home office and equipment plan | Industry leading pay schedule | Life insurance | Long-term disabilityMid-level Full TimeDayton, OH11h ago
-
Apache Airflow | Argo Workflows | Batch inference | CI/CD | ClearML401k match | Dental insurance | Disability insurance | Health insurance | Home office & equipment planSenior-level Full TimeDayton, OH11h ago
-
Data & ML Engineer USD 125K-195KAirflow | Amazon S3 | Apache Spark | Batch Processing | Data Analysis401k retirement plan | Commuter benefits | Disability insurance | Life insurance | Medical/Dental/Vision insuranceMid-level Full TimeSan Francisco Office12h ago
-
ADAS | Autonomous Driving | Build systems | Compute hardware | Configuration Management100 percent paid medical dental vision | 401k employer match | Accidental death and dismemberment insurance | Flexible schedule | Holiday office closuresSenior-level Full TimeRemote - U.S, Ann Arbor, MI R12h ago
-
AI Safety | AI Search | AWS SageMaker | Azure AI | Azure AI Search401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States12h ago
-
Sr. Data Engineer USD 140KAPIs | Apache Kafka | Apache Spark | Azure | Azure Data401k match | Birthday benefit | Boot camp classes | Dental insurance | Health insuranceSenior-level Full TimeRemote, US R12h ago
-
Data Engineer - Sr. Consultant level USD 152K-243KAWS | Apache Spark | CI/CD | Cloud Migration | Cloud platform401k | Dental insurance | FSA/HSA | Life insurance | Medical insuranceSenior-level Full TimeBellevue, WA, United States14h ago
-
Robotics Engineer, Deployment & Testing - San Mateo USD 100K-300KC# | C++ | Embedded Systems | Go | Machine LearningMid-level Full TimeSan Mateo15h ago
-
Analytics Engineer USD 220K-335KData Modeling | Data Visualization | Data pipeline | ETL | LookerHybrid work model | Relocation assistanceSenior-level Full TimeSan Francisco15h ago
-
Senior-level Full TimeCarlsbad, California, United States15h ago
-
Senior-level Full TimeAndover, Massachusetts, United States15h ago
-
Senior AI Engineer (Databricks) USD 166K-225KAPI | Agile | Databricks | Deep learning | Distributed SystemsCell phone allowance | Comprehensive health coverage | Equity compensation | Growth-focused environment | Home office setup allowanceSenior-level Full TimeRemote US R16h ago
-
AI Specialist - #2911 USD 77K-176KAPI Development | Amazon Web Services | Azure | Cloud Computing | Cloud platform401k | Dental insurance | Disability coverage | Education reimbursement | Employee resource groupsMid-level Full TimePittsburgh, PA16h ago
-
AI Specialist - #2910 USD 77K-176KAPI Development | AWS | Azure | Deep learning | Docker401k | Dental insurance | Education reimbursement | Employee resource groups | Employee stock programMid-level Full TimePittsburgh, PA16h ago
-
Data Engineer USD 92K-125KAWS EMR | AWS Glue | AWS Lambda | AWS S3 | Amazon Kinesis401k match | Comprehensive benefits | Flexible PTO | Gym reimbursement | Mental health supportMid-level Full TimeHerndon, VA, United States16h ago
-
BLDC | C plus plus | CAN | Current sensing | Design for manufacturability401k match | Health insurance | Paid relocation | Paid time offSenior-level Full TimeWaltham, MA, United States16h ago
-
Space Operations Engineer (Dragon) USD 95K-130KAttitude control | Avionics | C++ | Communication Systems | Flight Operations401k plan | Disability insurance | Employee stock purchase plan | Life insurance | Medical/Dental/Vision insuranceEntry-level Full TimeHawthorne, CA16h ago
-
Senior Platform Analytics Engineer USD 192K-264KAWS | Airflow | Apache Spark | Big Data | DBTHybrid work schedule | Remote work up to 4 weeks per yearSenior-level Full TimeSan Francisco, CA16h ago
-
Staff Machine Learning Platform Engineer USD 224K-308KAWS | Airflow | Apache Airflow | Cockroach DB | DatabricksFlex day availability | Hybrid work 3 days per week | Remote work up to 4 weeks per yearSenior-level Full TimeSan Francisco, CA16h ago
-
Active Learning | Bayesian optimization | Coarse Grained Modeling | Computer Vision | Data Pipelines401k eligibility | Employee assistance program | Health and wellness benefits | Paid Holidays | Paid parental leaveSenior-level Full TimeMentor, OH, United States17h ago
-
Embedded Software Engineer I USD 116K-174KC# | C++ | DRIVE OS | Device Drivers | Embedded LinuxAnnual bonus | Benefits | Equity compensation | Hybrid work environmentEntry-level Full TimeMountain View, California17h ago
-
Principal Software Engineer (AI) ( US) USD 132K-145KAI RMF | Agentic Systems | Alerting | Artificial Intelligence | Audit LoggingContinuous development support | Employee assistance program | Employee recognition | Flexible paid time off | Parental and caregiver leavesSenior-level Full TimeRemote - US R17h ago
-
CX Analytics Engineer USD 152K-179KAirflow | DBT | Data Governance | Data Modeling | Data MonitoringMid-level Full TimeRemote - USA R17h ago
-
Senior Analytics Engineer USD 184K-220KAirflow | Anomaly Detection | Automated testing | BigQuery | BugsnagHealthcare benefits | Paid Holidays | Paid Scopely free days | Pet insurance | Retirement benefitsSenior-level Full TimeUS - Culver City, United States17h ago