Senior Software Engineer, Data Engineering
Manhattan, New York, United States
USD 121K-161K Senior-level Full Time
Tasks
- Build cloud native data infrastructure for real time and batch workloads
- Design build maintain streaming and batch data processing services
- Develop real time data transformation enrichment validation routing
- Ensure scalability fault tolerance and performance of pipelines
- Implement deployment automation observability and operational tooling
- Own evolve event schemas and data contracts
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | At least once | At least once semantics | Automated testing | Avro | Azure | Backpressure | CI/CD | Container Orchestration | Data Enrichment | Data Ingestion | Data Pipelines | Data Routing | Data Transformation | Data Validation | Databricks | Deployment Automation | Distributed Systems | Event Driven | Event-driven architecture | Exactly once | Exactly-once semantics | Fault Tolerance | Infrastructure as Code | Java | Kafka | Kafka Streams | Kubernetes | Observability | Protobuf | Python | Real Time | Real-time Data | Real-time data pipelines | Scala | Schema Registry | Stream processing | Terraform | “as-code”
Education
N/A
Related jobs
-
AWS | Analytics | Data Mining | Generative AI | Machine LearningMentorship | Training | Work-life balanceSenior-level Full TimeArlington, Virginia, USA6h ago
-
API Integration | AWS | Autogen | Azure | Cloud platformHybrid work environmentSenior-level Contract Full TimeChicago, Illinois, United States8h ago
-
AI Engineer USD 103K-140KAI Agents | AI Studio | Access Control | Anthropic Claude | AuthenticationBonus eligibleSenior-level Full TimeDenver, CO, United States8h ago
-
Director, Data Governance & Observability USD 165K-190KAPI Design | Alerting | Automated testing | CI/CD | DashboardsExecutive-level Full TimeNew York, NEW YORK, United States10h ago
-
Senior-level Full TimeCincinnati, OH, United States10h ago
-
Bill of Materials | Change Management | Data Cleansing | Data Governance | Data Migration401k | Collaborative team environment | Cross training | Dental insurance | Medical insuranceMid-level Full TimeWichita, KS, United States10h ago
-
Senior Data Engineer USD 111K-124KAccess Control | Agile | Azure | CI/CD | Data Governance401k contributions | Education assistance | Life and disability coverage | Medical, dental, and vision coverage | Paid sabbaticalSenior-level Full TimeAtlanta, Georgia or Gainesville, FL12h ago
-
Senior-level Full TimeBoston, Massachusetts, United States12h ago
-
Data Analytics & Engineering Opportunities USD 65K-105KHive | Microstrategy | MySQL | Oracle | Python401k with firm profit share | Dental insurance | Disability insurance | Firm paid holidays | Flexible spending accountEntry-level Full TimeWashington, DC, United States13h ago
-
Analytics Engineer USD 60K-75KDBT | Data Architecture | Data Modeling | Data Pipelines | Data Quality401k employer match | Medical/Dental/Vision | Paid Holidays | Paid parental leave | SabbaticalMid-level Full TimeBoulder, Colorado, United States13h ago
-
Mid-Level Data Engineer USD 90K-98KAPI Development | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageRemote workMid-level Full TimeWork from home, VA, United States R14h ago
-
Senior Data Engineer USD 165K-180KAPIs | Anomaly Detection | Azure | Azure Data | Azure Data FactorySenior-level Full TimeWork from home, VA, United States R14h ago
-
Senior AI Engineer | Sage Home Loans USD 150K-220KAgent Orchestration | Automated Regression | Automated regression testing | Cost Optimization | DPO401k match | Disability insurance | Employee assistance program | Flexible paid time off | Flexible spending accountsSenior-level Full TimeCharlotte, NC R16h ago
-
Senior DevOps Engineer ID63545 USD 135K-185KAWS | Apache Airflow | ArgoCD | Azure | BigQueryFlextime | Growth roadmaps | Mentorship | Office work options | Remote work optionsSenior-level Full TimeMiami, United States16h ago
-
Software Engineer Level 2-FFPP-8863 USD 78K-250KAccumulo | BSON | Bigtable | Distributed File System | File System401k match | Employee referral programs | Flexible spending accounts | Inclusive workplace culture | Medical/Dental/Vision insuranceMid-level Full TimeHanover, MD17h ago
-
Evergreen - Mathematics for Machine Learning USD 80K-300KAutodiff | JAX | Linear Algebra | Matrix Operations | NumPyAsynchronous hiring process | Flexible collaboration | Part-time hoursMid-level Full TimeBoston, US17h ago
-
Senior Director, AI / Machine Learning Software Engineer USD 136K-300KApache Flink | Apache Spark | CI/CD | Data Lineage | Data PrivacyHealth benefits | Paid leave | Paid volunteer timeSenior-level Full TimeNew York, NY, United States17h ago
-
Data Engineering | Machine Learning | Machine Learning Pipelines | Python | Recommendation SystemsSenior-level Full TimeSan Jose, California, United States18h ago
-
Data Pipelines | Full Stack | Full-Stack Development | Machine Learning | PythonSenior-level Full TimeSan Jose, California, United States18h ago
-
C++ | Data Analysis | Data Manipulation | Data Processing | Deep learningSenior-level Full TimeMountain View, CA, USA19h ago
-
Software Engineer, Machine Learning USD 207K-300KC++ | Data Processing | Experimentation | Information Retrieval | Just-in-TimeSenior-level Full TimeNew York, NY, USA; Mountain View, …19h ago
-
Software Engineer III, AI/ML, Search News Intelligence USD 147K-211KAlgorithms | C++ | Data Processing | Data Structures | Feature EngineeringSenior-level Full TimeMountain View, CA, USA19h ago
-
Software Engineer Manager II, Embedded Systems, Firmware USD 207K-300KAgile project management | Automated testing | C++ | Direct memory access | Embedded operating systemsSenior-level Full TimeSunnyvale, CA, USA19h ago
-
Artificial Intelligence | C++ | CSS | Data Storage | Distributed ComputingSenior-level Full TimeNew York, NY, USA19h ago
-
Associate Principal, Trust and Safety, GenAI USD 142K-205KAbuse prevention | Cybersecurity | Dashboards | Data Transformation | Data VisualizationMid-level Full TimeWashington D.C., DC, USA; Seattle, WA, …19h ago