Senior Software Engineer, Data Engineering
Manhattan, New York, United States
USD 121K-161K Senior-level Full Time
Tasks
- Build cloud native data infrastructure for real time and batch workloads
- Design build maintain streaming and batch data processing services
- Develop real time data transformation enrichment validation routing
- Ensure scalability fault tolerance and performance of pipelines
- Implement deployment automation observability and operational tooling
- Own evolve event schemas and data contracts
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | At least once | At least once semantics | Automated testing | Avro | Azure | Backpressure | CI/CD | Container Orchestration | Data Enrichment | Data Ingestion | Data Pipelines | Data Routing | Data Transformation | Data Validation | Databricks | Deployment Automation | Distributed Systems | Event Driven | Event-driven architecture | Exactly once | Exactly-once semantics | Fault Tolerance | Infrastructure as Code | Java | Kafka | Kafka Streams | Kubernetes | Observability | Protobuf | Python | Real Time | Real-time Data | Real-time data pipelines | Scala | Schema Registry | Stream processing | Terraform | “as-code”
Education
N/A
Related jobs
-
Lead Software and Data Engineer USD 155K-200KADLS Gen2 | Apache Spark | Azure | Azure Data | Azure Data Lake401k | Disability insurance | Life insurance | Medical/Dental/Vision | Paid time offSenior-level Full TimeChicago, Illinois, United States3h ago
-
Senior-level Full TimeUS - San Francisco5h ago
-
Data Engineer, Data Platform - Distribution USD 180K-210KAccess Control | Agentic Systems | Auditing | BI Modernization | Business IntelligenceSenior-level Full TimeBoston, MA10h ago
-
Data Engineer, Expert USD 133K-238KApache Spark | Big Data | CI/CD | Cloud Data | Cloud Data WarehouseSenior-level Full TimeOakland, CA, US, 9461210h ago
-
Senior Software Engineer, Data Platform USD 128K-168KAWS | Amazon EC2 | Amazon RDS | Amazon S3 | ClickHouseGenerous vacation policies | Health insurance coverage | Paid leave | Relocation assistanceSenior-level Full TimeBerkeley, CA10h ago
-
Staff Software Engineer, Data Platform USD 147K-194KAmazon Web Services | ClickHouse | DBT | Dagster | DatabricksMedical/Dental/Vision insurance | Paid leave | Paid parental leave | Relocation assistance | Vacation timeSenior-level Full TimeBerkeley, CA10h ago
-
Autonomous Vehicles | C++ | Data Pipelines | Deep learning | JAXCompany benefits program | Discretionary annual bonus | Equity incentive planSenior-level Full TimeMountain View, CA, USA; San Francisco, …11h ago
-
Mid-level Full TimeNew York12h ago
-
Senior Software Engineer, Data Governance USD 130K-250KAWS | Access Control | Airflow | Amazon Bedrock | Amazon SageMakerBonus | Equity | Health insurance | Open to office work in San FranciscoSenior-level Full TimeSan Francisco, CA12h ago
-
Sr. AI / Embedded ML Engineer USD 120K-200KARM Cortex | ARM Cortex-M | Accelerometer | Automl | BarometerContinuous learning and development | Fair and honest workplace | Financial solutions for the future | Health and wellness care options | Optional Legal Services US OnlySenior-level Full TimeSaratoga, CA12h ago
-
Principal Data Engineer USD 160K-200KAI Agents | AWS Glue | AWS Lambda | Amazon ECS | Amazon MSK401k | Dental insurance | Discounts | Fully remote | Medical insuranceExecutive-level Full TimeNew York, NEW YORK, United States R12h ago
-
Senior Embedded Software Engineer I USD 132K-200KAWS | Automated testing | BLE | Beam | C#401k employer match | Dental insurance | Employee stock purchase plan | Flexible PTO | Life insuranceSenior-level Full TimeUnited States R12h ago
-
Software Engineer, Research Data Platform USD 320K-405KAPIs | Application development | BigQuery | Data Cataloging | Data LineageFlexible working hours | Generous vacation | Hybrid work policy | Optional equity donation matching | Parental leaveMid-level Full TimeSan Francisco, CA | New York …13h ago
-
Staff Engineer – Experimentation Team USD 182K-295KAWS | Bayesian | Bayesian optimization | BigQuery | CUPEDDental insurance | Health insurance | Mental health benefits | Restricted stock units | Vision insuranceSenior-level Full TimeRemote - US R13h ago
-
AWS | Algorithms | Azure | C# | ContainersMid-level Full TimeBellevue13h ago
-
Computational Geometry Senior Software Engineer USD 120K-165K3D CAD | 3D Modeling | 3D engineering analysis | 3D scanning | ACISHybrid work | Ownership planSenior-level Full TimeUnited States13h ago
-
Senior Software Engineer, Data Engineering USD 130K-150KApache Kafka | Apache Spark | At least once | Automated testing | AvroSenior-level Full TimeAndover, Massachusetts, United States13h ago
-
Senior Software Engineer, Data Engineering USD 121K-161KApache Kafka | At least once | At least once semantics | Avro | BackpressureSenior-level Full TimeCarlsbad, California, United States13h ago
-
GenAI Product Engineer USD 70K-136KAPI Development | Cloud Computing | Cloud platform | DevOps | Generative AICertification training | Fully remote within contiguous US | Hands-on experienceMid-level Full TimeArlington, VA R14h ago
-
Senior Staff Machine Learning Engineer - Agentic Systems USD 281K-401KAgent Orchestration | Data Pipelines | Distributed Systems | Evaluation systems | Experimentation401k retirement plan | Health insurance | Meal allowance | Paid Holidays | Paid parental leaveSenior-level Full TimeNew York, NY14h ago
-
Staff Data Engineer USD 170K-200KABAC | Aerospike | Amazon Redshift | Amazon S3 | Amazon SNSEmployee discounts | Employee equity | Medical, dental, and vision coverage | Pet insurance | Unlimited PTOSenior-level Full TimeRemote - United States R14h ago
-
A/B | A/B Testing | Airflow | B testing | BigQuerySenior-level Full TimeSan Francisco Bay Area14h ago
-
Databricks Lead (Data Migration Lead) USD 180K-248KAWS | Agile | Batch Processing | CI/CD | Data GovernanceOnsite workSenior-level Full TimeDetroit, MI, United States14h ago
-
Staff Machine Learning Engineer USD 220K-280KAWS | Amazon SageMaker | Apache Flink | BigQuery | C++401k match | Annual performance reviews | Company equipment | Dental insurance | Disability benefitsSenior-level Full TimeAtlanta, GA preferred, Remote R14h ago
-
Ansible | Cloud Native | Cloud-native software | Configuration Management | DevOps401k match | ESPP | Family leave | Flexible spending accounts | Flexible time awaySenior-level Full TimeChicago, Illinois, United States14h ago