Senior Software Engineer - Data Platform
New York, New York, United States
USD 145K-165K Senior-level Full Time
Tasks
- Apply detection logic at scale
- Author validate and version workflow rules
- Build real time event processing
- Conduct code reviews
- Deploy services with CI CD
- Design and build data pipelines
- Design data lakehouse tables and partitions
- Develop detection workflow and rule engine
- Expose event and incident flow visibility
- Ingest and orchestrate telemetry data
- Instrument observability and data lineage
- Manage storage lifecycle and schema evolution
- Operate Kubernetes workloads
- Optimize query performance for analytics
- Own data models APIs and services
- Participate in light on call rotation
- Use AI assisted engineering tools for development
- Write design documentation and diagrams
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Apache Flink | Apache Iceberg | Apache Kafka | Automated testing | Avro | BigQuery | CI/CD | Checkpointing | ClickHouse | Dagster | Data Lakehouse | Distributed Systems | ETL | Event Processing | Event time | Java | Kafka Streams | Keyed State | Kubernetes | Orchestration | Prefect | Presto | Python | Real Time | Real-time event processing | SQL | Schema Registry | Snowflake | Spark SQL | Spark Structured Streaming | Starrocks | Stream processing | Structured Streaming | Test automation | Trino | Unit Testing | Watermarks
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Regions
Countries
States
Cities
Related jobs
-
Senior-level Full TimeHuntsville, United States15h ago
-
Senior Data Engineer USD 165K-184KAWS | Apache NiFi | Apache Spark | Data Modeling | Data PipelinesSenior-level Full TimeHuntsville, United States15h ago
-
Agile | Amazon Web Services | Apache Hive | Apache Spark | Apache ZeppelinMid-level ContractPortland, United States15h ago
-
Apache Flink | Apache Hive | Apache Kafka | Apache Spark | Apache ZookeeperSenior-level ContractPortland, United States15h ago
-
Amazon DynamoDB | Apache Hive | Java | NoSQL | Object-OrientedSenior-level ContractBeaverton, United States15h ago
-
Security Data Engineer USD 128K-214KAI | API Integration | API scaling | Anomaly Detection | Automated MonitoringDisability insurance | Health insurance | Holiday pay | Learning and development | Life insuranceSenior-level Full TimeUSA-VA-Herndon15h ago
-
Data Engineer USD 94K-157KAWS | Air-gapped | Air-gapped environments | Bash | CRISP-DMHealth insurance | Holiday pay | Learning and development | Life insurance | Long-term disabilitySenior-level Full TimeUSA-VA-Arlington, USA-Remote Work15h ago
-
Palantir MSS Developer / Engineer USD 84K-140KData Engineering | Data Modeling | Data Pipelines | Data Visualization | ELTMid-level Full TimeBaltimore, Maryland, United States; McLean, Virginia, …15h ago
-
AI and Data Science Engineer III USD 131K-218KAgile | Apache Spark | Artificial Intelligence | Data Modeling | Data PipelinesDiscretionary annual incentive program | Mentorship | Professional development | Travel opportunitySenior-level Full TimeRosslyn, Virginia, United States15h ago
-
AWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon CloudWatchBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeColumbus, OH, United States17h ago
-
Software Engineer III, Storage Infrastructure USD 147K-210KC++ | Code Reviews | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeNew York, NY, USA18h ago
-
Software Engineer, Search, AI/ML USD 147K-210KC++ | Data Governance | Data Governance Framework | Data Management | Data PrivacyMid-level Full TimeCambridge, MA, USA18h ago
-
C++ | Cloud Storage | Compute Technologies | Data Structures | Data Structures and AlgorithmsBonus | Equity | Health insurance | Paid time offSenior-level Full TimeNew York, NY, USA18h ago
-
Software Engineer, AI/ML, Google Research USD 147K-210KData Processing | Data Structures | Data Structures and Algorithms | Debugging | Language ProcessingMid-level Full TimeMountain View, CA, USA18h ago
-
Software Engineer III, Infrastructure, Infra Bigtable USD 147K-210KAsynchronous processing | Back-end | C++ | Concurrent programming | Consensus AlgorithmsSenior-level Full TimeNew York, NY, USA; Sunnyvale, CA, …18h ago
-
Senior Software Engineer, Infrastructure, Infra Bigtable USD 174K-252KAsynchronous processing | Backend Services | C++ | Concurrent programming | Consensus AlgorithmsSenior-level Full TimeNew York, NY, USA; Sunnyvale, CA, …18h ago
-
C++ | Cloud Computing | Computer Vision | Data Processing | Data StructuresSenior-level Full TimeMountain View, CA, USA18h ago
-
Software Engineer III, Generative AI, Workspace Drive USD 147K-210KCode review | Computer Vision | Data Optimization | Data Preparation | DebuggingSenior-level Full TimeBoulder, CO, USA18h ago
-
Senior Software Engineer, Map Ads Machine Learning USD 174K-252KAds serving | C++ | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA18h ago
-
Algorithms | Artificial Intelligence | C++ | Code Quality | Data StorageSenior-level Full TimeSunnyvale, CA, USA18h ago
-
Systems Yield Engineer, Quantum AI USD 132K-189KCryogenic testing | Data Analysis | Data Visualization | Electrical Noise Analysis | Electrical noiseMid-level Full TimeGoleta, CA, USA18h ago
-
ANSYS | ANSYS APDL | AVL Excite | Computational Fluid Dynamics | Design optimizationMid-level Full TimeColumbus, IN, United States19h ago
-
C# | Git | JTAG | Logic analyzer | MicrocontrollersEntry-level Full TimeHillsboro, OR, US20h ago
-
AI/ML Engineer - Automation/Robotics USD 180K-200KAlgorithms | Azure Machine Learning | Data Structures | Diffusion Models | Fine Tuning401k retirement plan | Flexible spending account | Medical, dental & vision coverage | Paid time off | Parental leaveSenior-level Full TimeRedmond, WA23h ago
-
Data Engineer USD 79K-147KAccess Control | Auditing | Backup and Recovery | Bash | Caching401k match | Dental insurance | Education assistance | Employee assistance program | Flexible spending accountsSenior-level Full TimeHighlands Ranch, CO, US1d ago