Staff Software Engineer - Core Ingest
Tasks
- Build and manage data platforms using Kafka Kubernetes and Docker
- Collaborate across teams to architect data core ingest solutions
- Design and implement backend systems for high volume fault tolerant scalable data ingestion
- Develop multi threaded distributed systems
- Improve cluster load scheduling algorithms for elastic runtime
- Provide performance guarantees for multi tenant architecture
- Rearchitect internal message processing to petabyte per day scale
Perks/Benefits
Skills/Tech-stack
Agile Development | Apache Kafka | Distributed Systems | Docker | Fault Tolerance | Java | Kubernetes | Linux | Microservices | Multithreading | Performance Engineering | Scala | Scalability | Test-Driven | Test-Driven Development
Education
Roles
Related jobs
-
Staff Software Engineer - Data Query USD 191K-224KAgile | Automated testing | Big Data | C++ | Data StructuresSenior-level Full TimeUnited States, Remote R6h ago
-
Senior Full Stack Software Development Engineer - AI USD 135K-188KAWS | Agile | Amazon SQS | Automated testing | CI/CD401k matching | Flexible time off | Fully remote | Medical, dental, and vision coverage | Paid HolidaysSenior-level Full TimeUnited States, UNITED STATES, United States R10h ago
-
Senior Software Engineer - Data Infrastructure, Safety USD 196K-243KA/B | A/B Testing | AI | Automation | B testingSenior-level Full TimeSan Mateo, CA, United States R13h ago
-
Machine Learning Engineer USD 180K-250KAWS | Azure | CUDA | DDP | Distributed Training401k employer match | Health, dental, vision insurance | Paid time off | Professional development | Work-life balanceMid-level Full TimeEmeryville, California, United States; Hybrid (2-3 … R16h ago
-
Software Engineer - Platform USD 190K-230KAPI Design | Amazon Web Services | CI/CD | Distributed Systems | GraphQLBenefits | Equity | Remote work flexibilityMid-level Full TimeRemote with offices in San Francisco, … R18h ago
-
Algorithms | Amazon Kinesis | Amazon Kinesis Data Analytics | Apache Beam | Apache FlinkEmployer-matched 401k | Exceptional benefits package | Flexible paid time off | Hybrid work environmentSenior-level Full TimeSeattle, WA R1d ago
-
Amazon Kinesis | Amazon Kinesis Data Analytics | Apache Beam | Apache Cassandra | Apache Flink401k match | Comprehensive benefits | Flexible vacation | Paid time offSenior-level Full TimeSanta Monica, CA R1d ago
-
Algorithms | Amazon Kinesis | Amazon Kinesis Data Analytics | Apache Beam | Apache FlinkCompetitive compensation | Employer matched 401k plan | Exceptional benefits package | Flexible vacation and paid time off | Hybrid work environmentSenior-level Full TimePalo Alto, CA R1d ago
-
Data Engineer - AI (Spark, Databricks and Healthcare) USD 105K-125KAWS S3 | Airflow | Amazon Web Services | Apache Hadoop | Apache Kafka401k savings plan | Dental insurance | Disability insurance | Flexible work schedule | Health insuranceMid-level Full TimeRemote, United States R1d ago
-
Senior Data Engineer AI USD 140K-165KAWS | Amazon Web Services | Apache Airflow | Apache Spark | Data Ingestion401k matching | Dental insurance | Disability insurance | Life insurance | Medical insuranceSenior-level Full TimeRemote, United States R1d ago
-
Senior GenAI Engineer USD 90K-189K.NET | AWS | Agno | Amazon Bedrock | Anthropic APIContinuing education | Flexible time off | Healthcare | Learning and development resources | Retirement benefitsSenior-level Full Time999 REMOTE, United States R1d ago
-
Cloud Machine Learning Engineer - US remote USD 150K-200KAWS CloudWatch | Accelerate | Amazon EC2 | Amazon S3 | Amazon SageMakerConference reimbursement | Flexible paid time off | Flexible working hours | Health, dental, and vision benefits | Parental leaveMid-level Full TimeUnited States - Remote R1d ago
-
Staff Data Engineer USD 187K-245KAPI Gateway | Alerting | Amazon Redshift | Apache Airflow | BigQueryEquity | Flexible paid time off | Health insurance 100% paid premium | Lifestyle stipend | Parental leaveSenior-level Full TimeRemote, US R2d ago
-
Senior Data Engineer USD 117K-161KAWS | Agile | Avro | Azure | Azure Databricks401k match | Career development opportunities | Caregiver leave | Employee charity matching program | HolidaysSenior-level Full TimeWork at Home - Kentucky, United … R2d ago
-
Senior Software Engineer (Data Platform) USD 123K-200KApache Flink | Argo CD | BigQuery | Bigtable | CloudSQLMentorship | Onboarding program | Remote workSenior-level Full TimeRemote - United States R3d ago
-
Data Platform Engineer USD 100K-150KAWS | Amazon Kinesis | Apache Airflow | Apache Iceberg | Apache Spark401k match | Annual bonus | Annual performance reviews | Company equipment provided | Company eventsMid-level Full TimeAtlanta, GA preferred, Remote R3d ago
-
Ansible | Apache Kafka | Apache Storm | Authentication | Authorization401k matching | Commuter benefits | Flexible spending accounts | Life insurance | Long-term disabilitySenior-level Full TimeUnited States R3d ago
-
Senior Machine Learning Engineer, Voice Experience USD 205K-270KAutomatic Speech Recognition | Benchmarking | Continuous Learning | Conversational AI | Data PipelinesCommuter benefits | Flexible paid time off | In-office meals | Medical, dental & vision coverage | Paid parental leaveSenior-level Full TimeUnited States (Remote) R3d ago
-
Senior IT Infrastructure Engineer USD 150K-200KAWS | AWS Organizations | Ansible | Azure | CDNHealth and wellness resources | Remote work | Wellness Fridays | Work-life balance supportSenior-level Full TimeRemote - United States R3d ago
-
Machine Learning Engineer USD 138K-183KAWS | Airflow | Amazon Redshift | Amazon SageMaker | Apache Flink401k retirement savings | Health care insurance | Occasional travel for meetings | Paid parental leave | Paid sick timeMid-level Full TimeRemote - US R4d ago
-
Active Directory | Agile | Amazon Web Services | Databases | Enterprise LinuxAchievement Awards | Child/adult backup care | Educational assistance | Employee assistance program | Flexible work schedulesSenior-level Full TimeUS-TX-REMOTE, United States R4d ago
-
Principal Software Engineer- GenAI USD 136K-219KAgent Framework | Alerting | Ansible | CI/CD | CQRS401k retirement plan | Employee assistance program | Flexible spending account | Flexible work environment | Health savings accountSenior-level Full TimeBoston, MA, United States R4d ago
-
Sr. Data Engineer USD 137K-254KAccess Control | Cloud platform | Data Modeling | Data Sharing | Data TransformationCareer development and growth | Employee Assistance Program access | Fitness reimbursement | Flexible vacation | Flexible work policiesSenior-level Full TimeUnited States of America, McLean, Virginia R4d ago
-
Senior Inference Engineer - AI USD 100K-204KAPI Design | API Integration | AWS | Azure | C++Career development | Flexible work hours | Hybrid work model | Mental health days | Retirement savingsSenior-level Full TimeUnited States of America, Eagan, Minnesota R4d ago
-
Senior Python Developer - Code Migration Specialist USD 160K-160KBash | Coverage.py | Dagger | Docker | GcovFlexible schedule | Freelance project-based collaboration | Fully remote work | Global community supportSenior-level Full TimeUnited States - Remote R4d ago