Streaming Data Engineer
Tasks
- Architect Kafka platforms
- Collaborate with application teams
- Configure Kafka security
- Deploy and operate Kafka clusters
- Enable developers with Kafka tooling
- Implement high availability and disaster recovery
- Implement observability for Kafka
- Own Kafka end to end automation
- Perform code review and design review
- Translate requirements into solutions
- Troubleshoot Kafka production issues
Perks/Benefits
Skills/Tech-stack
AWS MSK | Ansible | Apache Flink | Apache Kafka | Apache Kafka Connect | Apache Spark | Azure Event | Azure Event Hubs | Azure Event Hubs Kafka | Azure Event Hubs Kafka API | Bash | Confluent Operator | Confluent Platform | Data Governance | Data Lineage | Disaster Recovery | Go | High Availability | KSQLDB | Kafka API | Kafka Connect | Kafka Security | Kafka Streams | Kafka internals | Kubernetes | MTLS | Observability | Python | RBAC | SASL | Schema Registry | Strimzi | Terraform
Education
Roles
Related jobs
-
Senior Machine Learning Engineer USD 229K-360KA/B | A/B Testing | Amazon S3 | Amazon SageMaker | Apache AirflowDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeSan Jose, California R1d ago
-
Senior Machine Learning Engineer, Search USD 361K-510KA/B | A/B Testing | Apache Airflow | Apache Spark | B testingCommuter benefits | Disability benefits | Equity awards | Health insurance | Life insuranceSenior-level Full TimeSan Jose, California R1d ago
-
Applied AI Architect, Strategic Enterprise Tech USD 240K-315KAPI Integration | Cloud Architecture | Data Science | Enterprise Integration | LLMFlexible work | Generous vacation | Parental leaveSenior-level Full TimeSan Francisco, CA | New York … R1d ago
-
Apache Flink | Apache Iceberg | Apache Spark | Avro | Concurrency401k match | ESPP | Family leave | Flexible time off | Flexible work scheduleSenior-level Full TimeSan Diego, CALIFORNIA, United States R1d ago
-
Senior Staff Data Platform Engineer - Data Access Team USD 201K-352KAlgorithms | CI/CD | Data Structures | Design Patterns | Distributed Systems401k match | ESPP | Family leave programs | Flexible spending accounts | Flexible time offSenior-level Full TimeSanta Clara, CALIFORNIA, United States R1d ago
-
Data Engineer – Databricks USD 152K-200KAWS | Apache Airflow | Azure | Azure Data | Azure Data FactoryContract-to-hire | Hybrid work onsite 3 days per weekSenior-level Contract Full TimeBeaverton, OR, United States R1d ago
-
Senior Software Engineer - Machine Learning Platform USD 166K-230KAPIs | AWS | Automation | Backtesting | DBT401k matching | Annual productivity allowance | Employee assistance program | Employee stock purchase plan | Health, dental, and vision insuranceSenior-level Full TimeUnited States | Remote R1d ago
-
Senior Machine Learning Engineer, Agent Eval Platform USD 176K-308KData labeling | Distillation | Evaluation | Fine Tuning | Information RetrievalInclusive work environment | Remote work flexibilitySenior-level Full TimeSanta Clara, CALIFORNIA, United States R1d ago
-
Data Scientist - Foward Deployed Engineer USD 160K-170KAPIs | Agentic Workflows | Anomaly Detection | Context engineering | Experimentation401k | Employee assistance program | Health spending account | Life insurance | Long-term disabilityMid-level ContractPalo Alto, California, USA R1d ago
-
Data Engineer II USD 78K-117KCI/CD | Cortex AI | Data Lake | Data Warehouse | ETL401k retirement plan | Employee assistance program | Health savings account | Life insurance | Long-term disabilityMid-level Full TimeBaltimore, Maryland, USA R1d ago
-
Senior Machine Learning Engineer USD 176K-308KAlgorithms | Artificial Intelligence | Code Tuning | Code profiling | Design PatternsFlexible work persona | Remote work flexibilitySenior-level Full TimeWest Palm Beach, Florida, United States R1d ago
-
Data Engineer USD 101K-130KBI | DBT | Data Modeling | Data Monitoring | Data QualityHybrid work | On site 3 to 4 days per week | Self service analytics enablementMid-level Full TimeDallas, TX R1d ago
-
Fullstack AI Engineer USD 117K-147KAWS | Anthropic | CI/CD | Go | JavaScriptDental insurance | Flexible time off | Medical insurance | Paid parental leave | SabbaticalMid-level Full TimeUnited States (Remote-First) R1d ago
-
Staff+ Software Engineer, RL Data Platform USD 320K-405KAPI | Crowdsourcing | Data Modeling | Data pipeline | LLMFlexible working hours | Generous vacation | Hybrid work policy | Optional equity donation matching | Parental leaveSenior-level Full TimeSan Francisco, CA | New York … R1d ago
-
Staff+ Research Engineer, RL Data Platform USD 500K-850KData pipeline | LLM Evaluation | Latency optimization | Machine Learning | MonitoringFlexible working hours | Generous vacation | Hybrid work policy | Optional equity donation matching | Parental leaveSenior-level Full TimeSan Francisco, CA | New York … R1d ago
-
Analytics Engineer USD 95K-105KBigQuery | Cursor | DBT | Data Contracts | Data Governance401k | Anniversary Milestone Celebrations | Flexible PTO | HSA contribution | Home internet reimbursementMid-level Full TimeRemote, United States R1d ago
-
Sr. Data Engineer (Hybrid - Addison, TX) USD 120K-150KAzure | Azure Data | Azure Data Factory | Data Cleansing | Data FactoryHybrid work schedule | Knowledge sharing culture | Onsite commute requirement 3 days per weekSenior-level Full TimeAddison, TX, United States R1d ago
-
BeeGFS | CI/CD | CUDA | Caching | CephSenior-level Full TimeSan Jose, CA / Austin, TX-%LABEL … R1d ago
-
Data Engineer II USD 150K-225KAmazon EKS | Amazon MSK | Amazon Web Services | Apache Flink | Apache Kafka401k match | Dental insurance | Employee discounts | Medical insurance | Paid time offMid-level Full TimeUnited States, Aliso Viejo, CA R2d ago
-
AI Solutions Engineer USD 217K-298KAPI Integrations | APIs | Application Programming | Application Programming Interfaces | Cost Optimization401k match | Coffee stipend | Flexible PTO | Health and wellness stipend | Medical/Dental/Vision insuranceMid-level Full TimeNew York, NY (HQ) R2d ago
-
APIs | Access Control | Agentic Workflows | Cloud Computing | Context engineeringTravel opportunitiesSenior-level Full TimeUSA - Remote R2d ago
-
Sr. Software Engineer USD 150K-190KAI workflows | API | AWS | Agentic Workflows | Coordinate systems401k match | Dental insurance | Family plan benefits | Flexible time off | Hybrid work modelSenior-level Full TimeAtlanta, GA R2d ago
-
Apache Flink | Apache Iceberg | Apache Spark | Avro | Concurrency401k match | ESPP | Family leave | Flexible time away | Flexible-hybrid workSenior-level Full TimeSan Diego, CALIFORNIA, United States R2d ago
-
Senior Manager, AI Software Engineering USD 199K-235KAWS | Agile | Automated testing | CI/CD | Cloud Native401k match | Flexible time off | Hybrid work model | Medical insuranceSenior-level Full TimeNew York, NY R2d ago
-
API Integration | Access Control | Agent Packs | Agentic Workflows | Anthropic APICustomer facing delivery opportunities | Remote work | Travel 25 percentSenior-level Full TimeUSA - Remote R2d ago