Real-Time Data Engineer
Tasks
- Architect Kafka platform
- Collaborate with application teams
- Configure Kafka security
- Deploy Kafka clusters
- Enable developers with tooling
- Ensure HA and DR
- Implement automation and observability
- Maintain Kafka Connect pipelines
- Manage schema registry
- Operate Kafka in production
- Support stream processing with Kafka Streams or ksqlDB
- Troubleshoot platform issues
- Use infrastructure as code
Perks/Benefits
- N/A
Skills/Tech-stack
ACLs | AWS MSK | Ansible | Apache Flink | Apache Kafka | Apache Spark | Apache Spark Streaming | Azure Event | Azure Event Hubs | Azure Event Hubs Kafka | Azure Event Hubs Kafka API | Bash | Confluent Operator | Confluent Platform | Go | Infrastructure as Code | KSQLDB | Kafka API | Kafka Connect | Kafka Streams | Kubernetes | Logging | MTLS | Monitoring | Observability | Python | RBAC | SASL | Schema Registry | Scripting | Spark Streaming | Strimzi | Terraform | Troubleshooting | “as-code”
Education
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R25d ago
-
Senior Software Engineer (Storage) - remote in the US USD 100K-155KArgoCD | CSI | Cluster API | Flux | GPU DirectConference attendance | Professional development and trainingSenior-level Full TimeRemote, USA, United States R6h ago
-
AI-Driven DevOps Engineer USD 132K-198KAI Agent | Alerting | Ansible | Artificial Intelligence | BashAdditional paid day off per month | Comprehensive onboarding and training | Conference participation fee coverage | English language classes discount | Fully remote workSenior-level Full TimeCyprus - Remote R16h ago
-
NLP AI Engineer USD 130K-180KAWS | Cloud platform | DeepSpeed ZeRO | Direct Preference Optimization | Distributed Training100 percent remote U.S. | Direct W2Senior-level Full TimeUnited States - Remote R16h ago
-
Applied AI Engineer USD 130K-180KAWS | Agentic AI | CI/CD | Cloud platform | Computer VisionCareer growth | Remote workSenior-level Full TimeUnited States - Remote R16h ago
-
Embedded Robotics Engineer USD 125K-145KC++ | Concurrent Systems | Control Systems | Debugging | GazeboCareer growth | Code review | Design review | Mentorship | Remote workSenior-level Full TimeUnited States - Remote R16h ago
-
Embedded Software Engineer USD 130K-195KARM Cortex | ARM Cortex A | ARM Cortex-M | Agile | Azure DevOpsSenior-level Full TimeUnited States - Remote R16h ago
-
Quantitative Engineer USD 150K-185KC++ | Cloud Native | Cloud Native Architecture | Columnar Databases | ConcurrencyCareer growth | Mentorship | Remote workSenior-level Full TimeUnited States - Remote R16h ago
-
Staff AI/ML Platform Engineer USD 144K-220KAWS | Alerting | Async Programming | CI/CD | Data EngineeringFlexible work environment | Professional growth opportunities | Remote work opportunitiesSenior-level Full TimeOakland, CA; Remote (United States) R1d ago
-
Senior Machine Learning Engineer (Remote) USD 176K-251KAPI Development | Amazon Web Services | Cloud Computing | DSP | DevOpsMinimal mentorship | Remote workSenior-level Full TimeNew York Office R1d ago
-
Mid-level Full TimeUnited States - Remote R1d ago
-
Senior Data Engineer USD 111K-139KAPI Integration | Amazon Redshift | Apigee | Azure | BI Publisher401k match | Bereavement leave | Dental insurance | Employee assistance program | Employee discountsSenior-level Full TimeRemote - Nationwide, United States R1d ago
-
AI & Machine Learning Vice President USD 120K-220KAWS | Alteryx | Anomaly Detection | Azure | C#401k | Dental insurance | Disability insurance | Health insurance | Hybrid work modelExecutive-level Full TimeUnited States R2d ago
-
Staff Machine Learning Engineer, Applied Research USD 189K-389KC++ | Graph Neural Networks | Information Retrieval | Java | Language ProcessingSenior-level Full TimeSan Francisco, CA, US; Remote, US R2d ago
-
Director, Data Analyst/BI Engineer USD 138K-175KAWS | Access Control | Aggregated Event Measurement | Airflow | BigQuery401k match | Healthcare Dental Vision | PTO | Paid Holidays | Parental leaveExecutive-level Full TimeUnited States R2d ago
-
Principal AI Engineer USD 185K-265KAPI Integration | Agent systems | Artificial Intelligence | Cloud Native | Cloud-native ArchitecturesEducation reimbursement | Health plans | Paid time off | Parental leave | Remote workSenior-level Full TimeRemote - USA R2d ago
-
Sr Machine Learning Engineer I USD 150K-241KAutomated retraining | Bayesian Filter | CI/CD | Cloud Computing | Data Association401k match | Dental insurance | Emotional & mental wellness support | Employee resource groups | Fitness programsSenior-level Full TimeSeattle, Washington, United States R2d ago
-
Data Engineer USD 160K-200KAWS | Apache Spark | Azure | CI/CD | DBT401k match | Continuing education support | Employee assistance program | Flexible spending accounts | Generous paid time offSenior-level Full TimeAuburn Hills, MI, US R2d ago
-
Senior Data Engineer II, AI Native USD 148K-216KAmazon Web Services | Apache Airflow | Apache Spark | Azure | BigQuery401k matching | Dental insurance | Disability insurance | Employee assistance program | Equipment reimbursementSenior-level Full TimeRemote, USA R2d ago
-
API Design | AWS | Apache Airflow | Apache Flink | Apache KafkaDental insurance | Employee discounts | Employee equity | Health insurance | Pet insuranceSenior-level Full TimeRemote - United States R2d ago
-
Senior Data Engineer USD 115K-175KAWS Fargate | AWS Glue | AWS IAM | AWS Lambda | AWS MWAACharitable giving program | Company-Paid Holidays | Dental insurance | Flexible PTO | Life insuranceSenior-level Full TimeMassachusetts - Boston R2d ago
-
Autonomy | C++ | DDS | Data Ingestion | Edge Computing401k | Healthcare coverage | Paid Holidays | Paid time off | Phone stipendMid-level Full TimeSan Carlos - Hybrid R2d ago
-
Senior Analytics Engineer USD 148K-218KAutomation | BI tools | CCPA | CI/CD | DBTDental insurance | Equity | Medical insurance | Remote work | Vision insuranceSenior-level Full TimeRemote, USA ; Remote, Canada R2d ago
-
A/B | A/B Testing | API Development | AWS Bedrock | Access Control401k plan | Healthcare premium coverage | Paid Company Holidays | Paid time off | Phone stipendSenior-level Full TimeSan Carlos - Hybrid R2d ago
-
AWS | AWS Batch | AWS Bedrock | AWS CDK | AWS CodeBuild401k | PTO | Paid Company Holidays | Phone stipend | Wellness stipendSenior-level Full TimeSan Carlos - Hybrid R2d ago