Software Engineer – Distributed Systems & Apache Kafka
Tasks
- Build technical onboarding requirements for new data types
- Design scalable Apache Kafka streaming systems
- Develop ETL ELT pipelines using AWS services
- Develop and maintain AWS CDK infrastructure as code
- Develop and maintain Kafka metrics reporting
- Implement multi environment deployments using CDK
- Report end to end latency throughput and operational status
Perks/Benefits
- N/A
Skills/Tech-stack
API Design | API Gateway | API Versioning | AWS CDK | AWS Fargate | AWS Lambda | Amazon API | Amazon API Gateway | Amazon Athena | Amazon DynamoDB | Amazon ECS | Amazon EKS | Amazon EventBridge | Amazon RDS | Amazon Redshift | Amazon S3 | Amazon SNS | Amazon SQS | Apache Kafka | Async Programming | Data Engineering | Data Lakes | Data Warehousing | ELT | ETL | Infrastructure as Code | Metrics dashboards | Monitoring | Python | Streaming Architectures | “as-code”
Education
N/A
Roles
Related jobs
-
Cognos | DBT | Data Migration | Data Modeling | Data SecurityBasic life insurance | Dental and vision coverage | Education and development opportunities | Flextime work schedule | Paid HolidaysSenior-level Full TimeUnited States of America-OHIO-Franklin County-Columbus4h ago
-
Deep learning | Fine Tuning | GPU Computing | Language Models | Large Language ModelsEntry-level InternshipSan Jose, California, United States4h ago
-
UX Engineer, Robot Infrastructure, DeepMind USD 176K-189K3D visualization | Angular | C++ | Data Annotation | Full StackMid-level Full TimeMountain View, CA, USA6h ago
-
Software Engineer III, AI/ML GenAI, YouTube USD 147K-211KC++ | Code review | Computer Vision | Data Processing | DebuggingSenior-level Full TimeMountain View, CA, USA6h ago
-
C# | C++ | Code review | Compute Technologies | Data StructuresSenior-level Full TimeSunnyvale, CA, USA6h ago
-
Backup & Recovery | BigQuery | Cloud platform | Clustering | Data LakesTechnical workshops and training delivery | Travel up to 30 percent timeMid-level Full TimeReston, VA, USA6h ago
-
Senior-level Full TimeBoston, MA10h ago
-
Systems Engineer - Analytical chemistry USD 120K-130KCavity Ring-Down Spectroscopy | Computational Methods | Data Analysis | Data Visualization | Experimental uncertainty401k | Dental insurance | Employee referral program | Flexible spending account | Health savings accountMid-level Full TimeSanta Clara, CA11h ago
-
AI Engineer USD 120K-200KActive Learning | Data Flywheel | Data Generation | Dataset Construction | Deep learningIn-person collaboration | Medical, dental & vision coverageEntry-level Full TimeSan Francisco Office16h ago
-
Mid-level Full TimePHK, United States R17h ago
-
AI Engineer (React UI) - Remote US USD 135K-170KAWS | Accessibility | Anthropic Claude | Apache Airflow | AzureRemote workSenior-level Full TimeWauwatosa, WI, United States R21h ago
-
Mid-level Full TimeWashington D.C.; On-site1d ago
-
API Integration | Algorithms | Analytics | Data Modeling | Data PipelinesClient impact | Hybrid work environment | Professional growthEntry-level Full TimeNew York, New York; Onsite1d ago
-
Automatic Speech Recognition | Benchmarking | Data Pipelines | Deep learning | Language ProcessingCollaborative work environment | Innovation-driven team | Opportunity for growthSenior-level Full TimeSan Francisco, CA; On-site1d ago
-
Asynchronous programming | Low Latency | Low-Latency Systems | Python | TypeScriptCollaborative work environment | Innovative environmentMid-level Full TimeNew York, New York; On-site1d ago
-
Clean Code | Data Structures | Deployment | Language Models | Language ProcessingCollaborative environment | Innovation encouragedSenior-level Full TimeSan Francisco, CA; Onsite1d ago
-
Data Pipelines | Deep learning | Document Understanding | Fine Tuning | Hugging FaceSenior-level Full TimeNew York, New York; Onsite1d ago
-
API Development | Classification | Django | Experimentation | Language ModelsVisa sponsorshipSenior-level Full TimeSan Francisco, CA; Onsite1d ago
-
Data Pipelines | Inference Systems | Language Models | Language Processing | Large Language ModelsEquity | Onsite workMid-level Full TimeNew York, New York; Onsite1d ago
-
AWS | Docker | GraphQL | JavaScript | KubernetesVisa sponsorshipMid-level Full TimeSan Francisco, CA; Onsite1d ago
-
Senior-level Full TimeJersey City, New Jersey, United States1d ago
-
AI/ML Engineer (TS/SCI with Polygraph required) USD 205K-270KAWS Bedrock | AWS GovCloud | AWS SageMaker | Air gapped deployment | Air-gapped401k match | Company sponsored training | Disability insurance | Gym membership | Health insuranceSenior-level Full TimeColumbia, Maryland, United States1d ago
-
Staff Machine Learning Engineer USD 192K-305K.NET | A/B | A/B Testing | API Design | AlertingCommute subsidy | Disability insurance | Employee assistance program | Employee resource groups | Employee stock ownershipSenior-level Full TimeMountain View, CA, USA1d ago
-
Senior DevOps / MLOps Engineer USD 160K-245KCI/CD | Cybersecurity | DVC | Data version control | Distributed TrainingSenior-level Full TimePalo Alto, CA1d ago
-
Staff Data Platform Engineer USD 164K-246KAWS | AWS CDK | AWS Lambda | Batch Processing | CI/CD401k match | Annual equity awards | Catered meals | Company paid life insurance | Flexible paid time offSenior-level Full TimeRemote, United States R1d ago