Software Engineer – Distributed Systems & Apache Kafka
Tasks
- Build technical onboarding requirements for new data types
- Design scalable Apache Kafka streaming systems
- Develop ETL ELT pipelines using AWS services
- Develop and maintain AWS CDK infrastructure as code
- Develop and maintain Kafka metrics reporting
- Implement multi environment deployments using CDK
- Report end to end latency throughput and operational status
Perks/Benefits
- N/A
Skills/Tech-stack
API Design | API Gateway | API Versioning | AWS CDK | AWS Fargate | AWS Lambda | Amazon API | Amazon API Gateway | Amazon Athena | Amazon DynamoDB | Amazon ECS | Amazon EKS | Amazon EventBridge | Amazon RDS | Amazon Redshift | Amazon S3 | Amazon SNS | Amazon SQS | Apache Kafka | Async Programming | Data Engineering | Data Lakes | Data Warehousing | ELT | ETL | Infrastructure as Code | Metrics dashboards | Monitoring | Python | Streaming Architectures | “as-code”
Education
N/A
Roles
Related jobs
-
Senior Data Engineer (St. Louis) USD 111K-139KANSI SQL | API | Amazon Redshift | Apigee | Azure401k matching | Bereavement | Dental insurance | Disability insurance | Employee assistance programSenior-level Full TimeRemote - Nationwide, United States R1h ago
-
Lead Data Analyst – World Cup Reporting Initiative USD 126K-267KAgile | Data Lakehouse | Data Pipelines | Databricks | ETLSenior-level ContractBeaverton, OR, US3h ago
-
A/B | A/B Testing | Agent systems | B testing | Data PipelinesSenior-level Full TimeCenter, Center District, IL3h ago
-
Cognos | DBT | Data Migration | Data Modeling | Data SecurityBasic life insurance | Dental and vision coverage | Education and development opportunities | Flextime work schedule | Paid HolidaysSenior-level Full TimeUnited States of America-OHIO-Franklin County-Columbus5h ago
-
Deep learning | Fine Tuning | GPU Computing | Language Models | Large Language ModelsEntry-level InternshipSan Jose, California, United States6h ago
-
UX Engineer, Robot Infrastructure, DeepMind USD 176K-189K3D visualization | Angular | C++ | Data Annotation | Full StackMid-level Full TimeMountain View, CA, USA7h ago
-
Software Engineer III, AI/ML GenAI, YouTube USD 147K-211KC++ | Code review | Computer Vision | Data Processing | DebuggingSenior-level Full TimeMountain View, CA, USA7h ago
-
C# | C++ | Code review | Compute Technologies | Data StructuresSenior-level Full TimeSunnyvale, CA, USA7h ago
-
Backup & Recovery | BigQuery | Cloud platform | Clustering | Data LakesTechnical workshops and training delivery | Travel up to 30 percent timeMid-level Full TimeReston, VA, USA7h ago
-
Senior-level Full TimeBoston, MA11h ago
-
Systems Engineer - Analytical chemistry USD 120K-130KCavity Ring-Down Spectroscopy | Computational Methods | Data Analysis | Data Visualization | Experimental uncertainty401k | Dental insurance | Employee referral program | Flexible spending account | Health savings accountMid-level Full TimeSanta Clara, CA12h ago
-
AI Engineer USD 120K-200KActive Learning | Data Flywheel | Data Generation | Dataset Construction | Deep learningIn-person collaboration | Medical, dental & vision coverageEntry-level Full TimeSan Francisco Office17h ago
-
Mid-level Full TimePHK, United States R18h ago
-
AI Engineer - Experienced Associate USD 63K-140KAI orchestration | AWS | Analytics Cloud | Cloud Native | Cloud platformMid-level Full TimeChicago - One North Wacker Drive, …18h ago
-
Senior-level Full TimeSan Jose, California, United States, United …18h ago
-
Data Engineer USD 77K-176KAWS Athena | AWS EMR | AWS Glue | AWS Redshift | AgileDependent care assistance | Paid leave | Professional development | Tuition assistance | Work-life programsMid-level Full TimeUSA, GA, Atlanta (575 Morosgo Drive …18h ago
-
Sr Data Engineer USD 30KAWS | AWS Glue | AWS IAM | AWS Lambda | Amazon CloudWatch401k match | Adoption Assistance | Associate Assistance Plan | Dental insurance | Education assistance programSenior-level Full TimeIrving TX (Greenway), United States18h ago
-
Data Engineer - AWS / Snowflake USD 165K-216KAWS | Agile | Amazon S3 | Bitbucket | Data ModelingWork from homeSenior-level Full TimeWork@Home USA, United States18h ago
-
Data Scientist, Senior (TS/SCI w/ Poly) USD 125K-225KAWS | Ansible | CI/CD | Containerization | DockerSenior-level Full TimeUSA MD Columbia (Field), United States18h ago
-
Senior Software Engineer – Embedded USD 86K-165KAgile | C# | C++ | CUDA | Code Analysis401k match | Dental insurance | Employee assistance program | Flexible spending accounts | Flexible work schedulesSenior-level Full TimeUS-TX-MCKINNEY-513WC ~ 2501 W University Dr …18h ago
-
CI/CD | Data Generation | Data Privacy | Docker | Hugging Face401k | Medical/Dental/Vision insurance | Paid time off | Wellness programsSenior-level Full Time6400 LAS COLINAS BLVD IRVING, United …18h ago
-
AI Engineer (React UI) - Remote US USD 135K-170KAWS | Accessibility | Anthropic Claude | Apache Airflow | AzureRemote workSenior-level Full TimeWauwatosa, WI, United States R23h ago
-
Mid-level Full TimeWashington D.C.; On-site1d ago
-
API Integration | Algorithms | Analytics | Data Modeling | Data PipelinesClient impact | Hybrid work environment | Professional growthEntry-level Full TimeNew York, New York; Onsite1d ago
-
Automatic Speech Recognition | Benchmarking | Data Pipelines | Deep learning | Language ProcessingCollaborative work environment | Innovation-driven team | Opportunity for growthSenior-level Full TimeSan Francisco, CA; On-site1d ago