Data Engineer II
Tasks
- Apply Terraform for infrastructure as code
- Build and optimize data pipelines
- Collaborate in Agile SCRUM ceremonies
- Communicate with stakeholders
- Deploy containerized applications on AWS EKS
- Design develop maintain Python applications and services
- Document technical designs and manage tasks in JIRA
- Ensure application security, scalability, and performance
- Implement API and microservices patterns
- Implement messaging and streaming solutions with Kafka
- Integrate with DynamoDB and PostgreSQL
- Use GitHub for version control and CI/CD pipelines
- Write testable code using Test Driven Development
Perks/Benefits
Skills/Tech-stack
API Gateway | AWS EKS | AWS Glue | AWS Lambda | Agile Scrum | Amazon API | Amazon API Gateway | Amazon DynamoDB | Amazon EKS | Amazon S3 | Apache Kafka | CD pipelines | CI/CD | CI/CD pipelines | Confluence | Django | Docker | FastAPI | Flask | GitHub | Jira | Kubernetes | Microservices | NoSQL | PostgreSQL | PySpark | Pytest | Python | REST APIs | Terraform | Test-Driven | Test-Driven Development | Unit Testing | Unittest
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R19d ago
-
Senior Data & ML Ops Engineer USD 137K-206KAWS | Airflow | Amazon SageMaker | Automated retraining | Automated testingHealth insurance | Paid time off | Retirement contributionsSenior-level Full TimeBoston, Massachusetts, US, 022105h ago
-
Accessibility API | Algorithms | Analytics | App SDK | Asynchronous programmingSenior-level Full TimeKansas City, MO, USA6h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Flexible remote work | Laid-back atmosphereMid-level Full TimeSeattle, WA, USA7h ago
-
Bash | Cloud infrastructure | Cloud platform | Data Ingestion | Data ProcessingAsynchronous culture | Diverse and inclusive workplace | Portfolio support | Remote-friendly environmentMid-level Full TimeChicago, IL, USA7h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous work culture | Career growth | Competitive compensation | Remote-friendly cultureMid-level Full TimeLong Beach, CA, USA7h ago
-
Bash | Data Processing | Docker | GCP | Large Scale DataAsynchronous culture | Friendly work environment | Remote workMid-level Full TimeSalt Lake City, UT, USA7h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Flexible management approachMid-level Full TimeMountain View, CA, USA7h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Laid-back atmosphere | Remote workMid-level Full TimeSunnyvale, CA, USA7h ago
-
AI Data | Bash | Cloud infrastructure | Data Ingestion | Data Ingestion PipelinesAsynchronous culture | Flexible team environment | Remote-friendlyMid-level Full TimeBerkeley, CA, USA7h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Collaborative team environment | Flexible, hands-off management | Remote-friendly work environmentMid-level Full TimeFremont, CA, USA7h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Laid back environment | Remote-friendlyMid-level Full TimeSanta Monica, CA, USA7h ago
-
Bash | Data Processing | Docker | GCP | Large Scale DataAsynchronous work culture | Career growth | Flexible management | Impactful missionMid-level Full TimeIrvine, CA, USA7h ago
-
Bash | Data Ingestion | Data Processing | Docker | GCPAsynchronous culture | Flexible management approach | Remote/distributed work | Supportive teamMid-level Full TimeHuntsville, AL, USA7h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous work culture | Friendly work environment | Remote-first environmentMid-level Full TimeTampa, FL, USA7h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Bonus | Equity | Friendly work environment | Portfolio supportMid-level Full TimeNewark, NJ, USA7h ago
-
Bash | Cloud platform | Data Processing | Data Processing Pipelines | Dataset EngineeringMid-level Full TimePhiladelphia, PA, USA7h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous work culture | Friendly work environment | Portfolio supportMid-level Full TimeNew Haven, CT, USA7h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Entrepreneurial team | Friendly laid-back atmosphere | Portfolio and LinkedIn sharing | Remote friendly distributed settingMid-level Full TimeTacoma, WA, USA7h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Flexible work environment | Impactful product mission | Remote workMid-level Full TimeColorado Springs, CO, USA7h ago
-
Bash | Data Processing | Data Processing Pipelines | Docker | GCPAsynchronous culture | Bonus | Equity | Flexible management | Remote workMid-level Full TimeHonolulu, HI, USA7h ago
-
Bash | Data Ingestion | Data Processing | Docker | GCPAsynchronous work culture | Bonus opportunity | Friendly work environment | Remote-friendlyMid-level Full TimeMilwaukee, WI, USA7h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Friendly work environment | Remote friendly distributed workMid-level Full TimeBloomington, IN, USA7h ago
-
Bash | Cloud platform | Docker | Google Cloud | Google Cloud PlatformAsynchronous culture | Flexible work environmentMid-level Full TimeDes Moines, IA, USA7h ago
-
Bash | Cloud infrastructure | Cloud platform | Data Ingestion | Data Ingestion PipelinesAsynchronous culture | Bonus | Distributed remote work | Equity | Friendly laid-back atmosphereMid-level Full TimeBuffalo, NY, USA7h ago