AWS Data Engineering Advisor
Tasks
- Build ETL/ELT pipelines
- Build reusable AWS utility libraries
- Create streaming data workflows with Kinesis
- Deliver reliable datasets with SLA backed pipelines
- Develop ingestion workflows into data lake
- Ensure observability with structured logs retry logic and alerting
- Execute config driven pipeline workflows with DynamoDB
- Implement data processing with AWS Glue and Athena
- Manage data quality validation and partitioning strategy
- Own deployment and runtime operations on AWS Batch and ECS
- Troubleshoot production data pipelines and resolve root causes
Perks/Benefits
- 401k retirement savings plan
- ESPP
- Employer-paid disability insurance
- Health, dental, and vision insurance
- Holidays
- Hybrid work policy
- Life insurance
- Paid time off
- Wellness days
Skills/Tech-stack
AWS | AWS Batch | AWS Glue | AWS Secrets | AWS Secrets Manager | Amazon Athena | Amazon CloudWatch | Amazon ECR | Amazon ECS | Amazon Kinesis | Amazon S3 | Apache Spark | CI/CD | Data Partitioning | Data Quality | Docker | DynamoDB | IAM | Iceberg | Parquet | PySpark | Python | SQL | Secrets Manager | Structured Logging | Unit Testing
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R4d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R17d ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Bonus | Equity | Friendly atmosphere | Remote-friendly environmentMid-level Full TimeSeattle, WA, USA8h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Portfolio and LinkedIn application support | Remote-friendlyMid-level Full TimeChicago, IL, USA8h ago
-
.NET | Accessibility APIs | Algorithms | App SDK | Asynchronous programmingAutonomy | Cross-functional collaboration | Flexible work setting | Mentorship opportunitiesSenior-level Full TimeAnchorage, AK, USA8h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Flexible, hands-off management | Opportunity to build accessible learning products | Remote or distributed teamMid-level Full TimeSan Francisco, CA, USA8h ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Bonus opportunities | Flexible management approach | Remote workMid-level Full TimeDallas, TX, USA8h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Bonus | Competitive compensation | Equity | Remote-friendlyMid-level Full TimeWashington, DC, USA8h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Friendly work environmentMid-level Full TimeRedmond, WA, USA8h ago
-
Bash | Data Processing | Docker | GCP | LinuxAsynchronous culture | Bonus | Equity | Friendly work environment | Remote/distributed workMid-level Full TimeScottsdale, AZ, USA8h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous work culture | Career growth | Collaborative team | Remote-friendlyMid-level Full TimePlano, TX, USA8h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeMid-level Full TimeSan Antonio, TX, USA8h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Laid-back atmosphere | Remote-friendly, distributed teamMid-level Full TimeSan Mateo, CA, USA8h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Hands off management approach | Portfolio and LinkedIn sharing during application | Remote distributed settingMid-level Full TimeSacramento, CA, USA8h ago
-
Bash | Data Processing | Docker | GCP | Large Scale DataAsynchronous culture | Friendly laid-back atmosphere | Opportunity to make impactMid-level Full TimeCulver City, CA, USA8h ago
-
Artificial Intelligence | Bash | Cloud platform | Data Ingestion | Data Ingestion PipelinesAsynchronous work culture | Bonus | Equity | Friendly work environment | Remote or distributed workMid-level Full TimePasadena, CA, USA8h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Hand off management | Remote-friendly, distributed teamMid-level Full TimeIndianapolis, IN, USA8h ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Bonus | Equity | Flexible, hands-off management | Remote-friendly environmentMid-level Full TimeNaperville, IL, USA8h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Flexible remote setting | Friendly work environmentMid-level Full TimePrinceton, NJ, USA8h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous work culture | Friendly work environmentMid-level Full TimeProvidence, RI, USA8h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerFlexible asynchronous culture | Friendly work environment | Impactful product | Remote/distributed workMid-level Full TimeBaltimore, MD, USA8h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Bonus | Equity | Flexible management approach | Remote-friendly, distributed teamMid-level Full TimeBend, OR, USA8h ago
-
Bash | Cloud infrastructure | Cloud platform | Data Ingestion | Data ProcessingAsynchronous culture | Friendly work environment | Opportunities for high impact on productMid-level Full TimeTucson, AZ, USA8h ago
-
Bash | Data Processing | Data pipeline | Docker | GCPAsynchronous culture | Career growth | Friendly work environment | Remote workMid-level Full TimeRiverside, CA, USA8h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeMid-level Full TimeBaton Rouge, LA, USA8h ago