AWS Data Engineer
Tasks
- Apply IAM for secure data access
- Build analytics and reporting dashboards with Amazon QuickSight
- Build data lakes on S3
- Configure AWS Glue crawlers and Glue Data Catalog
- Create event driven transformations with AWS Lambda
- Design and optimize data warehouses with Amazon Redshift
- Design lakehouse architectures on S3
- Develop ETL pipelines using AWS Glue and PySpark
- Implement data quality and observability mechanisms
- Implement fine grained security with AWS Lake Formation
- Implement streaming and CDC ingestion using AWS DMS and Kinesis
- Integrate DynamoDB and SQS for event processing
- Optimize costs with S3 storage tiers and Redshift RA3 and Glue optimization
- Orchestrate data workflows with AWS Step Functions
- Query datasets using Amazon Athena
- Tune performance using distribution keys sort keys parallelism and compaction
- Write stored procedures and complex SQL
Perks/Benefits
- 401k matching
- Dental insurance
- Education assistance program
- Health insurance
- Holiday pay
- Identity theft protection
- Life insurance
- Long-term disability
- Paid time off
- Short-term disability
- Vision insurance
- Wellness resources
Skills/Tech-stack
AWS CloudFormation | AWS Data | AWS Data Migration | AWS Data Migration Service | AWS EMR | AWS Glue | AWS IAM | AWS Kinesis | AWS Lake Formation | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon QuickSight | Amazon Redshift | Amazon S3 | Amazon SQS | Amazon Web Services | CI/CD | Change Data Capture | Data Capture | Data Migration Service | Data Modeling | Data Observability | Data Partitioning | Data Quality | DynamoDB | ETL | Lake Formation | Lakehouse | PySpark | Python | SQL | Schema Design | Step Functions | Stored Procedures | Terraform | Web Services
Education
Roles
Related jobs
-
Senior Product Engineer, Machine Learning Accelerators USD 144K-209KBash | Bench testing | Board assembly | Bring-up | Cause analysisSenior-level Full TimeSunnyvale, CA, USA3h ago
-
Software Engineer, Storage Everywhere, Google Cloud USD 147K-211KBack-end | Back-end development | C++ | Cloud Platforms | Data StructuresMid-level Full TimeSunnyvale, CA, USA3h ago
-
Senior Staff Software Engineer, Torch TPU USD 262K-365KAlgorithms | C++ | Cloud Computing | Computer Vision | Data ProcessingSenior-level Full TimeSunnyvale, CA, USA3h ago
-
Senior Software Engineer, AI/ML GenAI, Google Cloud USD 174K-252KC plus plus | Computer Vision | Data Processing | Debugging | Distributed ComputingSenior-level Full TimeSunnyvale, CA, USA3h ago
-
Senior Software Engineer, AI/ML GenAI, Google Play USD 174K-252KAndroid | C++ | Computer Vision | Data Processing | Data StorageSenior-level Full TimeMountain View, CA, USA3h ago
-
Staff Software Engineer, AI/ML GenAI, Google Cloud USD 207K-300KAlgorithms | C++ | Cloud infrastructure | Computer Vision | Data ProcessingSenior-level Full TimeSunnyvale, CA, USA; San Francisco, CA, …3h ago
-
Senior Software Engineer, AI/ML, Google Workspace USD 174K-252KC++ | Data Processing | Debugging | Language Processing | ML InfrastructureSenior-level Full TimeNew York, NY, USA; Sunnyvale, CA, …3h ago
-
Senior Software Engineer, Data Cloud Memorystore USD 174K-252KC++ | Caching | Cloud Computing | Cloud Networking | Cloud platformSenior-level Full TimeKirkland, WA, USA3h ago
-
RTL Design Engineer, Machine Learning Accelerators USD 138K-198KASIC design | Code review | High Performance | High-Performance Design | Low powerMid-level Full TimeSunnyvale, CA, USA3h ago
-
C# | C++ | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA3h ago
-
Software Engineer III, AI/ML, Google Fi USD 147K-211KData Processing | Debugging | Distributed Systems | Java | Language ProcessingSenior-level Full TimeMountain View, CA, USA; San Francisco, …3h ago
-
Cloud & Data Engineer USD 83K-187KAWS | Azure | Big Data | CI/CD | Container Security401k savings plan | Disability insurance | Employee assistance program | Flexible vacation | Life insuranceEntry-level Full TimeLexington, MA, US6h ago
-
AI Solution Principal Systems Development Engineer USD 148K-222KCluster management | Containerization | GPU Computing | Generative AI | Hardware/Software Integration401k plan | Choice of medical coverage | Fitness reimbursement | Generous Time Off Programs | Team member discounts on Dell productsSenior-level Full TimeAustin, Texas, United States, United States14h ago
-
Lead Cloud Data Engineer USD 116K-155KAWS Glue | AWS IAM | AWS Lake Formation | Amazon Athena | Amazon AuroraDental insurance | Hybrid work | Life insurance | Medical insurance | Paid time offSenior-level Full TimeFL - Saint Petersburg - 880 …14h ago
-
AI Search | Azure AI | Azure AI Search | CI/CD | Chroma401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States14h ago
-
Junior Applied AI Engineer- HRIS USD 105K-140KAWS | Azure | Cloud Platforms | Cloud platform | Data Engineering401k | Dental insurance | Disability insurance | Leave Program | Life insuranceEntry-level Full TimeSunnyvale, CA, United States15h ago
-
API Security | AWS | Adversarial inputs | Agent Frameworks | Application SecurityCiti Bike membership | Flexible paid time off | Gym membership | Health and mental health services | Home office stipendSenior-level Full TimeSan Francisco, California, United States; Seattle, …15h ago
-
Applied AI ML, Senior Associate USD 171K-245KAgentic AI | Cloud services | Continuous integration | Data Analysis | Data PipelinesBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeHouston, TX, United States16h ago
-
APIs | Artificial Intelligence | Automation | Decision support | Generative AI401k | Cafe Amenities | Fitness Center | Health insurance | Recreational facilitiesEntry-level Full TimeBroomfield, CO, United States17h ago
-
Agentic AI | Data Analysis | Data Pipelines | Financial Data | Financial Data AnalysisBackup childcare | Financial coaching | Health care coverage | Mental health support | On Site Health Wellness CentersEntry-level Full TimeJersey City, NJ, United States17h ago
-
Applied AI Engineer (AI Adoption) USD 200K-250KAI Evaluation | Agent Design | Automation | LLM APIs | Machine LearningDental insurance | Group pension scheme | Income protection | Life assurance | Paid HolidaysMid-level Full TimeNew York, Chicago, London17h ago
-
Sr. Staff Embedded AI Engineer USD 165K-200KBare Metal | C# | C++ | CMSIS NN | Code generationEmployee resource groups | Flexible work environment | Hybrid schedule | Remote work optionSenior-level Full TimeColumbia, MARYLAND, United States17h ago
-
Senior Software Engineer, Robotics USD 141K-194KAlgorithms | C++ | CI/CD | Computer Vision | Constraint SatisfactionCompany holidays | Health insurance | Learning reimbursement | Life insurance | Long-term disabilitySenior-level Full TimeTorrance, California, United States17h ago
-
Senior Data Engineer USD 157K-218KAWS Athena | AWS EMR | AWS Glue | AWS Lambda | Amazon S3Beverages | Commuter stipend | Hybrid work schedule | Lunch stipend | Relocation stipendSenior-level Full TimeDenver, Colorado, United States; San Francisco, …17h ago
-
Principal Machine Learning Engineer USD 157K-223KA/B | A/B Testing | AI Agents | Airflow | B testingSenior-level Full TimeUS TX Austin17h ago