AWS Data Engineer
Tasks
- Apply IAM for secure data access
- Build analytics and reporting dashboards with Amazon QuickSight
- Build data lakes on S3
- Configure AWS Glue crawlers and Glue Data Catalog
- Create event driven transformations with AWS Lambda
- Design and optimize data warehouses with Amazon Redshift
- Design lakehouse architectures on S3
- Develop ETL pipelines using AWS Glue and PySpark
- Implement data quality and observability mechanisms
- Implement fine grained security with AWS Lake Formation
- Implement streaming and CDC ingestion using AWS DMS and Kinesis
- Integrate DynamoDB and SQS for event processing
- Optimize costs with S3 storage tiers and Redshift RA3 and Glue optimization
- Orchestrate data workflows with AWS Step Functions
- Query datasets using Amazon Athena
- Tune performance using distribution keys sort keys parallelism and compaction
- Write stored procedures and complex SQL
Perks/Benefits
- 401k matching
- Dental insurance
- Education assistance program
- Health insurance
- Holiday pay
- Identity theft protection
- Life insurance
- Long-term disability
- Paid time off
- Short-term disability
- Vision insurance
- Wellness resources
Skills/Tech-stack
AWS CloudFormation | AWS Data | AWS Data Migration | AWS Data Migration Service | AWS EMR | AWS Glue | AWS IAM | AWS Kinesis | AWS Lake Formation | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon QuickSight | Amazon Redshift | Amazon S3 | Amazon SQS | Amazon Web Services | CI/CD | Change Data Capture | Data Capture | Data Migration Service | Data Modeling | Data Observability | Data Partitioning | Data Quality | DynamoDB | ETL | Lake Formation | Lakehouse | PySpark | Python | SQL | Schema Design | Step Functions | Stored Procedures | Terraform | Web Services
Education
Roles
Related jobs
-
Click Through Rate | Click Through Rate Prediction | Conversion Rate | Conversion Rate Prediction | Data ModelingMid-level Full TimeSan Jose, California, United States2h ago
-
Forward Deployed Engineer, Generative AI, Google Cloud USD 183K-265KAccelerators | C++ | Cloud Architecture | Data Pipelines | Distributed TrainingTravelSenior-level Full TimeAddison, TX, USA; Washington D.C., DC, …3h ago
-
Software Engineer, BigQuery Managed Storage USD 147K-211KAlgorithms | BigQuery | Change Data Capture | Cloud Computing | Data CaptureMid-level Full TimeKirkland, WA, USA3h ago
-
C++ | Data Structures | Data structures algorithms | Debugging | Google CloudMid-level Full TimeSunnyvale, CA, USA3h ago
-
C++ | Data Processing | Data Storage | Debugging | Distributed ComputingSenior-level Full TimeMountain View, CA, USA3h ago
-
Forward Deployed Engineer, Applied AI, Google Cloud USD 127K-183KAPI | CRM | Cloud platform | Conversational AI | Conversational agentsHigh-impact role | Opportunity to lead technical delivery | Travel up to 50 percentMid-level Full TimeNew York, NY, USA; Atlanta, GA, …3h ago
-
Software Engineer, AI System Hacker, GenAI, DeepMind USD 174K-252KArtificial Intelligence | C++ | CSS | Data Visualization | Generative AIMid-level Full TimeMountain View, CA, USA3h ago
-
Agent systems | Agentic Workflows | Cloud platform | Cost Per Request | CrewAISenior-level Full TimeNew York, NY, USA; Addison, TX, …3h ago
-
Data engineer , Machine Learning USD 170K-240KApache Airflow | Apache Spark | Audio Data | Coverage monitoring | DagsterEmployee Assistance Program (EAP) | Employer matching 401k | Health, dental, vision insurance | Unlimited PTOMid-level Full TimeSan Francisco8h ago
-
Data Platform Engineer II USD 100K-113KAzure Data | Azure Data Factory | Azure Key Vault | Azure Managed | Azure Managed IdentitiesDental insurance | Disability insurance | Health insurance | Life insurance | Unlimited paid time offMid-level Full TimeNeedham, MA9h ago
-
Senior Data Engineer USD 160K-207KDBT | Data Architecture | Data Governance | Data Observability | Data Quality401k match | Dental insurance | Equity | Family planning resources | Flexible vacation daysSenior-level Full TimeRemote - USA R11h ago
-
Systems Engineer (Network / Storage / Systems) USD 335K-455KAutomation | Bash | Cause analysis | Cluster management | Configuration ManagementHybrid work model | Relocation assistanceSenior-level Full TimeSan Francisco11h ago
-
Machine Learning Engineer USD 138K-183KAWS | Airflow | Amazon Redshift | Amazon SageMaker | Apache Flink401k retirement savings | Health care insurance | Occasional travel for meetings | Paid parental leave | Paid sick timeMid-level Full TimeRemote - US R11h ago
-
Staff Data Engineer USD 160K-207KAnomaly Detection | DBT | Data Governance | Data Modeling | Data Quality401k match | Dental insurance | Family planning resources | Flexible vacation policy | Fully remoteSenior-level Full TimeRemote - USA R12h ago
-
Senior Software Engineer, Data Engineering USD 164K-227KAWS | AWS Glue | Amazon EMR | Amazon Redshift | Apache Airflow401k match | Backup Child Care | Backup elder care | Backup pet care | Chime days paid time offSenior-level Full TimeSan Francisco, CA, USA13h ago
-
Database Engineer USD 162K-203KAWS | Backup and Restore | C++ | Cost Optimization | Data WarehouseCommuter stipend | Generous PTO | Health, dental, vision coverage | Learning and development stipend | Retirement benefitsSenior-level Full TimeSan Francisco, CA; New York, NY14h ago
-
Sr Analyst, Data Engineer USD 76K-143KAPI Integration | AWS | Agile | Batch Processing | CI/CD401k match | Business Casual Attire | Dental insurance | Health insurance | Hybrid work optionSenior-level Full TimeOhio - Columbus, Three Nationwide Plaza, … R14h ago
-
Software Engineer - Voice AI (Inference Runtime) USD 165K-330KAPI Development | CLI Development | Docker | Kubernetes | Language Processing401k matching | Fertility and family building stipend | Flexible PTO | Medical, dental, and vision insurance | Paid parental leaveSenior-level Full TimeSan Francisco15h ago
-
AI Search | AWS | AWS Bedrock | Azure | Azure AI401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States15h ago
-
Full Stack Software Engineer, Applied AI USD 140K-140KAPI Design | Alerting | CI/CD | Cloud infrastructure | DevOpsFlexible PTO | Health insurance | Mental wellness days | Paid Holidays | Parental leaveMid-level Full TimeSan Francisco15h ago
-
Staff Machine Learning Engineer, Developer Platform USD 230K-322KA/B | A/B Testing | AWS | Automation | B testingCoaching benefits | Comprehensive healthcare benefits | Employer 401k match | Family planning support | Flexible vacationSenior-level Full TimeRemote - United States R15h ago
-
Autonomy and Robotics Software Engineer USD 125K-220KC++ | CI/CD | Classification | Computer Vision | Dataset versioningE-Verify enrollment | Health insurance | Professional development | Retirement plansMid-level Full TimeHuntington Beach16h ago
-
Senior Data Platform Engineer, Remote USD 142K-180KAWS | AWS Lambda | Access Control | Amazon Aurora | Amazon CloudWatch401k matching | Dental insurance | Flexible time off | Flexible work environment | Medical insuranceSenior-level Full TimeUnited States, UNITED STATES, United States R16h ago
-
Intern, Mission Optimization Engineer USD 70K-120KAgile | Bash | CI/CD | Datadog | DockerAccess to LinkedIn Learning | Commuter benefits | Internet reimbursement | Paid time offEntry-level InternshipSan Francisco, CA R16h ago
-
Autonomy and Robotics Software Engineer USD 125K-220KC++ | CI/CD | Embedded Systems | Fault detection | GNSSHealth insurance | Professional development | Retirement plansMid-level Full TimeHuntington Beach16h ago