AWS Data Engineer
Tasks
- Automate provisioning with Infrastructure-as-Code
- Build and maintain data lakes on Amazon S3
- Build and maintain data warehouses on Redshift
- Build and optimize ETL and ELT pipelines
- Build transformation workflows with Spark
- Collaborate with stakeholders to understand data requirements
- Design scalable data architectures on AWS
- Develop real time and batch ingestion pipelines
- Enforce data privacy retention policies
- Implement AWS security best practices with IAM KMS VPC and Secrets Manager
- Implement CI/CD pipelines for data workflows
- Implement data quality checks and validation rules
- Maintain data governance compliance and audit readiness
- Manage database schemas partitioning compression and performance tuning
- Manage metadata cataloging and data lineage with AWS Glue Data Catalog
- Monitor pipelines and infrastructure with CloudWatch and CloudTrail
- Optimize data for analytics BI and ML
- Troubleshoot pipeline failures performance bottlenecks and data quality issues
Perks/Benefits
- Company holidays
- Employee assistance programs
- Life and disability insurance
- Medical, dental, and vision coverage
- Paid time off
- Retirement savings plan
Skills/Tech-stack
AWS Config | AWS Lambda | Amazon Web Services | Athena | CI/CD | CloudFormation | CloudTrail | CloudWatch | CodeBuild | CodePipeline | Data Quality | Data Validation | DynamoDB | ELT | EMR | ETL | GitHub Actions | Glue | IAM | Infrastructure as Code | Jenkins | KMS | Kafka | Kinesis | Networking | Python | Redshift | S3 | Scala | Secrets Manager | Snowflake | Spark | Terraform | VPC | Web Services | “as-code”
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Senior Machine Learning Engineer USD 229K-360KA/B | A/B Testing | Amazon S3 | Amazon SageMaker | Apache AirflowDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeSan Jose, California R1d ago
-
Senior Machine Learning Engineer, Search USD 361K-510KA/B | A/B Testing | Apache Airflow | Apache Spark | B testingCommuter benefits | Disability benefits | Equity awards | Health insurance | Life insuranceSenior-level Full TimeSan Jose, California R1d ago
-
Applied AI Architect, Strategic Enterprise Tech USD 240K-315KAPI Integration | Cloud Architecture | Data Science | Enterprise Integration | LLMFlexible work | Generous vacation | Parental leaveSenior-level Full TimeSan Francisco, CA | New York … R1d ago
-
Apache Flink | Apache Iceberg | Apache Spark | Avro | Concurrency401k match | ESPP | Family leave | Flexible time off | Flexible work scheduleSenior-level Full TimeSan Diego, CALIFORNIA, United States R1d ago
-
Senior Staff Data Platform Engineer - Data Access Team USD 201K-352KAlgorithms | CI/CD | Data Structures | Design Patterns | Distributed Systems401k match | ESPP | Family leave programs | Flexible spending accounts | Flexible time offSenior-level Full TimeSanta Clara, CALIFORNIA, United States R1d ago
-
Data Engineer – Databricks USD 152K-200KAWS | Apache Airflow | Azure | Azure Data | Azure Data FactoryContract-to-hire | Hybrid work onsite 3 days per weekSenior-level Contract Full TimeBeaverton, OR, United States R1d ago
-
Lead AI Engineer USD 120K-175KAWS | Agentic AI | Artificial Intelligence | Benchmarking | Data Preparation401k match | Background check required | Certification reimbursement | Health insurance | Maternity & paternity leaveSenior-level Full TimeSchenectady, New York, United States, Remote R1d ago
-
Senior Software Engineer - Machine Learning Platform USD 166K-230KAPIs | AWS | Automation | Backtesting | DBT401k matching | Annual productivity allowance | Employee assistance program | Employee stock purchase plan | Health, dental, and vision insuranceSenior-level Full TimeUnited States | Remote R1d ago
-
Senior Machine Learning Engineer, Agent Eval Platform USD 176K-308KData labeling | Distillation | Evaluation | Fine Tuning | Information RetrievalInclusive work environment | Remote work flexibilitySenior-level Full TimeSanta Clara, CALIFORNIA, United States R1d ago
-
Data Scientist - Foward Deployed Engineer USD 160K-170KAPIs | Agentic Workflows | Anomaly Detection | Context engineering | Experimentation401k | Employee assistance program | Health spending account | Life insurance | Long-term disabilityMid-level ContractPalo Alto, California, USA R1d ago
-
Data Engineer II USD 78K-117KCI/CD | Cortex AI | Data Lake | Data Warehouse | ETL401k retirement plan | Employee assistance program | Health savings account | Life insurance | Long-term disabilityMid-level Full TimeBaltimore, Maryland, USA R1d ago
-
Senior Machine Learning Engineer USD 176K-308KAlgorithms | Artificial Intelligence | Code Tuning | Code profiling | Design PatternsFlexible work persona | Remote work flexibilitySenior-level Full TimeWest Palm Beach, Florida, United States R1d ago
-
Data Engineer USD 101K-130KBI | DBT | Data Modeling | Data Monitoring | Data QualityHybrid work | On site 3 to 4 days per week | Self service analytics enablementMid-level Full TimeDallas, TX R1d ago
-
Fullstack AI Engineer USD 117K-147KAWS | Anthropic | CI/CD | Go | JavaScriptDental insurance | Flexible time off | Medical insurance | Paid parental leave | SabbaticalMid-level Full TimeUnited States (Remote-First) R1d ago
-
Staff+ Software Engineer, RL Data Platform USD 320K-405KAPI | Crowdsourcing | Data Modeling | Data pipeline | LLMFlexible working hours | Generous vacation | Hybrid work policy | Optional equity donation matching | Parental leaveSenior-level Full TimeSan Francisco, CA | New York … R1d ago
-
Staff+ Research Engineer, RL Data Platform USD 500K-850KData pipeline | LLM Evaluation | Latency optimization | Machine Learning | MonitoringFlexible working hours | Generous vacation | Hybrid work policy | Optional equity donation matching | Parental leaveSenior-level Full TimeSan Francisco, CA | New York … R1d ago
-
Analytics Engineer USD 95K-105KBigQuery | Cursor | DBT | Data Contracts | Data Governance401k | Anniversary Milestone Celebrations | Flexible PTO | HSA contribution | Home internet reimbursementMid-level Full TimeRemote, United States R1d ago
-
Staff Data Engineer USD 134K-175KAWS EMR | AWS Glue | AWS S3 | Agile | Apache Airflow401k matching | Dental insurance | Disability insurance | Employee assistance program | Employee referral programSenior-level Full TimeDenver, CO, USA R1d ago
-
Sr. Data Engineer (Hybrid - Addison, TX) USD 120K-150KAzure | Azure Data | Azure Data Factory | Data Cleansing | Data FactoryHybrid work schedule | Knowledge sharing culture | Onsite commute requirement 3 days per weekSenior-level Full TimeAddison, TX, United States R1d ago
-
BeeGFS | CI/CD | CUDA | Caching | CephSenior-level Full TimeSan Jose, CA / Austin, TX-%LABEL … R1d ago
-
Data Engineer II USD 150K-225KAmazon EKS | Amazon MSK | Amazon Web Services | Apache Flink | Apache Kafka401k match | Dental insurance | Employee discounts | Medical insurance | Paid time offMid-level Full TimeUnited States, Aliso Viejo, CA R2d ago
-
APIs | Access Control | Agentic Workflows | Cloud Computing | Context engineeringTravel opportunitiesSenior-level Full TimeUSA - Remote R2d ago
-
Apache Flink | Apache Iceberg | Apache Spark | Avro | Concurrency401k match | ESPP | Family leave | Flexible time away | Flexible-hybrid workSenior-level Full TimeSan Diego, CALIFORNIA, United States R2d ago
-
Senior Manager, AI Software Engineering USD 199K-235KAWS | Agile | Automated testing | CI/CD | Cloud Native401k match | Flexible time off | Hybrid work model | Medical insuranceSenior-level Full TimeNew York, NY R2d ago
-
API Integration | Access Control | Agent Packs | Agentic Workflows | Anthropic APICustomer facing delivery opportunities | Remote work | Travel 25 percentSenior-level Full TimeUSA - Remote R2d ago