AWS Data Engineer
Tasks
- Build data workflows with Apache Airflow
- Collaborate with version control using Git
- Create data models and source-to-target mappings
- Design AWS Redshift data warehouse
- Design ETL pipelines
- Develop AWS Glue jobs and crawlers
- Enable analytics consumption with QuickSight and SageMaker
- Ensure data quality with automated testing
- Implement IAM and CloudTrail governance
- Manage data in S3 and RDS
- Monitor and optimize EMR cluster performance
- Process and transform data with PySpark
- Support UAT and deployment activities
- Tune Redshift queries
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Data | AWS Data Modeling | AWS Glue | AWS Lambda | AWS Step Functions | Amazon EMR | Amazon Kinesis | Amazon QuickSight | Amazon RDS | Amazon Redshift | Amazon S3 | Amazon SageMaker | Apache Airflow | Automated testing | CloudTrail | Code Coverage | Data Modeling | Data Quality | Data Warehousing | Data pipeline | ETL | Git | IAM | PySpark | Python | SQL | Source-to-Target Mapping | Step Functions | Validation | Version control
Education
N/A
Roles
Related jobs
-
Sr. DevOps Engineer INR 2500K-3500KAIOps | AKS | ARM | Azure Container | Azure Container RegistryRotational on-call supportSenior-level Full TimeHyderabad, India8h ago
-
Database Engineer INR 1500K-2400KAWS RDS | Azure SQL | Backup and Recovery | Data Modeling | Data WarehousingSenior-level Full TimeIN-TN-Chennai9h ago
-
Database Engineer INR 1500K-2500KAWS RDS | Azure SQL | Azure SQL Database | Cassandra | Cloud DatabasesSenior-level Full TimeIN-TN-Chennai9h ago
-
Gen AI Developer INR 2000K-3000KAPI Integration | Claude API | Context Management | CrewAI | FastAPIMid-level Full TimeIN-MH-Pune9h ago
-
Senior-level Full TimeIN-TN-Chennai9h ago
-
Aws Etl INR 1500K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeIN-AP-Hyderabad9h ago
-
Aws Etl INR 1500K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeIN-AP-Hyderabad9h ago
-
Aws Etl INR 1500K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeIN-AP-Hyderabad9h ago
-
Senior-level Full TimeIndia10h ago
-
Azure | Azure Blob | Azure Blob Storage | Azure DevOps | Azure MLSenior-level Full Timebengaluru, India11h ago
-
Staff Software Engineer, Android Embedded Software INR 2000K-3200KAndroid | C++ | Distributed Systems | Java | Performance optimizationSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
DE&A - AWS - Data Engineer + Data Platform Support INR 3000K-4000KAmazon Bedrock | Amazon EC2 | Amazon EMR | Amazon S3 | Amazon SageMakerSenior-level Full TimePune, Maharashtra, India11h ago
-
Mid-level Full TimeMumbai, Maharashtra, India11h ago
-
Manager - Python with Gen AI INR 1800K-3000KAutogen | Claude | CrewAI | Data Pipelines | Event DrivenMid-level Full TimeBangalore, Karnataka, India15h ago
-
Lead Software Engineer - Big Data INR 2040K-3380KAmazon DynamoDB | Apache Avro | Apache Hive | Apache Kafka | Apache ParquetSenior-level Full TimeMumbai, Maharashtra, India15h ago
-
Mid-level Full TimeBangalore, Karnataka, India15h ago
-
Senior-level Full TimeBangalore, Karnataka, India15h ago
-
Assistant Manager - Forward Deployed Engineer / AI Engineer INR 1800K-2500KAgent-based | Agent-based frameworks | Autogen | Claude | Cloud ComputingMid-level Full TimeBangalore, Karnataka, India15h ago
-
Senior-level Full TimeHyderabad, India16h ago
-
Sr. Data Engineer INR 2800K-4000KCloud warehousing | DAX | Dashboard Design | Data Quality | Data StorytellingCommunity outreach programs | Employee Resource Group | Employee stock purchase program | Health and wellness incentivesSenior-level Full TimeBangalore, KA, IN, 56003716h ago
-
Senior-level Full TimeGurgaon, Haryana, India16h ago
-
Software Engineer INR 1000K-1496KBitbucket | Data Architecture | Data Modeling | Data Pipelines | LinuxEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India16h ago
-
Database Reliability/Automation Engineer INR 1000K-1820KAnsible | Bash | CI/CD | CloudFormation | DockerMid-level Full TimeIndia16h ago
-
Data Scientist- GenAI Engineer INR 2000K-3000KA/B | A/B Testing | B testing | Causal Inference | ClusteringMid-level Full TimeNoida, Uttar Pradesh, India16h ago
-
Applied AI ML Associate INR 2000K-3000KAI Agents | AWS Cloud | Advanced Analytics | Big Data | CI/CDSenior-level Full TimeHyderabad, Telangana, India16h ago