AWS Data Engineer
Tasks
- Build data workflows with Apache Airflow
- Collaborate with version control using Git
- Create data models and source-to-target mappings
- Design AWS Redshift data warehouse
- Design ETL pipelines
- Develop AWS Glue jobs and crawlers
- Enable analytics consumption with QuickSight and SageMaker
- Ensure data quality with automated testing
- Implement IAM and CloudTrail governance
- Manage data in S3 and RDS
- Monitor and optimize EMR cluster performance
- Process and transform data with PySpark
- Support UAT and deployment activities
- Tune Redshift queries
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Data | AWS Data Modeling | AWS Glue | AWS Lambda | AWS Step Functions | Amazon EMR | Amazon Kinesis | Amazon QuickSight | Amazon RDS | Amazon Redshift | Amazon S3 | Amazon SageMaker | Apache Airflow | Automated testing | CloudTrail | Code Coverage | Data Modeling | Data Quality | Data Warehousing | Data pipeline | ETL | Git | IAM | PySpark | Python | SQL | Source-to-Target Mapping | Step Functions | Validation | Version control
Education
N/A
Roles
Related jobs
-
Senior-level Full TimePune City, India8h ago
-
Senior-level Full TimePune, Maharashtra, India8h ago
-
Data Engineer - Python AWS Databricks INR 1200K-2000KAWS | Agentic AI | Amazon Web Services | Cost Optimization | Data ArchitectureSenior-level Full TimeIN-MH-Pune8h ago
-
Abinitio Developer INR 1600K-2500KAbinitio | Abinitio Batch Graphs | Automated testing | Conduct>It | Continuous GraphsSenior-level Full TimeIN-KA-Bangalore8h ago
-
Senior Data Engineer INR 2000K-2400KAWS Glue | Amazon Redshift | Amazon S3 | Apache Airflow | Apache SparkSenior-level Full TimeHyderabad, Hyderabad, IN8h ago
-
Practice Customer Engineer, Data Analytics INR 1200K-2000KApache Spark | Batch Processing | C++ | Cloud platform | DNSSenior-level Full TimeBengaluru, Karnataka, India; Mumbai, Maharashtra, India10h ago
-
Practice Customer Engineer, Data Analytics INR 1200K-2000KApache Spark | C++ | DMZ | DNS | Data LakeEqual opportunity work environment | Travel as requiredSenior-level Full TimeMumbai, Maharashtra, India; Bengaluru, Karnataka, India10h ago
-
Senior-level Full Timebengaluru, India11h ago
-
Consultant - Python Developer with Gen AI INR 1500K-2000KAI Search | Agile | Azure OpenAI | CSS | DjangoMid-level Full TimeBangalore, Karnataka, India11h ago
-
Assistant Manager- AI Engineer with Cloude INR 2000K-3000KAWS | Autogen | Azure | Claude | Cloud platformLeadership opportunity | MentorshipMid-level Full TimeBangalore, Karnataka, India11h ago
-
AWS Data Engineer- Assistant Manager INR 1200K-2000KAWS Data | AWS Data Pipeline | AWS Glue | AWS Kinesis | AWS Lake FormationSenior-level Full TimeBangalore, Karnataka, India11h ago
-
GCP & Databricks Manager INR 1500K-2000KApache Spark | BigQuery | Bitbucket | Cloud Composer | Cloud DataflowMid-level Full TimeBangalore, Karnataka, India11h ago
-
Data Engineering Professional INR 2000K-2146KAgile methodologies | Artificial Intelligence | Cloud Computing | Data Engineering | Data ManagementSenior-level Full TimeBengaluru, IN, 56010312h ago
-
Staff Engineer, Data Analytics Engineering INR 3000K-3380KAI Engineering | AWS | Azure | Azure Data | Azure Data LakeSenior-level Full TimeBengaluru, KA, India12h ago
-
Principal Engineer, Data Analytics Engineering INR 2500K-3900KAI Governance | API | Agent Orchestration | Agentic Workflows | ComplianceSenior-level Full TimeBengaluru, KA, India12h ago
-
Sr Data Engineering - GCP INR 1500K-2040KAccess Control | Analytics engineering | BigQuery | CI/CD | Cloud RunSenior-level Full TimeHyderabad, TS, India12h ago
-
Senior-level Full TimeHyderabad, TS, India12h ago
-
Senior Data Engineering (GCP) INR 2000K-2040KAccess Control | Anomaly Detection | BigQuery | CI/CD | Cloud RunSenior-level Full TimeHyderabad, TS, India13h ago
-
Azure AI | Containerization | DevOps | GenAI | GoHybrid workSenior-level Full TimeBengaluru, INDIA, India13h ago
-
AWS DevOps Engineer INR 2500K-2829KAWS CDK | Amazon CloudWatch | Amazon EKS | Amazon Web Services | Argo CDSenior-level Full TimeHyderabad, India13h ago
-
AWS DevOps Lead Engineer INR 2500K-2829KAI Copilot | AWS Cloud | AWS Cloud Development Kit | AWS CloudWatch | AWS IdentityDevelopment opportunities | Recognition programs | Reward and recognition | Volunteering opportunities | Wellness programsSenior-level Full TimeHyderabad, India13h ago
-
Senior Data Engineer INR 2516K-2829KAirflow | Apache Spark | Azure | Azure Data | Azure Data LakeEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India14h ago
-
Data Engineer INR 938K-1200KAzure Data | Azure Data Factory | Azure Databricks | Data Factory | ETLEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India14h ago
-
Software Engineer + Gen AI (Fresher) INR 300K-540KAI Model Integration | AI model | API Integration | Algorithms | Data StructuresEntry-level Full TimePune, MH, India14h ago
-
Senior Specialist, Data Analyst & BI INR 2520K-3380KAgile | CD pipelines | CI/CD | CI/CD pipelines | Data ModelingPaid leave | Paid volunteer timeSenior-level Full TimePune, MH, India15h ago