Data Engineer
Tasks
- Build data extraction using Lambda
- Design data pipelines
- Develop AWS Glue jobs
- Develop PySpark transformations
- Document code
- Implement ETL processes
- Manage incremental loads
- Monitor pipelines with CloudWatch
- Orchestrate workflows with Step Functions
- Troubleshoot and optimize data workflows
- Use EventBridge for event triggers
- Validate data quality
- Write SQL scripts
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS Lambda | AWS Step Functions | Amazon CloudWatch | Amazon EventBridge | Apache Iceberg | Data Pipeline Architecture | Data Quality | Data Quality Validation | Data Warehousing | Data pipeline | ETL | Pipeline architecture | PySpark | Quality validation | SQL | Step Functions | Unix
Education
N/A
Roles
Related jobs
-
Database Engineer INR 1500K-2400KAWS RDS | Azure SQL | Backup and Recovery | Data Modeling | Data WarehousingSenior-level Full TimeIN-TN-Chennai4h ago
-
Database Engineer INR 1500K-2500KAWS RDS | Azure SQL | Azure SQL Database | Cassandra | Cloud DatabasesSenior-level Full TimeIN-TN-Chennai4h ago
-
Senior-level Full TimeIN-TN-Chennai4h ago
-
Aws Etl INR 1500K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeIN-AP-Hyderabad4h ago
-
Aws Etl INR 1500K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeIN-AP-Hyderabad4h ago
-
Aws Etl INR 1500K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeIN-AP-Hyderabad4h ago
-
Senior-level Full TimeIndia5h ago
-
Azure | Azure Blob | Azure Blob Storage | Azure DevOps | Azure MLSenior-level Full Timebengaluru, India6h ago
-
DE&A - AWS - Data Engineer + Data Platform Support INR 3000K-4000KAmazon Bedrock | Amazon EC2 | Amazon EMR | Amazon S3 | Amazon SageMakerSenior-level Full TimePune, Maharashtra, India6h ago
-
Mid-level Full TimeMumbai, Maharashtra, India6h ago
-
Lead Software Engineer - Big Data INR 2040K-3380KAmazon DynamoDB | Apache Avro | Apache Hive | Apache Kafka | Apache ParquetSenior-level Full TimeMumbai, Maharashtra, India10h ago
-
Sr. Data Engineer INR 2800K-4000KCloud warehousing | DAX | Dashboard Design | Data Quality | Data StorytellingCommunity outreach programs | Employee Resource Group | Employee stock purchase program | Health and wellness incentivesSenior-level Full TimeBangalore, KA, IN, 56003711h ago
-
Senior-level Full TimeGurgaon, Haryana, India11h ago
-
Software Engineer INR 1000K-1496KBitbucket | Data Architecture | Data Modeling | Data Pipelines | LinuxEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India11h ago
-
Analytics Solutions Associate - Data Strategy INR 800K-1250KAWS Databricks | AWS Redshift | Data Governance | Data Privacy | Data QualityMid-level Full TimeBengaluru, Karnataka, India12h ago
-
Senior AI Engineer- Consultant INR 3000K-4800KAgent Orchestration | Agentic AI | Azure | Classification | ClusteringCareer advancement opportunities | Collaborative work culture | Continuous learning | Inclusive workplaceSenior-level Full TimeBangalore, Karnataka, India12h ago
-
GIS Data Engineer II INR 2000K-2400KAWS | Amazon Athena | Amazon EC2 | Amazon RDS | Amazon S3MentorshipSenior-level Full TimeMumbai, MH, India13h ago
-
AI Software Engineer INR 1753K-2600KAWS | Agent/tool use | Apache Spark | Azure | ContainersContinuing education program | Continuous learning | Family-friendly perks | Financial wellness programs | Flexible time offEntry-level Full TimeIN - HYDERABAD ORION, India17h ago
-
Apache Spark | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeNoida, India17h ago
-
IN_Manager_SSIS_Data & Analytics_Advisory_Noida INR 1500K-2000KAWS | Azure | CI/CD | Cloud Data | Cloud Data PlatformsFlexibility programmes | Inclusive benefits | MentorshipMid-level Full TimeNoida, India17h ago
-
EY - GDS Consulting - AI And DATA -Snowflake Architect -Manager INR 3000K-4000KAgile | Batch Processing | Cloud Data | Cloud Data Warehouse | DBTCareer development | Coaching and feedback | Flexible work arrangementSenior-level Full TimeHyderabad, TG, IN, 50008117h ago
-
AI Software Engineer INR 1753K-2600KAWS | Agentic AI | Azure | CI/CD | Code reviewContinuing education program | Continuous learning | Family-friendly perks | Financial wellness programs | Flexible time offEntry-level Full TimeIN - HYDERABAD ORION, India17h ago
-
Senior Data Engineer II INR 2800K-4000KAWS | Airflow | CDC | CI/CD | Control-MComprehensive benefits package | Flexible workingSenior-level Full TimeFIL Bengaluru Office, India17h ago
-
AI Developer INR 2200K-2700KAI | APIs | Agile | Automated testing | C#Diversity and inclusion | Hybrid workMid-level Full Timehyderabad, India17h ago
-
Sr. Data Engineer, Analytics Engineering INR 3000K-4000KAirflow | Data Governance | Data Modeling | Data Pipelines | Data QualitySenior-level Full TimeMumbai, India17h ago