Data Engineer
Tasks
- Design data pipelines
- Document code for team handover
- Ensure data quality validation
- Extract transform load data
- Implement ETL pipelines
- Implement incremental loads
- Migrate data to AWS
- Monitor and troubleshoot pipelines
- Optimize pipeline performance
Perks/Benefits
- N/A
Skills/Tech-stack
AWS CloudWatch | AWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon EventBridge | Apache Iceberg | Apache Spark | Astronomer | Data Warehousing | ETL | PySpark | SQL | Step Functions | Unix
Education
N/A
Roles
Related jobs
-
Software Engineer II - Big Data (ETL) / DevOps Engineer + AWS INR 1500K-2500KAWS | Agent Frameworks | Apache Spark | Athena | AuroraMid-level Full TimeBengaluru, Karnataka, India3h ago
-
Analyst-Data Science INR 2771K-4064KActive Learning | Algorithms | Apache Hive | Apache Spark | Bayesian MethodsEntry-level Full TimeGurugram, HR, India5h ago
-
Data Engineer (LBC) INR 1500K-2500KBusiness Intelligence | DAX | Data Analysis | Data Catalog | Data QualitySenior-level Full TimePune, IN5h ago
-
GCP Data Engineer INR 1500K-2000KAnsible | Cloud Bigtable | Cloud SQL | Cloud Spanner | Cloud platformProfessional growthMid-level Full TimeBengaluru, Pune6h ago
-
Software Engineer III - Java & Databricks INR 2200K-3500KAgile | Amazon Web Services | Angular | Application Resiliency | C#Senior-level Full TimeHyderabad, Telangana, India7h ago
-
AI Specialist (Technical) INR 1860K-3465KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksMid-level Full TimeGurugram, HR, IN7h ago
-
Applied AI ML Associate Senior-Data Engineer INR 1000K-1800KApache Spark | CI/CD | Data Governance | Data Lineage | Data ModelingMid-level Full TimeBengaluru, Karnataka, India8h ago
-
AWS | AWS Machine Learning | Agent systems | Angular | AutogenSenior-level Full TimeChennai, TN, IN, 60003212h ago
-
AI Engineering INR 3584K-5000KAgentic Workflows | Audit Logging | Authentication | Authorization | CI/CDSenior-level Full TimeBangalore, KA, IN12h ago
-
Sr. Power BI Engineer - (SSRS & PySpark) INR 1632K-2500KPower BI | PySpark | SQL | SQL Server | SSRSSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
Mid-level Full TimeBlock 1 DT, Chennai India12h ago
-
Senior-level Full TimeChennai, IN12h ago
-
Engineer Data Platform INR 1300K-2000KAPI Gateway | AWS CDK | AWS CloudFormation | AWS Identity | AWS Identity and Access ManagementFlexible work environment | Internal mobility | Volunteering opportunities | Welcoming and inclusive environment | Well-being supportMid-level Full TimeKA Bangalore, India12h ago
-
Senior Data Engineer INR 3600K-4995KAmazon Redshift | Amazon Web Services | Apache Airflow | Batch Processing | DBTSenior-level Full TimeIndia R18h ago
-
Test Lead - Data Automation INR 1500K-2500KCase design | ETL | Manual Testing | Python | Regression testingSenior-level Full TimeIndia2d ago
-
Staff Engineer (Snowflake, Apache Kafka, Oracle, AWS Lambda) INR 1500K-2500KAWS EC2 | AWS IAM | AWS Lambda | AWS VPC | Access ManagementSenior-level Full TimeGurugram, India2d ago
-
Senior Software Engineer, Machine Learning INR 3264K-5400KA/B | A/B Testing | Aerospike | B testing | Bayesian analysisCommuter benefits | Dental insurance | Disability insurance | Financial wellness support | Flexible remote workSenior-level Full TimeBengaluru, India2d ago
-
Mid-level Full TimePune, India2d ago
-
Senior Software Engineer INR 2000K-2700KAgile | Cloud services | Code review | Data Modeling | Data WarehousingSenior-level Full TimePune, India2d ago
-
Senior Data Engineer INR 3000K-4000KApache Spark | Batch Processing | DAX | Data Ingestion | Data ModelingFinancial consultations | Language courses | Legal consultations | Medical insurance | Mental health supportSenior-level Full TimeIndia2d ago
-
Manager Data and Analytics INR 1400K-2000KAmazon Redshift | Azure | BigQuery | Business Intelligence | Cloud platformMid-level Full TimeBangalore, Karnataka, India R2d ago
-
Senior AI Engineer INR 3242K-4680KAWS EC2 | AWS ECS | AWS Lambda | AWS RDS | Amazon S3Financial consultation | Legal consultation | Medical insurance | Mental health support | Paid certificationsSenior-level Full TimeIndia2d ago
-
Senior Java Kafka Architect INR 2000K-2700KAmazon Web Services | Apache Kafka | CI/CD | Code Refactoring | Code reviewSenior-level Full TimeIN-AP-Hyderabad3d ago
-
Senior-level Full TimeIN-TN-Chennai3d ago
-
Data Engineer INR 2000K-3000KAPI Design | Asynchronous programming | Caching | Celery | Clean architectureSenior-level Full TimeIN-KA-Bangalore3d ago