Data Engineer
Tasks
- Build and optimize ETL pipelines
- Design data solutions
- Develop data pipelines
- Document code for team handover
- Implement ETL processes
- Integrate AWS native services for data processing
- Migrate data across systems
- Monitor and troubleshoot pipelines
- Optimize pipelines for cost and scalability
- Validate data quality
Perks/Benefits
- N/A
Skills/Tech-stack
AWS CloudWatch | AWS Glue | AWS Lambda | AWS Step Functions | Amazon EventBridge | Astronomer | Data Pipeline Architecture | Data Warehousing | Data pipeline | ETL | Iceberg | Pipeline architecture | PySpark | SQL | Step Functions | Unix
Education
N/A
Roles
Related jobs
-
Senior-level Full TimeGurugram, Haryana, India5h ago
-
Senior-level Full TimeIN-TN-Chennai5h ago
-
Senior-level Full TimeIN-AP-Hyderabad5h ago
-
Associate - Data Scientist INR 1500K-2500KAmazon Web Services | Apache Spark | Artificial neural networks | Chunking | DatabricksMid-level Full TimeGurugram, Haryana, India7h ago
-
Assistant Manager INR 1500K-2200KACID | Azure Cloud | Azure Data | Azure Data Factory | CI/CDWork from office 5 daysMid-level Full TimeBengaluru, Karnataka, India7h ago
-
Azure Data Engineer INR 1500K-2500KAzure Cloud | Azure Cloud Platform | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeHyderabad, Telangana, India7h ago
-
Staff Data Engineer (HPC cluster software such as Slurm, NC, LSF or Grid Engine) experience with 9 to 13 years INR 1500K-3000KAnsible | Docker | Grid Engine | Infiniband | IsilonSenior-level Full TimeBengaluru, KA, India8h ago
-
Senior Software Engineer _Cloud Developer INR 3715K-5000KAPI Development | API Integration | AWS Glue | AWS Lambda | AWS Step FunctionsEqual opportunity | Inclusive culture | On-call rotationSenior-level Full TimeHyderabad, India8h ago
-
Data & Analytics Engineer - AM INR 1500K-2700KApache Spark | Data Modeling | Data Warehousing | Databricks | Delta LakeSenior-level Full TimeBangalore, Karnataka, India8h ago
-
Senior Artificial Intelligence/Machine Learning Engineer INR 2500K-4800KAWS | Agent Frameworks | Agent systems | Autogen | CI/CDCompany-paid certifications | Financial consultations | Language courses | Legal consultations | Medical insuranceSenior-level Full TimeIndia8h ago
-
Lead Software Engineer Java INR 2500K-4000KAPI Gateway | AWS Glue | AWS Lambda | AWS OpenSearch | AWS SageMakerSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Data and Analytics Engineer , Enablement INR 3000K-4000KApache Spark | Azure Data | Azure Data Platform | CI/CD | Data AnalysisDocumentation enablement content creation | Mentoring and onboarding supportSenior-level Full TimeMumbai, Maharashtra, India9h ago
-
Data and Analytics Engineer , Enablement INR 3000K-4000KAgile | Apache Spark | Data Governance | Data Modeling | Data VisualizationSenior-level Full TimeMumbai, Maharashtra, India9h ago
-
Data and Analytics Engineer , Enablement INR 3000K-4000KAgile | Apache Spark | Azure Data | Azure Data Platform | CI/CDSenior-level Full TimeMumbai, Maharashtra, India9h ago
-
Data and Analytics Engineer , Enablement INR 3000K-4000KCI/CD | Data Analysis | Data Modeling | Databricks | Exploratory Data AnalysisMid-level Full TimeMumbai, Maharashtra, India9h ago
-
Software Engineer III - Data Lake INR 2000K-3100KAWS | AWS Glue | Agile methodologies | Amazon S3 | Apache CassandraSenior-level Full TimeHyderabad, Telangana, India11h ago
-
Staff Software Engineer - Database Engineering INR 2771K-4064KAmazon Aurora | Ansible | Cassandra | Citus | Configuration ManagementSenior-level Full TimeBangalore, India R11h ago
-
GCP Data Engineering Bangalore INR 2800K-4000KApache Spark | Cloud platform | ETL | Google Cloud | Google Cloud PlatformSenior-level Full TimeBangalore, Karnataka, India11h ago
-
Senior-level Full TimeBengaluru, KA, India11h ago
-
Snowflake & DBT Expert INR 1500K-2500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | CI/CDSenior-level Full TimeNoida, UTTAR PRADESH, India11h ago
-
Software Engineer III INR 2500K-4200KAWS CloudFormation | AWS Glue | AWS IAM | AWS Lambda | Amazon AthenaAgile team collaboration | Automated testing and code review support | Secure and stable engineering environmentSenior-level Full TimeHyderabad, Telangana, India11h ago
-
Senior-level Full TimeBangalore12h ago
-
Mid-level Full TimeIndia, Telangana, Hyderabad12h ago
-
GCP Data Engineer Lead INR 2000K-2500KApache Airflow | BigQuery | CI/CD | Cloud Composer | Cloud FunctionsSenior-level Full TimeHyderabad, //TS, India12h ago
-
Access Control | Apache Airflow | Auditability | Azure | Change Data CaptureCollaborative environment | Documentation and architecture diagram creation support | Flexible contract engagement | Fully remote | Knowledge sharing cultureSenior-level Contract Full TimeIndia R14h ago