Data Engineer
Tasks
- Analyze datasets to identify trends
- Build and optimize SQL queries
- Collaborate with product, engineering, and data science teams
- Define data contracts and schemas
- Design and build data enrichment pipelines
- Execute data governance with cataloging lineage tracking and schema design
- Implement observability and debugging
- Improve pipeline performance scalability and cost efficiency
- Maintain AWS data architectures
- Orchestrate data workflows with Airflow
- Run data quality validation and monitoring
- Troubleshoot data delivery issues
Perks/Benefits
Skills/Tech-stack
AWS | AWS Glue | Amazon Athena | Amazon S3 | Apache Airflow | Apache Spark | Data Governance | Data Modeling | Data Quality | ELT | ETL | GRPC | Java | Kafka | Monitoring | Observability | PySpark | Python | Query Optimization | REST API | SQL | Schema Design
Education
Roles
Related jobs
-
Ardoq | Bird | Collibra | Data Architecture | Data GovernanceSenior-level Full TimeRemote, India R19h ago
-
Associate Principal Engineer, Data Engineer (Enterprise Data Architect-Banking Domain) INR 1524K-2541KAgile | Ardoq | Bird | Collibra | Data ArchitectureMid-level Full TimeRemote, India R19h ago
-
ClickHouse | Cloud Native | Containerization | Data Integrity | Data PipelinesEmployee stock purchase programs | Equity opportunities | Flexible paid time off | Fully remote work | Generous parental leaveMid-level Full TimeIndia R1d ago
-
API | ClickHouse | Dashboards | Data Engineering | Data ModelingFlexible paid time off | Fully remote | Growth Funding | Health and wellbeing benefits | Learning resourcesMid-level Full TimeIndia R1d ago
-
Senior Data Engineer INR 3600K-4580KApache Airflow | Batch Processing | Billing integration | CRM Integration | DBTCommunity involvement | Employee wellbeing programs | Hybrid work | Remote work | Work-life balanceSenior-level Full TimeRemote (IND), India R1d ago
-
AWS | Autogen | Embedding Models | GenAI | GoSenior-level Full TimeBangalore - Carina, India R1d ago
-
Principal Data Engineer / Architect - Individual Contributor INR 3200K-4580KAI Agent framework | AWS | Agent Framework | Airbyte | AlertingSenior-level Full TimeBangalore, INDIA R1d ago
-
Senior Analytics Engineer (Contract) INR 3600K-5400KAmazon Redshift | Apache Airflow | CI/CD | DBT | DagsterSenior-level ContractIndia - Remote R1d ago
-
Senior Machine Learning Engineer INR 3584K-4580KAWS | Azure | CI/CD | Databricks | Distributed SystemsHybrid work model | Learning and development programs | Mentorship and coaching | Remote workSenior-level Full TimeBangalore, India R1d ago
-
Senior Machine Learning Engineer INR 3584K-4580KAWS | Azure | CI/CD | Cloud platform | DatabricksHybrid work model | Learning and development programs | Mentoring and coaching culture | Remote work opportunitySenior-level Full TimeBangalore, India R1d ago
-
Data Engineering / Sr. Associate Director, Software Engineering INR 1400K-2000KApache Airflow | Apache Beam | Auditability | Batch Processing | CI/CDMid-level Full TimeHyderabad, Telangana, India R1d ago
-
Ansible, Jira, Confluence, Hadoop / Consultant Specialist INR 800K-1700KAmazon S3 | Ansible | CI/CD | Confluence | DevSecOpsContinuous professional development | Flexible working | Inclusive work environment | Opportunities to growMid-level Full TimeHyderabad, Telangana, India R1d ago
-
Data Engineer - Global Team (India) INR 1500K-2500KApache Spark | Data Modeling | Databricks | Delta Lake | ETLLearning reimbursement | Parental leave | Team events | Vacation timeMid-level Full TimeIndia Remote R1d ago
-
Staff Engineer, AJO,RTCDP INR 2520K-3880KAPI Integration | Adobe Campaign | Adobe Campaign Classic | Adobe Campaign Classic v8 | Adobe ExperienceSenior-level Full TimeRemote, India R1d ago
-
APIs | Architecture development | BigQuery | Cloud Data | Cloud Data WarehouseCollaborative innovation culture | Continuous learning | Employee stock purchase plan | Equity compensation | Flexible paid time offSenior-level Full TimeIndia R1d ago
-
Intermediate Backend Engineer - Analytics Instrumentation INR 2000K-3370KAt-Scale | Backend Development | ClickHouse | Cloud Native | Data QualityEquity compensation | Flexible paid time off | Growth and development fund | Parental leave | Remote workMid-level Full TimeRemote, India R1d ago
-
API Design | AWS | Amazon SageMaker | Automated retraining | CI/CDAutonomy and ownership | Continuous learning | Fully remote | High-growth environment | Professional developmentSenior-level Full TimeIndia R1d ago
-
Databricks Solution Architect INR 2000K-3000KAWS | Azure | CI/CD | CloudWatch | Data GovernanceOn-site client work | Remote work flexibilitySenior-level Full TimeIndia - Remote R2d ago
-
Senior Consultant (Databricks) INR 2000K-2800KAmazon Web Services | Apache Airflow | Apache Spark | Azure | Azure DataSenior-level Full TimeIndia - Remote R2d ago
-
Senior Software Engineer, Data Platform INR 3419K-4200KApache Airflow | Apache Iceberg | Apache Kafka | Apache Pinot | Apache SparkAI tooling access | On-call rotationSenior-level Full TimeIndia Remote R2d ago
-
Machine Learning Engineer 2 INR 360K-420KArtificial Intelligence | C# | C++ | Computer Vision | Data AnalysisEntry-level Full TimeBangalore, India R2d ago
-
Senior DevOps Engineer - E-commerce INR 3000K-4000KAPI Gateway | AWS | AWS Lambda | Akamai | Amazon ECSHybrid workSenior-level Full TimeIndia, Pune R2d ago
-
Data Engineering Operations Lead INR 3000K-4000KApache Airflow | Apache Hive | Apache Spark | Batch Processing | CI/CDContributory pension | Diversity forums | Hybrid work | Mindfulness app access | Networking groupsSenior-level Full TimePune, India R2d ago
-
DevOps Engineer II INR 3000K-4000KAnsible | Argo CD | ArgoCD | Bash | CI/CDEducation reimbursement | Employee referral program | Hybrid remote flexible hours | Life and accidental insurance | Maternity and parental leaveSenior-level Full TimeBengaluru, Karnataka, India - Remote R2d ago
-
Data Engineer - AWS Glue INR 1500K-2500KAWS Glue | Amazon Athena | Amazon Redshift | Amazon S3 | Apache AirflowCounseling sessions | Health and family insurance | Hybrid work mode | Maternity leave | Meditation sessionsMid-level Full TimeGurgaon R2d ago