Data Engineer (Python, Spark)
APAC - India - Bengaluru - Sunriver
INR 1500K-2500K (estimate) Mid-level Full Time
Tasks
- Architect scalable data systems
- Collaborate with stakeholders to gather requirements
- Design, build, and maintain data pipelines
- Develop ETL and ELT workflows
- Enable analytics and product insights
- Ensure pipeline reliability resiliency and scalability
- Improve data quality reliability and observability
- Ingest transform and serve data for analytics
- Migrate Hive to Iceberg
- Modernize legacy data workflows
Perks/Benefits
- N/A
Skills/Tech-stack
AWS EMR | Amazon Web Services | Apache Airflow | Apache Flink | Apache Hive | Apache Spark | Apache Zeppelin | Azure | CI/CD | Cloud platform | Data Modeling | Data Monitoring | Data Observability | Data Pipelines | Data Processing | ELT | ETL | Git | Google Cloud | Google Cloud Platform | Iceberg | Jenkins | Jupyter | Looker | Power BI | Presto | Python | SQL | Snowflake | Streaming Data | Streaming data processing | Web Services
Education
Roles
Related jobs
-
Sr Specialist, Data Engineering INR 2400K-3380KApache Airflow | CI/CD | Cloud Build | Cloud Storage | Cloud platformRelocation assistance within countrySenior-level Full TimeMumbai, MH, IN1h ago
-
Sr Specialist, Data Engineering INR 2400K-3380KApache Airflow | CI/CD | Cloud Build | Cloud Storage | Cloud platformRelocation assistanceSenior-level Full TimeMumbai, MH, IN1h ago
-
API Development | AWS | Airflow | Azure | Data ModelingCareer growth | Continuous learning | Flexible work environment | Inclusive culture | Professional developmentSenior-level Full TimeIndia3h ago
-
GCP Data Engineer Lead INR 1500K-2500KApache Airflow | BigQuery | CI/CD | Cloud Composer | Cloud FunctionsSenior-level Full TimeHyderabad, TS, India4h ago
-
Staff Machine Learning Engineer L5 INR 2520K-3500KAWS | Algorithms | Apache Airflow | Azure | Data StructuresSenior-level Full TimeGurugram, India8h ago
-
Principal AI Engineer INR 2000K-4500KAPI Integration | AWS Bedrock | Agent Orchestration | CI/CD | Deep learningSenior-level Full TimeBangalore, KA, IN9h ago
-
Staff LiDAR Algorithms Engineer INR 2500K-4500K3D Geometry | ASPICE | C++ | Calibration | Cloud processingSenior-level Full TimeBangalore16h ago
-
Data Product Services Analytics Engineer - India INR 2500K-4000KAmazon Redshift | Apache Airflow | BigQuery | Confluence | DBTRemote work flexibility | Training supportMid-level Full TimeIndia R17h ago
-
Mid-level Full TimeBengaluru, KA, India18h ago
-
AI Engineer / AI Developer INR 1800K-3300KAI Agents | Alerting | Amazon SQS | Async Programming | CI/CDSenior-level Full TimeBangalore, India Office (BANGALORE) R18h ago
-
Mid-level Full TimeBangalore, India Office (BANGALORE) R19h ago
-
AI Engineer – Python & Snowflake INR 1800K-2700KAPI Development | AWS | Airflow | Azure | Data ModelingMid-level Full TimeHyderabad, Hyderabad, IN19h ago
-
Senior AI Engineer (Full-Stack) (Remote) INR 2500K-5000KAWS | Active Directory | Anthropic | ArcGIS REST | ArcGIS REST APIClient facing ownership | Remote workSenior-level Full TimeMaharashtra, Pune, India R19h ago
-
Staff Artificial Intelligence & Machine Learning Engineer INR 2500K-4500KAPIs | Agentic Workflows | Chunking | Compliance | Cost OptimizationSenior-level Full TimeBengaluru, KA, India19h ago
-
Senior Database Engineer - #3180 (Remote) INR 1500K-2700KAWS CDK | AWS IAM | AWS KMS | Amazon Aurora | Amazon CloudFormationSenior-level Full TimeChennai, India R19h ago
-
Lead AI Software Engineer INR 2000K-4500KAI Agents | AWS | Azure | CI/CD | Cloud platformCareer growth | Career growth in technology domain | Continuous learningSenior-level Full TimePune City, India20h ago
-
GCP Data Engineer INR 1500K-2500KAirflow | BigQuery | Cloud Composer | Cloud Functions | Cloud platformSenior-level Full TimeIndia - Pune20h ago
-
Entry-level Full TimeCoimbatore, India20h ago
-
Senior-level Full TimeHyderabad, India20h ago
-
Entry-level Full TimeCoimbatore, India20h ago
-
Senior-level Full TimeIN-HR-Gurgaon20h ago
-
Senior-level Full TimeIN-KA-Bangalore20h ago
-
Senior Engineer - Embedded QA INR 1500K-2094KAgile | CI/CD | Continuous Deployment | Continuous integration | Data Driven TestingSenior-level Full TimeHadapsar, Pune, Maharashtra, IND, 411013 R21h ago
-
APIs | Automation | BigQuery | Data Architecture | Data LineageAutonomy | Flexible work environment | Inclusive innovation driven environment | Learning and growth opportunities | Strong ownership cultureSenior-level Full TimeIndia21h ago
-
Senior-level Full TimeBengaluru, Karnataka, India22h ago