Data Engineer (Python, Spark)
APAC - India - Bengaluru - Sunriver
INR 1500K-2000K (estimate) Mid-level Full Time
Tasks
- Architect scalable data systems
- Build ETL ELT workflows for analytics
- Collaborate with stakeholders to define data needs
- Design, build, and maintain data pipelines
- Ensure data quality, reliability, and observability
- Improve data pipeline reliability and scalability
- Ingest transform and serve data for analytics
- Migrate Hive to Iceberg
- Modernize legacy data workflows
- Monitor and improve data processing performance
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Airflow | Apache Flink | Apache Hive | Apache Spark | Apache Zeppelin | CI/CD | Cloud Data | Cloud Data Architecture | Data Architecture | Data Mining | Data Modelling | Data Observability | ELT | EMR Notebooks | ETL | Git | Iceberg | Jenkins | Jupyter | Looker | Notebook Solutions | Power BI | Presto | Python | SQL | Snowflake | Streaming
Education
Roles
Related jobs
-
Principal Consultant-Manager, GenAI Engineer (Cloud: GCP) INR 2520K-3380KAgent Development | Agent Development Kit | Agent systems | Artificial Intelligence | Automated testingContinuous learning opportunities | MentorshipSenior-level Full TimeIndia-Hyderabad6h ago
-
Senior-level Full TimeIN-AP-Hyderabad6h ago
-
Senior-level Full TimeIN-MH-Pune6h ago
-
Lead-Affluent BIU & Analytics-AFFLUENT-Program & MIS INR 1960K-2600KA/B | A/B Testing | B testing | Clustering | Data GovernanceSenior-level Full TimeMumbai, Maharashtra, India6h ago
-
Developer, Data Analytics INR 1200K-1968KBigQuery | Cloud Composer | Cloud Storage | Cloud platform | Data WarehousingHybrid workSenior-level Full TimeIndia-Telangana-Hyderabad6h ago
-
Senior Data Engineer INR 1300K-2000KBigQuery | Cloud Composer | Cloud Storage | Cloud platform | Data WarehousingHybrid workSenior-level Full TimeIndia-Telangana-Hyderabad6h ago
-
Software Engineer III Data Engineer-Python, AWS INR 2050K-3500KAWS | CI/CD | Databricks | ETL | PySparkSenior-level Full TimeBengaluru, Karnataka, India7h ago
-
Team Member-Analytics-SUPPORT SERVICES-HR - CoE INR 400K-700KANOVA | Data Modeling | Data Visualization | Excel | Hypothesis TestingSenior-level Full TimeMumbai, Maharashtra, India7h ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Dashboards | Data CleansingSenior-level Full TimeBengaluru, Karnataka, India7h ago
-
Algorithms | Artificial Intelligence | BigQuery | Cloud Storage | Cloud platform24x7 support rotation | Non-standard hours | On-call workMid-level Full TimeBengaluru, Karnataka, India; Pune, Maharashtra, India8h ago
-
Senior Software Engineer, Silicon Infrastructure and Engineering INR 1500K-2300KAlgorithms | Business Intelligence | Dashboards | Data Structures | Data VisualizationSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
Agentic AI Developer INR 2500K-2800KAPI Development | AWS | Azure | Deep learning | Deployment PipelinesMid-level Full Timepune, Maharastra, India8h ago
-
Senior-level Full TimeBengaluru, Karnataka, India8h ago
-
Software Engineer INR 316K-316KAzure Data | Azure Data Factory | Azure Synapse | Composite Models | DAXEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India8h ago
-
Cloud Engineer INR 750K-1000KAWS Lambda | Access Control | Access Control List | Amazon Web Services | Apache TomcatEnhanced medical benefits | Family well-being benefits | Health Safety and Wellbeing | Paid time off | Wellbeing benefitsMid-level Full TimeHyderabad, India8h ago
-
Analytics Solution Senior Associate INR 2000K-3380KAWS Glue | AWS Lambda | Agile methodologies | Data Governance | Data IngestionContinuous improvement | Inclusive work environment | TeamworkSenior-level Full TimeMumbai, Maharashtra, India8h ago
-
Senior Data Engineer INR 1200K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Alerting | Amazon EMRSenior-level Full TimeHyderabad, IN9h ago
-
Data Analytics - Power BI - ETL INR 1628K-2040KAzure Data | Azure Data Factory | DAX | Data Factory | Data ModelingSenior-level Full Time Part Timetelengana, India9h ago
-
Azure Data Engineer INR 1500K-2000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Functions | Azure SynapseMid-level Full TimeChennai, Tamil Nadu, India10h ago
-
AI/ML enhanced control engineering INR 2500K-3100KAdaptive Control | Artificial neural networks | Bagging | Boosting | C plus plusSenior-level Full Timebengaluru, India10h ago
-
Consultant - AI Engineer with Cloude INR 2500K-4500KAWS | Autogen | Azure | Cloud platform | ContainerizationSenior-level Full TimeBangalore, Karnataka, India11h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India11h ago
-
SDE - Backend* INR 1600K-2200KAlgorithms | CI/CD | Data Structures | Distributed Systems | DockerCollaborative culture | Hybrid work | Leadership development programs | Learning and development | Multicultural work environmentMid-level Full TimeIndia11h ago
-
SDE - Backend* INR 1600K-2200KAlgorithms | Availability | CI | CI/CD | Code reviewCollaborative culture | Hybrid work | Learning and development programs | Multicultural experience | Professional growthMid-level Full TimeIndia11h ago
-
Entry-level Full TimePune, ASIA, India11h ago