IN_Senior Associate_Senior Data Engineer_Data and Analytics_Advisory_Bangalore
Bengaluru Millenia, India
INR 2400K-3200K (estimate) Senior-level Full Time
Tasks
- Build and optimize ETL processes
- Design data pipelines for batch processing
- Design data pipelines for real time processing
- Develop ETL workflows
- Ensure data reliability and efficiency
- Implement data quality checks
- Optimize Google Cloud data services
- Optimize Python and SQL code
- Troubleshoot and optimize shell scripts
- Write and troubleshoot data processing scripts
Perks/Benefits
Skills/Tech-stack
Ab Initio | Apache Airflow | BigQuery | Cloud Storage | Cloud platform | Dataflow | Dataplex | Dataproc | ETL | Google Cloud | Google Cloud Platform | PySpark | Python | SQL | Shell Scripting | Unix Shell | Unix/Shell Scripting
Education
Roles
Related jobs
-
Convolutional Neural Networks | Deep learning | Generative AI | Google Gemini | LLM PromptsFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportMid-level Full TimeKolkata DN 57, India2h ago
-
API | Amazon Web Services | Apache Airflow | Apache Hadoop | Azure DataFlexibility programs | Inclusive benefits | MentorshipMid-level Full TimeKolkata DN 57, India2h ago
-
Apache Airflow | Apache Hadoop | Apache Spark | App Service | Azure AppFlexibility programmes | Inclusive benefits | MentorshipSenior-level Full TimeKolkata DN 57, India2h ago
-
Apache Airflow | Apache Spark | Azure Cosmos | Azure Cosmos DB | Azure DataSenior-level Full TimeKolkata DN 57, India2h ago
-
Apache Airflow | Apache Hadoop | Apache Kafka | Apache Spark | App ServiceSenior-level Full TimeKolkata DN 57, India2h ago
-
IN_Manager_Data Analyst_Data and Analytics_Advisory_Bangalore INR 1500K-2000KApache Airflow | Apache Flink | Azure | Azure DevOps | CI/CDMid-level Full TimeBengaluru Millenia, India2h ago
-
API Integration | Agile | Apache Airflow | Apache Hadoop | Apache KafkaFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeKolkata DN 57, India2h ago
-
Amazon Web Services | Apache Airflow | Apache Databricks | Apache Hadoop | Apache SparkSenior-level Full TimeKolkata DN 57, India2h ago
-
API ingestion | Agile | Apache Airflow | Apache Hadoop | Apache KafkaFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeKolkata DN 57, India2h ago
-
Ab Initio | Apache Airflow | BigQuery | Cloud Storage | Cloud platformFlexible work arrangements | Inclusive workplace culture | MentorshipSenior-level Full TimeBengaluru Millenia, India2h ago
-
Ab Initio | BigQuery | Cloud Composer | Cloud Storage | Cloud platformFlexible work programs | Inclusive workplace culture | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India2h ago
-
Ab Initio | Apache Airflow | BigQuery | Cloud Storage | Cloud platformFlexible work arrangements | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India2h ago
-
Ab Initio | Apache Dataflow | BigQuery | Cloud Composer | Cloud StorageCompetitive compensation | Flexibility programmes | Hybrid work environment | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India2h ago
-
AWS Data | AWS Data Pipeline | AWS Glue | AWS Lake Formation | AWS LambdaFlexibility programmes | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India2h ago
-
AWS Data | AWS Data Pipeline | AWS Glue | AWS IAM | AWS KMSSenior-level Full TimeBengaluru Millenia, India2h ago
-
AWS Data | AWS Data Pipeline | AWS Glue | AWS IAM | AWS Lake FormationFlexibility programmes | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India2h ago
-
API | API Development | Agentic AI | Artificial Intelligence | BaggingFlexible working arrangements | Inclusive benefits | Mentorship | Wellbeing supportMid-level Full TimeKolkata DN 57, India2h ago
-
API | Agentic AI | Apache Airflow | Apache Hadoop | Azure DataMid-level Full TimeKolkata DN 57, India2h ago
-
IN_Manager_Data Analyst_Data and Analytics_Advisory_Bangalore INR 1500K-2000KApache Airflow | Apache Flink | Azure DevOps | CI/CD | Cloud DataFlexible work arrangements | Mentorship | Wellbeing supportMid-level Full TimeBengaluru Millenia, India2h ago
-
Ab Initio | BigQuery | Cloud Storage | Cloud platform | ComposerFlexibility programmes | Global exposure | Hybrid work environment | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India2h ago
-
Apache Airflow | Apache Hadoop | Apache Spark | App Service | Azure AppFlexibility programmes | Inclusive benefits | MentorshipSenior-level Full TimeKolkata DN 57, India2h ago
-
API ingestion | Apache Airflow | Apache Kafka | Apache Spark | App ServiceFlexible work programs | Inclusive benefits | Mentorship | Work-life balanceSenior-level Full TimeKolkata DN 57, India2h ago
-
API ingestion | Agile | Apache Airflow | Apache Hadoop | Apache SparkFlexibility programs | Inclusive benefits | MentorshipSenior-level Full TimeKolkata DN 57, India2h ago
-
Apache Airflow | Apache Hadoop | Apache Spark | App Service | Azure AppFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeKolkata DN 57, India2h ago
-
Agile | Apache Spark | App Service | Azure App | Azure App ServiceFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeKolkata DN 57, India2h ago