DE&A - Core - Big Data Engineering - ETL
Bangalore, Karnataka, India
INR 1500K-2000K (estimate) Mid-level Full Time
Tasks
- Architect and develop PySpark applications
- Define migration strategies
- Design target state architectures
- Implement batch and streaming workloads
- Lead big data platform migrations
- Modernize ETL pipelines
- Optimize data pipelines for performance, scalability, and cost
- Refactor Spark Hive or MapReduce jobs for GCP
Perks/Benefits
- N/A
Skills/Tech-stack
Batch Processing | BigQuery | Dataflow | Dataproc | ETL | GCP | GCS | Hadoop | Hive | MapReduce | PySpark | Spark | Streaming
Education
N/A
Roles
Related jobs
-
Senior Data Engineer, Payments INR 3050K-4350KAWS Glue | Amazon Redshift | Apache Airflow | Apache Flink | Apache KafkaSenior-level Full TimeBangalore, India2h ago
-
AWS | Access Control | Apache Airflow | Azure | CI/CDAutonomy | Career growth | Inclusive culture | Learning and developmentSenior-level Full TimeIndia2h ago
-
Staff Data Engineer INR 1500K-2400KAI code generation | AWS | AWS Glue | Agentic Frameworks | Apache IcebergSenior-level Full TimeGurugram11h ago
-
Sr Data Engineer II - Salesforce (Hybrid) INR 1500K-2700KAmazon Redshift | Apache Airflow | Boomi | Bulk API | DBTMid-level Full TimeBangalore, INDIA R12h ago
-
Senior Azure Data Engineer INR 3000K-3900KAPI Integration | Azure | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeIndia15h ago
-
Artificial Intelligence | ETL | Git | Pandas | PySparkCollaborative team | Personal growth | Technical mentorship | Values-driven cultureEntry-level Full TimeHyderabad, Telangana16h ago
-
Bash | Data Processing | Docker | GCP | LinuxAsynchronous work culture | Remote workMid-level Full TimeKochi, India18h ago
-
API Development | Amazon SageMaker | Azure Machine Learning | CI/CD | Cloud ComputingCareer growth opportunities | Collaborative work culture | Flexible work environment | Mentoring opportunitiesMid-level Full TimeIndia18h ago
-
API Testing | Agile | Airflow | Azure | CI/CDEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, India18h ago
-
API Integration | AWS | Active Directory | Anthropic | Azure Active DirectoryCareer growth opportunities | Continuous learning and professional development | Cross-functional project exposure | Flexible and collaborative environment | Inclusive workplace cultureSenior-level Full TimeIndia18h ago
-
Senior Data Engineer INR 2000K-3000KAI integrations | API Integration | Automation workflows | Azure Data | Azure Data FactoryClient-facing work | Fast-paced environment | Independent ownershipSenior-level Full TimeBangalore North, India19h ago
-
Data Science INR 2000K-3300KAgentic AI | Apache Airflow | CrewAI | Data Architecture | Data PipelinesSenior-level Full TimeIN-MH-Pune19h ago
-
Data Engineer with Airflow INR 1500K-2400KAmazon Web Services | Apache Airflow | Data Visualization | Data Warehousing | DockerSenior-level Full TimeIN-AP-Hyderabad19h ago
-
Data Engineer- Airflow INR 1500K-2500KAmazon Web Services | Apache Airflow | Data Visualization | Data Warehousing | DockerSenior-level Full TimeIN-AP-Hyderabad19h ago
-
Data Engineer- Airflow INR 1500K-2500KAmazon Web Services | Apache Airflow | Data Visualization | Data Warehousing | DockerSenior-level Full TimeIN-AP-Hyderabad19h ago
-
Senior-level Full TimeIN-TN-Chennai19h ago
-
Data Engineer INR 1400K-1800KAnomaly Detection | Apache Spark | Azure DevOps | Azure DevOps Pipelines | CDCHybrid work modelSenior-level Full TimeMumbai, Maharashtra, India19h ago
-
DevOps Engineer INR 1500K-2500KAgile | Amazon Web Services | BI dashboarding | CI/CD | Cloud platformInternational collaboration | Occasional travel to EuropeMid-level Full TimePune, MH, India21h ago
-
AI Engineer – Retail/CPG Domain INR 1500K-2500KAWS | Azure | Cloud platform | Data Governance | Data ModelingMid-level Full TimeGurugram, Haryana, India21h ago
-
REF82383U - Data science (ML Algorithms, unsupervised techniques, Databricks, Python, PySpark, Azure,AB testing ) 3- 6 yrs exp INR 1500K-2040KA/B | A/B Testing | B testing | Databricks | Machine LearningSenior-level Full TimeBangalore, KA, India21h ago
-
Specialist - Data Engineering-Data Engineering INR 180K-200KAWS | Apache Kafka | Apache Spark | Data Modeling | Data QualityEntry-level Full TimeMumbai, Maharashtra, India21h ago
-
Mid-level Full TimeBengaluru, IN22h ago
-
Sr. Staff Engineer (Python,Pyspark,AWS) INR 2800K-4000KAI Agents | API Gateway | AWS | Apache Spark | BedrockEmployee volunteering | Family wellbeing benefits | Health insurance | Paid time off | Wellbeing programsSenior-level Full TimeHyderabad, India1d ago
-
Senior-level Full TimeIndia - Bengaluru; India - Hyderabad1d ago
-
GCP Data Engineer INR 2000K-3000KApache Airflow | Apache Spark | BigQuery | Cloud Composer | Cloud DataflowSenior-level Full TimeIndia - Bengaluru; India - Hyderabad1d ago