IN_Sr Associate_ Data Engineer Spark, Scala_D&A_Advisory_Bangalore
Bengaluru Millenia, India
INR 2040K-2400K (estimate) Senior-level Full Time
Tasks
- Automate build test deployment
- Build ETL processes
- Debug and optimize Spark jobs
- Design data processing pipelines
- Develop Hive data models
- Develop data ingestion workflows
- Ensure data quality, reliability, and consistency
- Implement CI/CD pipelines
- Implement data transformation logic
- Manage Airflow or Oozie workflows
- Manage project dependencies
- Schedule workflows
Perks/Benefits
Skills/Tech-stack
Apache Airflow | Apache Hive | Apache Kafka | Apache Oozie | Apache Spark | CI/CD | Docker | Docker Compose | ETL | GitHub | GitHub Actions | Kubernetes | Maven | SBT | Scala
Education
Bachelor of Engineering | Bachelor of Technology | Master of Business Administration | Master of Computer Applications | Master of Engineering | Master of Technology
Roles
Related jobs
-
Consultant_ GCP Data Engineer INR 1200K-2000KAirflow | BigQuery | Cloud Composer | Cloud Functions | Cloud StorageAI certifications | Training and mentorshipEntry-level Full TimeIndia-Gurugram13h ago
-
Lead Consultant, Gen_AI Engineer with MCP server expertise! INR 2500K-4000KAWS | Agentic AI | Amazon SageMaker | Azure | Azure OpenAISenior-level Full TimeIndia-Bangalore13h ago
-
A/B | A/B Testing | B testing | Constrained optimization | DockerFlexible working hours | Remote work | Short term contractSenior-level ContractNoida, India13h ago
-
Pyspark Databricks AWS INR 500K-2000KAWS Glue | Agile | Airflow | Amazon Web Services | Apache KafkaSenior-level Full TimeIN-TN-Chennai14h ago
-
Senior-level Full TimeIN-TN-Chennai14h ago
-
Mid-level Full TimePune, Maharashtra, India15h ago
-
AWS Lead Data Engineer INR 2000K-2040KAWS | AWS Glue | AWS architecture | Agile methodology | Amazon AuroraSenior-level Full TimeGurugram, Haryana, India16h ago
-
Senior-level Full TimeNew Delhi, DL, India16h ago
-
DE&A - Core - Cloud Data Engineering - Azure Data Engineering INR 1500K-2000KAggregation pipelines | Azure Blob | Azure Blob Storage | Azure Cosmos | Azure Cosmos DBMid-level Full TimePune, Maharashtra, India17h ago
-
Lead Software Engineer - AWS, PySpark, BigData INR 2000K-2450KAWS | AWS CDK | AWS Lambda | Agile | AirflowSenior-level Full TimeHyderabad, Telangana, India17h ago
-
API Gateway | AWS Bedrock | AWS Lambda | AWS Step Functions | Amazon APIEntry-level Full TimeMumbai, MH, India17h ago
-
Software Engineer III - AWS, PySpark, ETL INR 2000K-2450KAWS EMR | Agile | Apache Spark | CI/CD | Data ModelingSenior-level Full TimeHyderabad, Telangana, India17h ago
-
Software Engineer III - PySpark, BigData, AWS INR 2050K-2600KAWS | Agile | Amazon Web Services | Application Resiliency | Application SecuritySenior-level Full TimeHyderabad, Telangana, India17h ago
-
Senior AI/ML Engineer I INR 2500K-4000KAgentic AI | Azure | BERT | Continuous integration | Distributed SystemsCertification programs | Education reimbursement | Employee Assistance Program (EAP) | Flexible work options | Health coverageSenior-level Full TimeHyderabad, Telangana, India17h ago
-
Senior Embedded DevOps Engineer INR 2229K-2500KAutomotive Software | Build Tools | CI/CD | Change Management | Cloud ComputingSenior-level Full TimeBangalore, IN, 56010018h ago
-
Consultant - Python Developer with Gen AI INR 1500K-2000KAI Search | Agile | Azure | Azure OpenAI | CSSMid-level Full TimeBangalore, Karnataka, India18h ago
-
NW Perf and Optimization Expert INR 500K-800K3GPP | 5G Core | 5G NAS | 5GC | AMFCustomer facing collaboration | Shift work support | Technical documentation supportSenior-level Full TimeIndia18h ago
-
Azure Data Engineer - Associate Consultant INR 1500K-2000KAzure Data | Azure Data Factory | Azure Data Flow | Azure Data Lake | Azure DatabricksMid-level Full TimeBangalore, Karnataka, India19h ago
-
Data Engineer- AWS+MS Fabric+ Purview INR 1628K-2040K.NET | AWS | AWS CloudFormation | AWS Lambda | Amazon EC2Senior-level Full TimeGurugram, Haryana, India19h ago
-
Data Engineer INR 960K-1400KADO | Automated testing | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeMumbai, Maharashtra, India20h ago
-
Mid-level Full TimePune, India20h ago
-
Senior-level Full TimeChennai, TN, India21h ago
-
Data Engineer II - Python, AWS, Spark INR 1500K-2000KAWS Cloud | Amazon Web Services | Apache Hadoop | Apache Spark | CI/CDMid-level Full TimeHyderabad, Telangana, India21h ago
-
Senior-level Full TimeBengaluru, India23h ago
-
Senior-level Full TimeBengaluru, India23h ago