IN_Senior Associate_Spark Scala_Data and Analytics_Advisory_Bangalore
Bengaluru Millenia, India
INR 2000K-2146K (estimate) Senior-level Full Time
Tasks
- Build and manage end to end data ingestion workflows
- Debug troubleshoot and optimize Spark jobs
- Design large-scale data processing pipelines
- Develop data transformation logic
- Ensure data quality, reliability, and consistency
- Implement CI/CD pipelines
- Maintain Hive data models and ETL processes
- Manage project dependencies
- Schedule and manage workflow orchestration
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Apache Hive | Apache Kafka | Apache Spark | CI/CD | Docker | ETL | Functional Programming | GitHub | GitHub Actions | Kubernetes | Maven | Oozie | SBT | Scala
Education
Bachelor of Engineering | Master of Computer Applications | Master of Engineering | Master of Technology
Roles
Related jobs
-
Sr. DevOps Engineer INR 2500K-3500KAIOps | AKS | ARM | Azure Container | Azure Container RegistryRotational on-call supportSenior-level Full TimeHyderabad, India3h ago
-
Database Engineer INR 1500K-2400KAWS RDS | Azure SQL | Backup and Recovery | Data Modeling | Data WarehousingSenior-level Full TimeIN-TN-Chennai4h ago
-
Senior-level Full TimeIN-TN-Chennai4h ago
-
Aws Etl INR 1500K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeIN-AP-Hyderabad5h ago
-
Aws Etl INR 1500K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeIN-AP-Hyderabad5h ago
-
Aws Etl INR 1500K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeIN-AP-Hyderabad5h ago
-
Senior-level Full TimeIndia5h ago
-
Azure | Azure Blob | Azure Blob Storage | Azure DevOps | Azure MLSenior-level Full Timebengaluru, India6h ago
-
DE&A - AWS - Data Engineer + Data Platform Support INR 3000K-4000KAmazon Bedrock | Amazon EC2 | Amazon EMR | Amazon S3 | Amazon SageMakerSenior-level Full TimePune, Maharashtra, India7h ago
-
Mid-level Full TimeMumbai, Maharashtra, India7h ago
-
Manager - Python with Gen AI INR 1800K-3000KAutogen | Claude | CrewAI | Data Pipelines | Event DrivenMid-level Full TimeBangalore, Karnataka, India10h ago
-
Lead Software Engineer - Big Data INR 2040K-3380KAmazon DynamoDB | Apache Avro | Apache Hive | Apache Kafka | Apache ParquetSenior-level Full TimeMumbai, Maharashtra, India10h ago
-
Mid-level Full TimeBangalore, Karnataka, India10h ago
-
Senior-level Full TimeBangalore, Karnataka, India10h ago
-
Senior-level Full TimeHyderabad, India11h ago
-
Sr. Data Engineer INR 2800K-4000KCloud warehousing | DAX | Dashboard Design | Data Quality | Data StorytellingCommunity outreach programs | Employee Resource Group | Employee stock purchase program | Health and wellness incentivesSenior-level Full TimeBangalore, KA, IN, 56003711h ago
-
Lead Software Engineer - Java, AWS, GraphSQL, Data science INR 2500K-4500KAWS | Amazon ECS | Amazon EKS | Application Resiliency | CI/CDSenior-level Full TimeHyderabad, Telangana, India11h ago
-
Senior-level Full TimeGurgaon, Haryana, India11h ago
-
Database Reliability/Automation Engineer INR 1000K-1820KAnsible | Bash | CI/CD | CloudFormation | DockerMid-level Full TimeIndia11h ago
-
Applied AI ML Associate INR 2000K-3000KAI Agents | AWS Cloud | Advanced Analytics | Big Data | CI/CDSenior-level Full TimeHyderabad, Telangana, India12h ago
-
GIS Data Engineer II INR 2000K-2400KAWS | Amazon Athena | Amazon EC2 | Amazon RDS | Amazon S3MentorshipSenior-level Full TimeMumbai, MH, India13h ago
-
Software Engineer - Embedded & Functional Safety Software INR 1753K-3440KAgile | Automated testing | C# | C++ | CAN busSenior-level Full TimeBangalore, IN17h ago
-
Software Engineer - Robot Navigation, Localization & SLAM INR 1753K-2372K3D camera | Agile | Automated testing | C++ | CI/CDMid-level Full TimeBangalore, IN17h ago
-
Software Engineer - Robot Connectivity & Wi Fi Systems INR 1000K-2000KAgile | Automated testing | CI/CD | GRPC | GitCustomer-facing workSenior-level Full TimeBangalore, IN17h ago
-
AI Software Engineer INR 1753K-2600KAWS | Agent/tool use | Apache Spark | Azure | ContainersContinuing education program | Continuous learning | Family-friendly perks | Financial wellness programs | Flexible time offEntry-level Full TimeIN - HYDERABAD ORION, India17h ago