Spark, Scala, Hadoop & Quantexa/Senior Consultant Specialist
Bangalore, Karnataka, India
R
INR 1600K-2700K (estimate) Senior-level Full Time
Tasks
- Analyze business requirements
- Build deploy batch data processing systems
- Collaborate with support teams
- Communicate with Product Owner and agile pod
- Design systems accordingly
- Design, develop, test, implement solutions
- Guide junior team members
- Implement CI/CD pipeline
- Maintain platforms and integrations
- Monitor services
- Perform peer review
- Support production releases
Perks/Benefits
Skills/Tech-stack
Apache Airflow | Apache Hadoop | Apache Spark | CI/CD | DevOps | Elasticsearch | HDFS | Quantexa | Scala | Service Monitoring | Spark SQL | Unix | Unix Shell
Education
N/A
Related jobs
-
Agentic AI | Alerting | Anomaly Detection | Apache Airflow | Artifact RegistryMid-level Full TimePune, Maharashtra, India R10h ago
-
Senior Data Engineer INR 3000K-4000KAWS | Airflow | Amazon Aurora | Apache Kafka | Apache SparkBike to work | Career mentorship | Educational assistance | Employee assistance program | Employee discountSenior-level Full TimeMumbai, MH, India R11h ago
-
Azure Data Engineer INR 1500K-2500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Functions | Azure SynapseSenior-level Full TimeHyderabad, Telangana, India R12h ago
-
AWS | Alerting | Application Security | Authentication | AuthorizationAdditional Holiday Benefits | Continuous learning | Flexible remote first async working | Fully remote | High ownership roleSenior-level Full TimeIndia R21h ago
-
Principal AI Engineer INR 2000K-5000KAutogen | CI/CD | Chroma | CrewAI | DockerFully remote | High-impact work | Remote working options | Small teamSenior-level Full TimeIndia - Remote R23h ago
-
Analytics Engineer I INR 2500K-3380KAccess Controls | Anomaly Detection | CI/CD | Code review | Data GovernanceEntry-level Full TimeHyderabad, India R23h ago
-
Data Engineer INR 2000K-3900KAWS | Airflow | Azure | CI/CD | CloudFormationCareer Development Programs | Flexible work arrangements | Health and wellbeing benefits | Hybrid work scheduleSenior-level Full TimeBengaluru, Karnātaka, India R23h ago
-
Python AI /Senior Consultant Specialist INR 3000K-5000KAWS | Azure | CI/CD | Chroma | Data AnalysisContinuous professional development | Flexible working | Inclusive diverse environmentSenior-level Full TimePune, Maharashtra, India R1d ago
-
AI machine learning | Agile | CI/CD | Data Governance | Data LineageFlexible working | Inclusive diverse environment | Professional developmentMid-level Full TimeHyderabad, Telangana, India R1d ago
-
Senior Data Engineer INR 3000K-4000KAWS | Apache Airflow | Apache Kafka | Apache Spark | AzureMedical insurance | Personal accident insurance | Remote-first work | Term life insuranceSenior-level Full TimeIndia - Remote R1d ago
-
API Integration | Airflow | Authentication | Authorization | DagsterFixed-term contract | Permanent work from home flexibility | Remote work | Work from homeEntry-level Full TimeIndia R1d ago
-
Mid-level Full TimeBangalore, Karnataka, India R1d ago
-
AWS | Agentic Workflows | Airflow | Asynchronous programming | AzureFully remote | Growth opportunities | High autonomy | Innovation-focused culture | Modern technology accessSenior-level Full TimeIndia R1d ago
-
AWS | Agile | Amazon Athena | Amazon Bedrock | CI/CDContinuous learning opportunities | Fully remote | Professional developmentMid-level Full TimeIndia R1d ago
-
Access Control | Apache Airflow | Auditability | Azure | Change Data CaptureCollaborative environment | Documentation and architecture diagram creation support | Flexible contract engagement | Fully remote | Knowledge sharing cultureSenior-level Contract Full TimeIndia R1d ago
-
Alerting | Batch Processing | Big Table | Data Modeling | Data ObservabilityFully remote | Inclusion and collaboration culture | Professional growth opportunities | Well-being support | Work-life balance initiativesMid-level Full TimeIndia R1d ago
-
Data Engineering MTS INR 2000K-2500KAPI Integration | AWS | Airflow | Amazon Redshift | CI/CD1-on-1 coaching | Adoption Assistance | Fertility benefits | On-demand training | Parental leaveMid-level Full TimeIndia - Bangalore R1d ago
-
Software Engineer (Full Stack Developer, Node JS & React JS)) INR 2000K-4500KAI Agents | AI orchestration | API Design | Agile | CI/CDSenior-level Full TimeBangalore, India Office (BANGALORE) R2d ago
-
Senior Software Engineer (Golang / Agentic AI / Cloud / Distributed / Microservices) INR 2500K-5000KAI tools | Analytics Pipelines | CI/CD | ClickHouse | Cloud NativeSenior-level Full TimeBangalore, India Office (BANGALORE) R2d ago
-
Apache Airflow | Apache Beam | Apache Flink | Asynchronous Messaging | BigQueryCareer growth opportunities | Continuous professional development | Flexible workingMid-level Full TimePune, Maharashtra, India R2d ago
-
Senior-level Full TimeNoida, India R2d ago
-
Specialist - Data Analytics INR 800K-1500KAgile | CI/CD | Data Governance | Data Modeling | Data QualityHybrid work | Learning and development programs | Two-way transportationMid-level Full TimeHyderabad GBS, India R2d ago
-
Junior Software Engineer INR 480K-800KAzure Data | Azure Data Factory | Azure Data Lake | Azure Synapse | Azure Synapse AnalyticsClient facing communication experience | Night shift rotation | Remote workEntry-level Full TimeHyderabad/Remote, India R3d ago
-
Forward Deployed Engineer INR 2400K-3900KAWS | Apache Spark | Azure | CI/CD | DatabricksCustomer-facing work | Travel 20 percent timeSenior-level Full TimeRemote - India R3d ago
-
Lead Consultant - AI Architect INR 3584K-5000KAWS | Agent Orchestration | Agentic AI | Amazon Bedrock | Amazon QSenior-level Full TimeIndia - Bangalore R3d ago