Spark, Scala, Hadoop & Quantexa/Senior Consultant Specialist
Bangalore, KA, IN, 560076
INR 2000K-2800K (estimate) Senior-level Full Time
Tasks
- Analyze complex business requirements
- Build and deploy production data processing batch systems
- Collaborate with support teams
- Communicate with Product Owner and agile pod
- Design develop test implement data solutions
- Design systems accordingly
- Guide junior team members
- Implement CI/CD pipeline
- Maintain platforms and system integrations
- Monitor services
- Perform peer review
- Support production releases
- Work in shifts and on-call
Perks/Benefits
Skills/Tech-stack
Apache Airflow | Apache Spark | Elasticsearch | HDFS | Hadoop | Scala | Shell Scripting | Spark SQL | Unix | Unix Shell | Unix/Shell Scripting
Education
N/A
Related jobs
-
Mid-level Full TimeBangalore, Karnataka, India; Hyderabad, Telangana, India2h ago
-
APIs | Airflow | Apache Iceberg | Apache Kafka | Apache SparkSenior-level Full TimeBengaluru7h ago
-
Node JS Developer - Senior Consultant INR 2200K-3500KAWS OpenSearch | Agile | Apache Kafka | Bull queue | CI/CDSenior-level Full TimeBangalore, IN, 5600668h ago
-
Azure Databricks | Azure DevOps | Data Quality | Data Warehousing | DatabricksCollaborative Agile environment | Fully remote | Hands on cloud data platform exposureMid-level Full TimeIndia R8h ago
-
Data Analytics/Engineer (Python and MS Fabric exp) INR 2500K-4720KAWS | Apache Airflow | Azure Data | Azure Data Factory | Azure SynapseCross-functional collaboration | Mentorship | Professional developmentSenior-level Full TimeIND-Pune-Smartworks, India13h ago
-
AWS S3 | Amazon Redshift | Amazon Web Services | Apache Spark | Azure DataSenior-level Full TimeBengaluru Millenia, India13h ago
-
Snowflake Data Engineer INR 2000K-2600KAmazon Web Services | Apache Spark | Bitbucket | CI/CD | Cloud platformSenior-level Full TimeBangalore, KA, IN13h ago
-
Senior-level Full TimeBangalore, KA, IN13h ago
-
Senior-level Full TimeBangalore, KA, IN13h ago
-
Senior-level Full TimeBengaluru, KA, IN13h ago
-
Senior Data Engineer - PySpark & Python INR 1500K-2500KApache Airflow | Apache Spark | CI/CD | Data Cleansing | Data LinkingSenior-level Full TimeBengaluru, Karnataka, India13h ago
-
Staff Solutions Architect - AI/ML INR 3000K-4580KAI Governance | APIs | AWS | Azure | Computer VisionSenior-level Full TimeHyderabad - Phoenix Equinox Tower 2, …13h ago
-
Senior-level Full TimeMaharashtra, Pune, India1d ago
-
Senior-level Full TimeIN-AP-Hyderabad1d ago
-
Senior-level Full TimeIN-TN-Chennai1d ago
-
Mid-level Full TimeBangalore, Karnataka, India1d ago
-
AI Data Engineer III INR 3000K-4000KAgile | Amazon Web Services | Apache Airflow | CI/CD | DBTComprehensive insurance | Education assistance program | Fitness benefits | Flexible working hours | Health checkupsSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Staff Data Engineer INR 3000K-4132KAWS | Agile | Amazon Redshift | Amazon S3 | Apache AirflowEducation assistance | Fitness benefits | Flexible working hours | Health checkups | Health insuranceSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Mid-level Full TimeBangalore, Karnataka, India1d ago
-
Mid-level Full TimeBangalore, Karnataka, India1d ago
-
Mid-level Full TimeBangalore, Karnataka, India1d ago
-
Big Data Lead INR 1500K-2500KAWS S3 | Amazon ECS | Amazon IAM | Apache Airflow | CI/CDClient facing communication | Team collaborationSenior-level Full TimeIndia1d ago
-
Cloud Operations Engineer INR 2500K-4000KAWS | Amazon EKS | Ansible | Apache Tomcat | Application middleware24x7 on-call rotationSenior-level Full TimeHyderabad India1d ago
-
Lead Software Engineer -Python or Java, big data INR 3000K-4500KAWS | AWS Lambda | Agile | Amazon EMR | Amazon Elastic Compute ServiceSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior Engineer, Data Engineering INR 1500K-2500KAirflow | Azure | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeBengaluru, KA, India1d ago