Big Data Developer
Bangalore, Karnataka, India
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Architect HBase data models
- Build Spark Streaming ingestion pipelines
- Collaborate to integrate ML models into Spark workflows
- Deploy Kudu tables for analytical queries
- Design scalable distributed big data solutions
- Develop Hive queries and data pipelines
- Evaluate new big data technologies
- Implement Spark SQL real time processing
- Leverage in memory caching
- Optimize Spark application performance
- Troubleshoot performance and data quality issues
- Tune RDD transformations and partitioning
- Use Spark MLlib for machine learning
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Hadoop | Apache Hive | Apache Kudu | Apache Spark | Data Ingestion | Data Modeling | Data Warehousing | HBase | Machine Learning | Spark MLlib | Spark SQL | Spark Streaming
Education
N/A
Roles
Big Data Developer | Data Developer | Data Engineer | Developer | Engineer
Related jobs
-
Staff Engineer, Search Intelligence INR 3000K-5000KAudio Processing | C++ | Classifiers | Data Processing | Data StructuresSenior-level Full TimeBengaluru, Karnataka, India23h ago
-
Staff Software Engineer, Search Intelligence INR 3000K-5500KData Processing | Data Structures | Data Structures and Algorithms | Distributed Computing | Fine TuningSenior-level Full TimeBengaluru, Karnataka, India23h ago
-
Senior Solutions Engineer INR 2000K-4131KApache Spark | Big Data | Big data analytics | Cloud Computing | Data EngineeringSenior-level Full TimeIndia1d ago
-
Machine Learning Engineer - APAC INR 3000K-4408KA/B | A/B Testing | B testing | CI/CD | ClassificationBenefits for family | Flexible working arrangements | Learning and development resources | Sabbaticals | Study assistanceMid-level Full TimeIndia-Bengaluru (Helios Business Park)1d ago
-
26-2292: Databricks Engineer- India, Hyderabad INR 1000K-2000KAIOps | Access Control | Amazon S3 | Anonymization | Apache KafkaMid-level Full TimeHyderabad/Vijayawada1d ago
-
Value Data Engineer INR 1800K-2400KAPI | AWS | Agile | Azure | Data EnrichmentCab drop | Cab pickup | Flexible working hours | Subsidized mealsMid-level Full TimeBHUBANESWAR, India1d ago
-
Software Site Reliability Engineer - AI & Data Platforms INR 2500K-4300KAWS | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkMid-level Full TimeHyderabad1d ago
-
Software Site Reliability Engineer - AI & Data Platforms INR 2500K-4300KAWS | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkMid-level Full TimeBengaluru1d ago
-
Senior Data Engineer INR 1500K-2500KAirflow | Apache Spark | Confluence | Data Warehousing | DatabricksSenior-level Full TimeBengaluru, KA, IN1d ago
-
Senior II Data Engineer INR 3600K-4995KData Intelligence | Data Modeling | Fusion Data Intelligence | Oracle Cloud | Oracle DatabaseFlexible workingSenior-level Full TimeIndia1d ago
-
AI Solutions Engineer – Quality & Digitalization INR 2500K-4500KAnomaly Detection | Artificial Intelligence | Azure | Bias Mitigation | Cloud ComputingMid-level Full TimeBangalore - Karnataka - India1d ago
-
Mid-level Full TimeIndia2d ago
-
Senior-level Full TimeMADURAI, TAMIL NADU, India2d ago
-
Snowflake + Python + SQL Developer INR 1500K-2500KAWS | Azure | DBT | Data Governance | Data ModelingSenior-level Full TimeBangalore, Karnataka, India2d ago
-
API | Apache Hadoop | Apache Kafka | Apache Spark | Azure DataHybrid workSenior-level Full TimeBangalore, Karnataka, India R2d ago
-
API | Agile | Apache Hadoop | Apache Kafka | Apache SparkHybrid work | Technical research opportunities | Training supportSenior-level Full TimeBangalore, Karnataka, India R2d ago
-
Apache Airflow | Apache Hadoop | Apache Kafka | Apache Spark | Azure DataHybrid work | Training opportunitiesSenior-level Full TimeBangalore, Karnataka, India R2d ago
-
AI Engineer INR 2500K-4800KCloud Computing | Generative AI | Language Models | Large Language Models | MLOpsMid-level Full TimeIndia2d ago
-
Entry-level Full TimeBangalore, Karnataka, India2d ago
-
Senior Software Engineer II (Java Microservices) INR 3000K-4500KAWS | Agile | Apache Kafka | Apache Spark | AzureCareer development | Distributed collaboration | Learning opportunities | Work from Anywhere cultureSenior-level Full TimeIndia R2d ago
-
AI Engineer (Manager level) INR 1200K-2500KApache Spark | Azure AI | Azure CI | Azure CI/CD | Azure CognitiveMid-level Full TimeHyderabad, India2d ago
-
Consultant - Databricks Azure INR 1000K-2700KAccess Control | Azure | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeBangalore, Karnataka, India2d ago
-
Assistant Manager - Databricks Azure INR 1500K-2000KADLS | Amazon Kinesis | Apache Kafka | Apache Spark | Azure ADMid-level Full TimeBangalore, Karnataka, India2d ago
-
Associate Consultant - Databricks Azure INR 1500K-2000KADLS | Azure | Azure Data | Azure Data Factory | Azure DatabricksMid-level Full TimeBangalore, Karnataka, India2d ago
-
Staff AI Engineer INR 4000K-5500KDeep learning | Graph Learning | Graphical Models | Linear Algebra | Machine LearningSenior-level Full TimeDelhi NCR2d ago