Big Data Developer
Bangalore, Karnataka, India
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Architect HBase data models
- Build Spark Streaming ingestion pipelines
- Collaborate to integrate ML models into Spark workflows
- Deploy Kudu tables for analytical queries
- Design scalable distributed big data solutions
- Develop Hive queries and data pipelines
- Evaluate new big data technologies
- Implement Spark SQL real time processing
- Leverage in memory caching
- Optimize Spark application performance
- Troubleshoot performance and data quality issues
- Tune RDD transformations and partitioning
- Use Spark MLlib for machine learning
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Hadoop | Apache Hive | Apache Kudu | Apache Spark | Data Ingestion | Data Modeling | Data Warehousing | HBase | Machine Learning | Spark MLlib | Spark SQL | Spark Streaming
Education
N/A
Roles
Big Data Developer | Data Developer | Data Engineer | Developer | Engineer
Related jobs
-
Data Engineer II INR 2040K-3380KAWS CloudFormation | Amazon Kinesis | Amazon Redshift | Amazon Web Services | Apache AirflowComplimentary games | Family leave | Healthcare coverage | Mental well-being support | Paid time offSenior-level Full TimeLocations: Hyderabad, Telangana, India5h ago
-
Data Engineer II INR 2040K-3380KAWS | Amazon Kinesis | Amazon Redshift | Apache Airflow | Apache BeamComplimentary games | Family leave | Healthcare coverage | Hybrid work model | Mental well-being supportSenior-level Full TimeLocations: Hyderabad, Telangana, India5h ago
-
Data Engineer II INR 2200K-3465KAmazon Kinesis | Amazon Redshift | Amazon Web Services | Apache Airflow | Apache BeamFree games | Healthcare benefits | Hybrid work schedule | Mental health support | Paid time offMid-level Full Time地点：Hyderabad, Telangana, India5h ago
-
Data Engineer II INR 2200K-3465KAWS | Amazon Kinesis | Amazon Redshift | Apache Airflow | Apache BeamFamily leave | Free games | Health insurance | Hybrid work | Mental health supportMid-level Full Time地点：Hyderabad, Telangana, India5h ago
-
Senior Data Engineer INR 1500K-2500KAWS Glue | AWS Lambda | Amazon EMR | Amazon S3 | Apache AirflowSenior-level Full TimeSaidapet5h ago
-
Senior-level Full TimeIN-AP-Hyderabad6h ago
-
ETL Data with QA Tester INR 1500K-2500KDBT | Data Aggregation | Data Quality | Data Transformation | Data ValidationRemote workSenior-level Full TimeIN-AP-Hyderabad6h ago
-
Agile | Airflow | Azure | Azure Data | Azure Data FactoryEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time off | Wellness plansMid-level Full TimeChennai, TN, India7h ago
-
Software Engineer III - Python Developer + LLM / Gen AI INR 2500K-5000KAWS | Agile | Application Resiliency | CI/CD | Cloud ComputingSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
Sr. Expert INR 2516K-3356KAlgorithms | Cloud Computing | Data Aggregation | Data Engineering | Data IngestionEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeVadodara, GJ, India8h ago
-
API Development | Amazon Redshift | Amazon Web Services | Apache Spark | AzureSenior-level Full TimeBangalore, Karnataka, India9h ago
-
Lead ML Engineer INR 2500K-5000KAgile | Autogen | Automl | Azure | CI/CDEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India10h ago
-
Senior Data Engineer INR 3000K-4000KAWS | Amazon Aurora | Apache Airflow | Apache Kafka | Apache SparkAccreditations | Bike to work | Career development | Educational assistance | Employee assistance programSenior-level Full TimeMumbai, MH, India11h ago
-
ETL Developer INR 2800K-4000KAPI Keys | Adeptia | Automated testing | Azure Data | Azure Data FactorySenior-level Full TimeIndia11h ago
-
Data Engineer INR 3000K-4000KAWS | Cloud Computing | Data Architecture | Data Governance | Data ManagementAccreditation support | Bike to work | Career development program | Educational assistance | Employee assistance programMid-level Full TimeBengaluru, KA, India12h ago
-
Mid-level Full TimeNoida, Uttar Pradesh, India12h ago
-
Sr. AI Engineer - Data Pipelines & Context Systems INR 4000K-5449KABAC | API Design | Asynchronous programming | Auditability | ChunkingFlexible work arrangementsSenior-level Full TimeBangalore13h ago
-
Algorithms | Apache Airflow | Argo Workflows | Azure | Azure ComputeCollaborative team environment | Flexible work environment | Opportunity to innovate | Opportunity to work on impactful projectsSenior-level Full TimeIndia13h ago
-
AI Engineer INR 3264K-5876KAPI Integration | Data Pipelines | Enterprise Search | JavaScript | Language ModelsCompany year end break | Flexible time off | Learning and development stipend | Medical, dental, and vision insurance | Paid parental leaveEntry-level Full TimeChennai, Tamil Nadu, India13h ago
-
AI Engineer II INR 3715K-5572KAWS | Agent Orchestration | Apache Kafka | Data Safety | Evaluation and monitoringCareer growth opportunities | Comprehensive well-being support | Learning opportunitiesSenior-level Full TimeBengaluru, KA, India14h ago
-
Research Engineer – Generative AI and Computer Vision INR 360K-420KAUC | Active Learning | Adversarial Networks | Anomaly Detection | Anomaly Detection MetricsEntry-level Full Timebengaluru, India14h ago
-
Research Engineer – Neuro-Symbolic AI (Knowledge Graphs) & Multimodal Assistant Systems INR 336K-480KD3.js | Deep learning | Entity recognition | Gensim | GephiEntry-level Full Timebengaluru, India14h ago
-
Agentic AI Engineer - Assistant Manager INR 2500K-5000KAPI Design | AWS | Agent systems | Azure | CI/CDFlexible work/life support | Inclusive development opportunities | Paid volunteer days | Vibrant employee networksSenior-level Full TimeBangalore, India19h ago
-
Agile | Data Analysis | Data Enrichment | Data Quality | Data integrationSenior-level Full TimeIND-HYDERABAD, India19h ago
-
Data Engineer INR 2500K-2700KAPIs | AWS | Aurora | Data Governance | Data ModelingPaid time off | Volunteer time offMid-level Full TimeIND-BANGALORE, India19h ago