Senior Big Data Engineer
Tasks
- Decompose complex problems
- Design data pipelines
- Develop scalable distributed SaaS systems
- Document requirements
- Drive technology explorations and roadmaps
- Ensure architecture and design quality
- Mentor engineers
- Prototype data platform features
- Provide technical leadership
- Research and benchmark cloud technologies
- Support data platform and services
Perks/Benefits
Skills/Tech-stack
Agile | Apache Airflow | Apache Flink | Apache Kafka | Apache Spark | Architecture Design | Cassandra | Data Infrastructure | Data Lakes | Elasticsearch | Hadoop | Java | Kappa Architecture | Lambda Architecture | Machine Learning | Microservices | NoSQL | OO modeling | Oracle | Performance Benchmarking | Performance Testing | Presto | Queue | RDBMS | Redis | Rule engines | Scala | Scrum | Secure Data | Secure data infrastructure | Solr | Troubleshooting | Unix
Education
Related jobs
-
AI Data Engineer III INR 3000K-4000KAWS | Agile methodologies | Amazon Redshift | Apache Airflow | CI/CDEducation assistance program | Fitness benefits | Flexible working hours | Health checkups | Hybrid work environmentSenior-level Full TimeBengaluru, Karnataka, India R4h ago
-
API Integration | Agent Frameworks | Agentic Workflows | Automation platforms | Event DrivenAutonomy | Fully remote | Healthcare benefits | Professional development | U S business hours alignmentMid-level Full TimeIndia R5h ago
-
Lead Data Engineer INR 2500K-4500KAWS | AWS Glue | Access Control | Airflow | AzureCareer mobility | Cross portfolio opportunities | Leadership development | Learning opportunitiesSenior-level Full TimeIndia R6h ago
-
Cloud ERP | Data Architecture | Data Catalog | Data Intelligence | Data QualityCollaborative & Inclusive Culture | Family support | Flexible working hours | Health and wellness benefits | Professional development opportunitiesSenior-level Full TimeIndia R11h ago
-
Senior Software Engineer (Web Scraping Gen AI Developer) INR 2829K-4500KAPIs | AWS | Azure | CI/CD | DockerEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimePune, MH, India1d ago
-
Lead Software Engineer - Platform Data Team INR 2500K-4200KAWS | Ansible | Azure | Benchmarking | CAP TheoremCareer growth mentoring | Global team collaboration | Remote workSenior-level Full TimeIndia1d ago
-
Senior Backend Engineer - Customer Engineering INR 3500K-6000KCI/CD | Celery | Django | Docker | ETLSenior-level Full TimeNoida1d ago
-
Senior-level Full TimeHyderabad, Andhra Pradesh, India1d ago
-
Staff Software Engineer (AI/ML) INR 3000K-5000KAmazon Bedrock | Anomaly Detection | Asynchronous programming | Behavioral analytics | Connector developmentSenior-level Full TimePune, India1d ago
-
Staff Software Engineer (AI/ML) INR 3000K-5000KAgentic AI | Amazon Bedrock | Anomaly Detection | Artificial Intelligence | Behavioral ModelingSenior-level Full TimePune, India1d ago
-
Senior-level Full TimeBangalore, India1d ago
-
Staff Engineer, Search Intelligence INR 3000K-5000KAudio Processing | C++ | Classifiers | Data Processing | Data StructuresSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Staff Software Engineer, Search Intelligence INR 3000K-5500KData Processing | Data Structures | Data Structures and Algorithms | Distributed Computing | Fine TuningSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior Solutions Engineer INR 2000K-4131KApache Spark | Big Data | Big data analytics | Cloud Computing | Data EngineeringSenior-level Full TimeIndia2d ago
-
Machine Learning Engineer - APAC INR 3000K-4408KA/B | A/B Testing | B testing | CI/CD | ClassificationBenefits for family | Flexible working arrangements | Learning and development resources | Sabbaticals | Study assistanceMid-level Full TimeIndia-Bengaluru (Helios Business Park)2d ago
-
26-2292: Databricks Engineer- India, Hyderabad INR 1000K-2000KAIOps | Access Control | Amazon S3 | Anonymization | Apache KafkaMid-level Full TimeHyderabad/Vijayawada2d ago
-
Lead Software Engineer - Workday INR 1800K-2600KAPI Gateway | AWS CloudWatch | AWS Elastic Load Balancing | AWS Lambda | AWS VPCSenior-level Full TimeOff Embassy Golf Links Business Park, …2d ago
-
Value Data Engineer INR 1800K-2400KAPI | AWS | Agile | Azure | Data EnrichmentCab drop | Cab pickup | Flexible working hours | Subsidized mealsMid-level Full TimeBHUBANESWAR, India2d ago
-
Software Site Reliability Engineer - AI & Data Platforms INR 2500K-4300KAWS | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkMid-level Full TimeHyderabad2d ago
-
Software Site Reliability Engineer - AI & Data Platforms INR 2500K-4300KAWS | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkMid-level Full TimeBengaluru2d ago
-
Senior Data Engineer INR 1500K-2500KAirflow | Apache Spark | Confluence | Data Warehousing | DatabricksSenior-level Full TimeBengaluru, KA, IN2d ago
-
SW Architect - AI Engineering INR 2500K-5000KAPI Development | AWS | Azure | Cloud platform | Cost OptimizationContinuous learning opportunities | Hybrid work opportunities | Supportive, inclusive work environment | Training programsSenior-level Full TimePune - Maharashtra - India2d ago
-
AI Solutions Engineer – Quality & Digitalization INR 2500K-4500KAnomaly Detection | Artificial Intelligence | Azure | Bias Mitigation | Cloud ComputingMid-level Full TimeBangalore - Karnataka - India2d ago
-
Staff Software Engineer - Multi Cloud Efficiency INR 2500K-4200KAWS | Agentic Systems | Automation | C plus plus | Cloud platformSenior-level Full TimeBengaluru, India2d ago
-
Senior-level Full TimeBengaluru, India2d ago