Staff Big Data Engineer
Tasks
- Conduct technical reviews architecture governance
- Define data platform technical vision
- Design scalable data processing systems
- Identify troubleshoot data platform performance bottlenecks
- Implement event driven streaming architectures
- Lead architecture decisions across teams
- Maintain high availability data pipelines
- Mentor engineers distributed systems performance optimization
- Research evaluate recommend data processing technologies
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Lambda | Apache Airflow | Apache Flink | Apache Kafka | Apache Solr | Apache Spark | Benchmarking | Cassandra | Data Lake | Distributed Caching | Elasticsearch | Event Driven | Event-driven architecture | Hadoop | Linux | Machine Learning | Oracle Database | Performance Tuning | Redis | Streaming Data | Trino
Education
Related jobs
-
Senior Data Engineer- AWS INR 2000K-2500KAWS Glue | AWS Lambda | Amazon Redshift | Amazon Web Services | Apache AirflowSenior-level Full TimeBangalore North, India14h ago
-
Java, GCP, ReactJS/Consultant Specialist INR 2200K-3200KAnsible | Apache Airflow | Apache Atlas | BigQuery | ClaudeFlexible working | Professional developmentMid-level Full TimeHyderabad, Telangana, India R15h ago
-
Java, GCP, ReactJS/Consultant Specialist INR 2200K-3200KAnsible | Apache Airflow | Apache Atlas | BigQuery | ClaudeFlexible working | Professional developmentMid-level Full TimeHyderabad, Telangana, India R15h ago
-
Consultant - Cloud AI Developer INR 1400K-2500KAWS | Application Modernization | Application rationalization | Azure | Azure OpenAIMid-level Full TimeBangalore, Karnataka, India16h ago
-
Mid-level Full TimePune, Maharashtra, India17h ago
-
DTICI_SalesProductServices_DataEngineer_T9 INR 1500K-2500KAWS | Agile | Apache Spark | Azure | Azure DataMid-level Full TimeBengaluru, Karnataka, India17h ago
-
Entry-level Full TimePune, Maharashtra, India17h ago
-
AI Full stack Engineer INR 2000K-5000KAPI Development | Agentic AI | BigQuery | Cloud SQL | Cloud platformSenior-level Full TimeIndia17h ago
-
Associate Process Manager INR 500K-1500KAzure SQL | Azure Synapse | BI Data modeling | Compliance | DAXMid-level Full TimeMumbai, Maharashtra, India17h ago
-
Senior Analyst - AI/ML INR 2500K-5000KAWS | Artificial Intelligence | Automl | Azure | Cloud platformMentorship | TrainingSenior-level Full TimePune, Maharashtra, IND, 41101420h ago
-
Principal Software Engineer INR 1500K-3000KApache Spark | C# | C++ | Continuous integration | Distributed SystemsSenior-level Full TimeIndia, Karnataka, Bangalore21h ago
-
Mid-level Full TimeBengaluru, Karnataka, India21h ago
-
Mid-level Full TimeBengaluru, Karnataka, India21h ago
-
Mid-level Full TimeHadapsar, Pune, Maharashtra, IND, 41101321h ago
-
AI Data Scientist INR 1200K-3000KAgent systems | Agentic AI | Data Preprocessing | Data Quality | Diffusion ModelsMid-level Full TimeChennai, Tamil Nadu, India22h ago
-
Data Scientist II USD 45KAWS SageMaker | Adapters | Azure Machine Learning | CI CD for ML Pipelines | CI/CDMid-level Full TimeBengaluru, Karnataka, India22h ago
-
Data Engineer INR 360K-480KApache Airflow | Apache Flink | Git | Linux | PandasCareer development | Code reviews | MentorshipEntry-level Full TimeMumbai, Maharashtra, India23h ago
-
Senior-level Full TimeIndia - Bengaluru23h ago
-
Sr ML & AI Engineer INR 3264K-5000KAPI Integration | Agentic AI | Amazon Web Services | Azure | Cloud ComputingCareer growth opportunities | Continuous learning | Flexible work arrangements | Hybrid work arrangementsSenior-level Full TimeNavi Mumbai, India1d ago
-
Sr ML & AI Engineer INR 4000K-5500KAgentic AI | Amazon Web Services | Azure | Cloud Computing | Cloud platformCourse access | Learning and development | Online trainingSenior-level Full TimeNavi Mumbai, India1d ago
-
Staff Software Engineer (Python) INR 3500K-5000KAPIs | Alerting | Amazon Web Services | Authentication | Batch ProcessingCollaborative team environment | Global consulting environment | Leadership development | Training programsSenior-level Full TimeMumbai, MH, India1d ago
-
Data & Analytics Engineer - AM INR 1500K-2500KApache Spark | Data Modeling | Data Warehousing | Data pipeline | DatabricksSenior-level Full TimeBangalore, Karnataka, India1d ago
-
IN|KDN KRC|Nordics|Digital Audit -Tech Assistant Manager - NOI INR 1200K-2500KAlteryx | Automation Scripts | Data Cleansing | Data Management | Data ModelingMid-level Full TimeNoida, Uttar Pradesh, India1d ago
-
Machine Learning Associate Advisor - HIH - Evernorth INR 2500K-3000KAPI Integration | Artificial Intelligence | Authentication | C# | C++Flexible hours | Remote work flexibilityMid-level Full TimeHIH - Hyderabad, India R1d ago
-
A/B | A/B Testing | AWS | Apache Spark | B testingFlexibility programmes | Hybrid work environment | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeMumbai Goregaon, India1d ago