Senior Big Data Engineer
Tasks
- Decompose complex problems
- Design data pipelines
- Develop scalable distributed SaaS systems
- Document requirements
- Drive technology explorations and roadmaps
- Ensure architecture and design quality
- Mentor engineers
- Prototype data platform features
- Provide technical leadership
- Research and benchmark cloud technologies
- Support data platform and services
Perks/Benefits
Skills/Tech-stack
Agile | Apache Airflow | Apache Flink | Apache Kafka | Apache Spark | Architecture Design | Cassandra | Data Infrastructure | Data Lakes | Elasticsearch | Hadoop | Java | Kappa Architecture | Lambda Architecture | Machine Learning | Microservices | NoSQL | OO modeling | Oracle | Performance Benchmarking | Performance Testing | Presto | Queue | RDBMS | Redis | Rule engines | Scala | Scrum | Secure Data | Secure data infrastructure | Solr | Troubleshooting | Unix
Education
Related jobs
-
Lead AI/ML Engineer – Security AI & LLMs INR 3000K-5000KAPI Design | AWS SageMaker | Azure ML | Deep learning | DockerSenior-level Full TimePune, Maharashtra, India4h ago
-
Node JS Developer - Senior Consultant INR 2200K-3500KAWS OpenSearch | Agile | Apache Kafka | Bull queue | CI/CDSenior-level Full TimeBangalore, IN, 5600666h ago
-
Tech Lead - Java (Java, React, Kong) INR 1500K-3000KAPI Development | API Gateway | API Management | API Security | AgileSenior-level Full TimePune, IN, 4110576h ago
-
Data Analytics/Engineer (Python and MS Fabric exp) INR 2500K-4720KAWS | Apache Airflow | Azure Data | Azure Data Factory | Azure SynapseCross-functional collaboration | Mentorship | Professional developmentSenior-level Full TimeIND-Pune-Smartworks, India12h ago
-
AI Architect INR 3000K-5000KAPIs | Artificial Intelligence | Cloud Computing | Data Management | Data integrationSenior-level Full TimeMumbai (ex Bombay), IN12h ago
-
AWS S3 | Amazon Redshift | Amazon Web Services | Apache Spark | Azure DataSenior-level Full TimeBengaluru Millenia, India12h ago
-
Snowflake Data Engineer INR 2000K-2600KAmazon Web Services | Apache Spark | Bitbucket | CI/CD | Cloud platformSenior-level Full TimeBangalore, KA, IN12h ago
-
Senior-level Full TimeBangalore, KA, IN12h ago
-
Senior-level Full TimeBangalore, KA, IN12h ago
-
Senior-level Full TimeBengaluru, KA, IN12h ago
-
AWS | Autogen | Azure | BERT | Computer VisionCollaborative team environment | Continuous learning | Professional growthMid-level Full TimeIndia21h ago
-
Member of Technical Staff - AI/ML Engineer INR 2500K-4500KAnomaly Detection | BM25 | Computer Vision | Document Understanding | Entity ResolutionEquity | Professional developmentSenior-level Full TimeHyderabad, TS, IN21h ago
-
AI-Native Software Developer INR 2500K-4000K.NET | AI Evaluation | AI Orchestration Framework | AI guardrails | AI orchestrationMid-level Full TimeBangalore - Karnataka - India22h ago
-
Software Engineer, BizTech(Python, LLM, GenAI, MCP) INR 2380K-3400KAI Agents | AI Assisted Development | API Design | AWS | ClaudeMid-level Full TimeBangalore, India23h ago
-
Senior-level Full TimeIN-AP-Hyderabad23h ago
-
Senior-level Full TimeIN-AP-Hyderabad23h ago
-
Senior-level Full TimeIN-TN-Chennai23h ago
-
Senior-level Full TimeIN-HR-Gurgaon23h ago
-
Senior Machine Learning Engineer INR 3584K-4580KAWS | Azure | CI/CD | Data Science | DatabricksLearning and development programs | Mentorship culture | Remote workSenior-level Full TimeBangalore, India R1d ago
-
Senior Machine Learning Engineer INR 3584K-4580KAmazon Web Services | Azure | CI/CD | Cloud platform | DatabricksCoaching and mentoring | Employee development programs | Learning and development programs | Remote work flexibilitySenior-level Full TimeBangalore, India R1d ago
-
Apache Kafka | Distributed Systems | Java | Kafka Connect | Kafka ProducersCollaborative environment | Long term role | Mission-driven work | Remote workMid-level Full TimeIndia1d ago
-
Mid-level Full TimeBangalore, Karnataka, India1d ago
-
AI Data Engineer III INR 3000K-4000KAgile | Amazon Web Services | Apache Airflow | CI/CD | DBTComprehensive insurance | Education assistance program | Fitness benefits | Flexible working hours | Health checkupsSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Staff Data Engineer INR 3000K-4132KAWS | Agile | Amazon Redshift | Amazon S3 | Apache AirflowEducation assistance | Fitness benefits | Flexible working hours | Health checkups | Health insuranceSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Mid-level Full TimeBangalore, Karnataka, India1d ago