Staff Big Data Engineer
Tasks
- Conduct technical reviews architecture governance
- Define data platform technical vision
- Design scalable data processing systems
- Identify troubleshoot data platform performance bottlenecks
- Implement event driven streaming architectures
- Lead architecture decisions across teams
- Maintain high availability data pipelines
- Mentor engineers distributed systems performance optimization
- Research evaluate recommend data processing technologies
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Lambda | Apache Airflow | Apache Flink | Apache Kafka | Apache Solr | Apache Spark | Benchmarking | Cassandra | Data Lake | Distributed Caching | Elasticsearch | Event Driven | Event-driven architecture | Hadoop | Linux | Machine Learning | Oracle Database | Performance Tuning | Redis | Streaming Data | Trino
Education
Related jobs
-
Mid-level Full TimeBangalore, KA, IN R9h ago
-
Senior-level Full TimeIndia - Bengaluru; India - Pune1d ago
-
Manager - Senior AI/ML Engineer INR 3000K-5000KAPI Design | AWS | Agent Orchestration | Agent systems | Asynchronous Workflows401k match | Dental insurance | Health insurance | Paid time off | Vision insuranceSenior-level Full TimePune, IN R1d ago
-
Senior Software Engineer - Search INR 2500K-4200KInformation Retrieval | Language Models | Language Processing | Large Language Models | Machine LearningSenior-level Full TimeBengaluru, India2d ago
-
Senior Software Engineer - Data Platform INR 2500K-3584KAWS | Agentic AI | Apache Airflow | Apache Druid | Apache FlinkAccident insurance | Commuter benefits | Dental insurance | Disability insurance | Financial wellness supportSenior-level Full TimeBengaluru, India R2d ago
-
Mid-level Full TimeChennai, Tamil Nadu, India2d ago
-
Senior-level Full TimeBengaluru - GTP, India2d ago
-
Senior-level Full TimeChennai, Tamil Nadu, India2d ago
-
Data Engineering Manager - GCP INR 1500K-2500KAirflow | Apache Spark | BigQuery | CI/CD | Cloud ComposerSenior-level Full TimeHyderabad, TS, India2d ago
-
Senior-level Full TimeHyderabad, Noida, Chennai, India2d ago
-
DATA Architect - Lead Systems Engineer INR 2771K-4132KAgile | Apache Airflow | Apache Kafka | Apache Spark | Audit LoggingSenior-level Full TimeIndia2d ago
-
Lead Salesforce Full Stack AI Engineer INR 3715K-5449KAPI Design | Agile | Apex | Automated testing | Azure DevOpsFlexible schedule | Generous vacation days | Health coverage | Parental leave | Volunteer timeSenior-level Full TimeBangalore, India2d ago
-
AI Foundry | AWS | AWS SageMaker | Agentic AI | Amazon Bedrock401k match | Career development resources | Dental insurance | Flexible work arrangements | Health Savings Account medical planSenior-level Full TimeIndia2d ago
-
Engineer, Storage and Data Protection INR 1500K-2600KAlerting | Ansible | Automation | Backup | BashMid-level Full TimeGurugram, Haryana2d ago
-
AWS Glue | AWS Lambda | AWS Step Functions | Amazon EC2 | Amazon EMRSenior-level Full TimeNoida, India2d ago
-
Senior-level Full TimeGurugram, India2d ago
-
Mid-level Full TimeHyderabad, India2d ago
-
Senior Forward Deployed Engineer INR 1500K-2800KAI APIs | AWS | Apache Spark | Azure | CI/CDCustomer-facing role | Travel 20 percent of the timeSenior-level Full TimeBengaluru, India2d ago
-
Senior Software Engineer, AI/ML INR 2000K-5000K3D mathematics | Agent systems | Autonomous Agents | C plus plus | Computational GeometrySenior-level Full TimeBengaluru, Karnataka, India2d ago
-
Senior Software Engineer - BLR/HYD INR 2000K-4500KArtificial Intelligence | Cloud services | Debugging | Distributed Systems | Machine LearningSenior-level Full TimeIndia, Karnataka, Bangalore; India, Telangana, Hyderabad2d ago
-
Senior Data Engineer INR 3000K-4000KAmazon Web Services | Apache Spark | Cloud platform | Continuous Delivery | Data GovernanceSenior-level Full TimeBangalore, India; Chennai, India; Hyderabad, India; …2d ago
-
Data Engineer (GCP, Azure) INR 1500K-2500KAmazon Web Services | Apache Kafka | Apache Spark | Cloud platform | Data PipelinesSenior-level Full TimePune, Maharashtra, India2d ago
-
Applied AI/ML Senior Associate INR 2817K-4680KApache Hive | Apache Spark | Keras | Language Processing | Machine LearningSenior-level Full TimeBengaluru, Karnataka, India3d ago
-
Software Engineer - Workflow INR 3715K-5000KAWS | Apache Flink | Apache Kafka | Apache Spark | AzureSenior-level Full TimeIndia (Bengaluru)3d ago
-
Member of Technical Staff INR 3242K-4580KConcurrency | Containerization | Go | Idempotency | KubernetesCompany-sponsored team events | Flexible time off | Wellness resourcesSenior-level Full TimeBangalore, India3d ago