Senior Staff Engineer, Big Data
Tasks
- Contribute to documentation and knowledge sharing
- Design data pipelines for large-scale processing
- Identify risks dependencies bottlenecks
- Mentor team members
- Optimize data pipelines
- Participate in design discussions
- Perform code reviews
- Translate requirements into scalable solutions
Perks/Benefits
Skills/Tech-stack
AWS | Agile | Apache Airflow | Apache Hadoop | Apache Hive | Apache Kafka | Apache Spark | Apache Spark SQL | Azure | Cloud platform | Confluence | Data Lake | Data Quality | Data Warehousing | Docker | Git | Google Cloud | Google Cloud Platform | Integration Testing | Jenkins | Jira | Kubernetes | Maven | Oozie | Query Tuning | SBT | SQL | Scala | Spark SQL | Spark Streaming | Unit Testing | YARN
Education
Related jobs
-
Data Engineer INR 1500K-2000KADLS | AWS | Airflow | Azure | DBTBonuses | Broadband reimbursement | Medical insurance | Paid certifications | Professional development allowanceMid-level Full TimeIndia - Remote R4h ago
-
AI Engineer INR 950K-1050KAWS | Airflow | Algorithms | Apache Spark | Data StructuresGlobal team collaboration | Hybrid workMid-level Full TimeBengaluru, INDIA, India5h ago
-
Associate Data Engineer INR 1000K-1250KApache Airflow | Apache Flink | Apache Spark | Autogen | DagsterEducation reimbursement | Health plans | Hybrid work | In-office perks | Parental leaveMid-level Full TimeBangalore, IND; Mohali, IND; Pune, IND5h ago
-
Mid-level Full TimeRemote, India R6h ago
-
Sr ML & AI Engineer INR 2940K-4500KAPIs | Amazon Web Services | Data Preprocessing | Deep learning | Distributed ComputingContinuous learning and professional growth | Flexible working arrangementsSenior-level Full TimeMumbai, India7h ago
-
Sr Software Engineer INR 3050K-4350KAWS | Amazon Web Services | Best practices | Cloud Computing | DebuggingCross-functional team projects | Learning and development | Online learning campus | Training coursesSenior-level Full TimeMumbai, India7h ago
-
Engineer II, Quality Engineering INR 1340K-1890KAPI Testing | AWS | Amazon Redshift | BigQuery | CI/CDContinuous learning | Family-friendly perks | Financial wellness programs | Flexible time off | Health care coverageMid-level Full TimeIN - NOIDA CANDOR TECHSPACE SECTOR …11h ago
-
Data Engineer INR 400K-700KAI | API Integration | Alteryx | Automated testing | CI/CDCareer development | ESG initiatives | Employee incentive programs | Employee wellbeing resources | Flexible vacationEntry-level Full TimeIndia, Bengaluru, Karnataka R11h ago
-
Software Engineer, Data Platform INR 800K-1200KAPI | API Gateway | AWS | Agile | CI/CDCareer development | Headspace access | Hybrid work model | Mental health days | Paid volunteer daysMid-level Full TimeIndia, Bengaluru, Karnataka R11h ago
-
Advanced Data Scientist INR 2040K-2600KBayesian Inference | CI/CD | Causal Inference | Computer Vision | Data QualitySenior-level Full TimeBangalore, KA, IN, 56006611h ago
-
Senior Application Developer, AI INR 2500K-3500KAI Foundry | AI Studio | AWS | Authentication | AzureSenior-level Full TimeHyderabad, Telangana, India11h ago
-
Lead Data Scientist- Content Creation INR 2516K-3356KApache Spark | CI/CD | Computer Vision | Deep learning | Diffusion ModelsSenior-level Full TimeBangalore,India11h ago
-
Mid-level Full TimeBangalore, KA, IN11h ago
-
Senior Data Governance Engineer INR 2520K-3380KABAC | Access Management | Agile | Alation | AtlanFlexible work options | Life leave | Professional development days | Retirement savings options | Vacation time that increases with tenureSenior-level Full TimePune, MH, India11h ago
-
Intermediate Data Engineer INR 1000K-1250KAWS | Agile | DBT | Data Governance | Data ModelingCorporate bonus program | Flexible work options | Life leave days | Professional development days | Retirement savings optionsMid-level Full TimePune, MH, India11h ago
-
AI ML Tech Lead INR 2500K-5000KAWS Lambda | AWS SageMaker | AWS Step Functions | Amazon ECS | Amazon EventBridgeComprehensive benefits packages | Corporate bonus program | Flexible work options | Life leave days | Professional development daysSenior-level Full TimePune, MH, India11h ago
-
Data Governance Engineer INR 1068K-1680KABAC | Alation | Atlan | Azure Purview | BigQueryFlexible work options | Life leave days | Professional development days | Retirement savings options | Vacation timeMid-level Full TimePune, MH, India12h ago
-
Security Engineer (Automation & AI) INR 2500K-5000KAPI Security | AWS | Application Security | Azure | CI/CDDental insurance | Flexible time off | Health insurance | Health stipends | Learning opportunitiesSenior-level Full TimeIndia R17h ago
-
Senior-level Full TimeHyderabad, India17h ago
-
.NET | Anomaly Detection | Bash | C# | CI/CDSenior-level Full TimeBengaluru, INDIA, India20h ago
-
API Gateway | AWS Bedrock | AWS CloudFormation | AWS Lambda | Access ControlCareer development | Hybrid work environment | Mentoring support | MentorshipSenior-level Full TimeBengaluru, INDIA, India20h ago
-
AI Engineer INR 2520K-3800KAI Agents | AI Foundry | APIs | Azure | Azure AIBirthday off | Flexible working hours | Flexible working optionsSenior-level Full TimeGurgaon20h ago
-
Associate Principal Engineer, Google Analytics Implementation INR 1000K-1200KData Governance | Data Layer | Data Quality | Data Quality Validation | GA360Mid-level Full TimeRemote, India R21h ago
-
Mid-level Full TimePune City, India21h ago
-
AI Native Full stack Developer - #2896 INR 1500K-1700K.Net Core | ASP.NET | AWS Lambda | Agile | Amazon EC2Cross-functional collaboration | Mentorship | Technical coachingMid-level Full TimeChennai, India21h ago