Senior Big Data Engineer
Tasks
- Build data pipeline architecture
- Debug data processing issues
- Design data platform components
- Develop best practices
- Establish engineering standards
- Maintain system documentation
- Mentor engineers
- Operate data platform systems
- Optimize Kafka pipelines
- Tune Spark jobs
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Kafka | Apache Spark | Data Engineering | Distributed Systems | High Throughput | High-Throughput Systems | Java | Pipeline Optimization | Python | Scala | System Documentation
Education
Related jobs
-
Mid-level Full TimeHaveli, India1h ago
-
Mid-level Full TimeHyderabad, India2h ago
-
Senior-level Full TimeGurugram, Haryana, India3h ago
-
Senior-level Full TimeIN-TN-Chennai3h ago
-
Senior-level Full TimeIN-AP-Hyderabad3h ago
-
Senior Artificial Intelligence/Machine Learning Engineer INR 3000K-5000KAPI Integrations | Agentic AI | Alerting | Atlassian Bamboo | Atlassian BitbucketCompany-paid certifications | Financial consultations | Language courses | Legal consultations | Medical insuranceSenior-level Full TimeIndia4h ago
-
Associate - Data Scientist INR 1500K-2500KAmazon Web Services | Apache Spark | Artificial neural networks | Chunking | DatabricksMid-level Full TimeGurugram, Haryana, India5h ago
-
Staff Software Engineer, AI/ML GenAI, Google Ads INR 2000K-5000KC++ | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeBengaluru, Karnataka, India5h ago
-
Staff Software Engineer, Cloud AI INR 2500K-5000KAPI Gateways | API Management | Agentic AI | C++ | Cloud ArchitectureSenior-level Full TimeHyderabad, Telangana, India5h ago
-
Azure Data Engineer INR 1500K-2500KAzure Cloud | Azure Cloud Platform | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeHyderabad, Telangana, India5h ago
-
Senior Artificial Intelligence/Machine Learning Engineer INR 3000K-5000KAPIs | Agentic AI | Apache Flink | Apache Spark | CI/CDCompany-paid certifications | Financial consultations | Language courses | Legal consultations | Medical insuranceSenior-level Full TimeIndia6h ago
-
Data & Analytics Engineer - AM INR 1500K-2700KApache Spark | Data Modeling | Data Warehousing | Databricks | Delta LakeSenior-level Full TimeBangalore, Karnataka, India6h ago
-
Senior Artificial Intelligence/Machine Learning Engineer INR 2500K-4800KAWS | Agent Frameworks | Agent systems | Autogen | CI/CDCompany-paid certifications | Financial consultations | Language courses | Legal consultations | Medical insuranceSenior-level Full TimeIndia6h ago
-
Lead Software Engineer Java INR 2500K-4000KAPI Gateway | AWS Glue | AWS Lambda | AWS OpenSearch | AWS SageMakerSenior-level Full TimeBengaluru, Karnataka, India7h ago
-
Data and Analytics Engineer , Enablement INR 3000K-4000KApache Spark | Azure Data | Azure Data Platform | CI/CD | Data AnalysisDocumentation enablement content creation | Mentoring and onboarding supportSenior-level Full TimeMumbai, Maharashtra, India7h ago
-
Data and Analytics Engineer , Enablement INR 3000K-4000KAgile | Apache Spark | Data Governance | Data Modeling | Data VisualizationSenior-level Full TimeMumbai, Maharashtra, India7h ago
-
Data and Analytics Engineer , Enablement INR 3000K-4000KAgile | Apache Spark | Azure Data | Azure Data Platform | CI/CDSenior-level Full TimeMumbai, Maharashtra, India7h ago
-
Data and Analytics Engineer , Enablement INR 3000K-4000KCI/CD | Data Analysis | Data Modeling | Databricks | Exploratory Data AnalysisMid-level Full TimeMumbai, Maharashtra, India7h ago
-
Software Engineer III - Data Lake INR 2000K-3100KAWS | AWS Glue | Agile methodologies | Amazon S3 | Apache CassandraSenior-level Full TimeHyderabad, Telangana, India9h ago
-
Senior Software Engineer INR 3264K-4720KAI Engineering | Best practices | Business Intelligence | Cloud Computing | Data ArchitectureFamily support benefits | Flexible working options | Health benefits | Paid time off | Retirement benefitsSenior-level Full TimeIndia9h ago
-
Staff Software Engineer - Database Engineering INR 2771K-4064KAmazon Aurora | Ansible | Cassandra | Citus | Configuration ManagementSenior-level Full TimeBangalore, India R9h ago
-
GCP Data Engineering Bangalore INR 2800K-4000KApache Spark | Cloud platform | ETL | Google Cloud | Google Cloud PlatformSenior-level Full TimeBangalore, Karnataka, India9h ago
-
Senior-level Full TimeBengaluru, KA, India10h ago
-
Software Engineer III INR 2500K-4200KAWS CloudFormation | AWS Glue | AWS IAM | AWS Lambda | Amazon AthenaAgile team collaboration | Automated testing and code review support | Secure and stable engineering environmentSenior-level Full TimeHyderabad, Telangana, India10h ago
-
APIs | Agent workflows | C++ | Caching | CancellationSenior-level Full TimeBengaluru, India10h ago