Principal Engineer (Big Data Engineer)
Bengaluru, KA, India
R
INR 2800K-4500K (estimate) Senior-level Full Time
Tasks
- Build data pipelines
- Compare technologies for best fit
- Create architecture and design documents
- Define non-functional requirements
- Define process flows
- Design complex data mappings
- Design message broker architecture
- Design system architecture
- Develop ETL to consumption flows
- Develop solution for functional and non functional requirements
- Gather and analyze requirements
- Implement event sourcing
- Lead technical team
- Perform performance tuning
- Resolve issues with root cause analysis
- Review architecture for scalability security and extensibility
- Troubleshoot complex bugs
- Write and review code
Perks/Benefits
Skills/Tech-stack
Amazon Web Services | Apache HBase | Apache Spark | Cassandra | Cloud platform | Data Mapping | Data pipeline | Design Patterns | ETL | Event Sourcing | Extensibility | Functional Requirements | Google Cloud | Google Cloud Platform | Java | MS SQL | Message Broker | Microsoft Azure | Non-functional Requirements | Non-functional) | Performance Tuning | PySpark | Scala | Scalability | Security | System design | Troubleshooting | Web Services
Education
N/A
Related jobs
-
Senior Data Engineer with Azure (ADF/Fabric/Synapse), SQL, Data modeling, ETL/ELT, Python/PySpark INR 3000K-4000KApache Airflow | Azure Data | Azure Data Factory | Azure DevOps | Azure SynapseHybrid schedule | Onsite interview requirementSenior-level Full TimeIND-Pune-Smartworks, India R18h ago
-
SQL,GCP/Consultant Specialist INR 500K-1500KAWS | Agile Scrum | Backup and Recovery | Cloud Computing | Cloud Platform (GCPMid-level Full TimePune, Maharashtra, India R1d ago
-
Technical Lead (Data) - India INR 2500K-4000KAPI Design | AWS | Amazon RDS | Amazon Redshift | Cloud servicesDigital first collaboration | Flexible work in office locations | Remote work optionsSenior-level Full TimeIndia R1d ago
-
Mid-level Full TimeBangalore, India Office (BANGALORE) R1d ago
-
Senior Software Developer (C++) - StorageGrid INR 2000K-3500KAWS S3 | Agile | C++ | CQL | CassandraSenior-level Full TimeBangalore, India Office (BANGALORE) R1d ago
-
Automation and AI Solutions INR 2755K-3584KAWS Agent | AWS Agent Core | AWS Bedrock | Agent core | Agent tracingCareer development | Continuous learning | Flex My Way policy | Hybrid work model | Work from anywhere up to 8 weeks per yearMid-level Full TimeIndia, Bengaluru, Karnataka R1d ago
-
Machine Learning Lead Analyst - HIH - Evernorth INR 2500K-3500KAWS | Authentication | Azure | C# | C++Cross-functional collaboration | Professional growth | Remote work flexibilitySenior-level Full TimeHIH - Hyderabad, India R1d ago
-
Computer Scientist - 1 INR 3264K-5560KCloud services | Databases | Distributed Systems | GenAI | HibernateSenior-level Full TimeBangalore, India R1d ago
-
Mid-level Full TimeNoida, India R1d ago
-
Specialist Cloud Database Engineer INR 2500K-3000KAWS CloudFormation | AWS RDS | Agile | AlwaysOn Availability | AlwaysOn availability groupsFlexible schedule | Hybrid work model | Remote workSenior-level Full TimeIndia - Pune R2d ago
-
Data Science Lead (India) (Remote) INR 2500K-5000KAWS | AWS Bedrock | AutoEncoder | Azure OpenAI | CNNSenior-level Full TimeMaharashtra, Pune, India R2d ago
-
AI Observability | AWS | Azure | CI/CD | DockerCareer advancement | Flexible work environment | Fully remote | Professional development | Work-life balanceSenior-level Full TimeIndia R4d ago
-
Java Full Stack Engineer - Professional INR 1300K-2200KAmazon Web Services | Apache Kafka | AppDynamics | Automation | Cause analysisClient office work requirement | Hybrid work modelMid-level Full TimeIndia R4d ago
-
Vice President - Principal Data Engineer INR 3584K-5500KAPI | AWS | Agile | Anomaly Detection | AzureComprehensive healthcare | Flexible time off | Hybrid work model | Retirement plan | Support for working parentsSenior-level Full TimeM11 - Commers III, 43, 44 … R4d ago
-
Senior Data Platform Support Engineer -GCP Certified INR 3000K-3500KAirflow | Bash | BigQuery | CI/CD | Cloud ComposerHybrid work modelSenior-level Full TimePune, India R4d ago
-
Staff Software Engineer - Database INR 1500K-2500KAmazon Web Services | Apache Calcite | Apache Hive | Cloud platform | Database InternalsCareer development access | Employee resource groups | Flexible WFH | Generous PTO | Phone and internet reimbursementSenior-level Full TimeIndia-Bangalore-Remote R4d ago
-
AI Engineer INR 3000K-5876KAgent systems | Amazon Web Services | Azure | C++ | Cloud NativeRemote-first environment | Travel opportunitiesSenior-level Full TimeBengaluru, Karnataka, India R4d ago
-
AI Development Engineer - contractual role INR 3000K-5000KAPI Integration | Audio Processing | Benchmarking | Deep learning | EvaluationContinuous learning | High-impact work | Proximity talks | World class team collaborationMid-level Full TimeIndia - Remote R4d ago
-
Senior .NET AI Engineer- 3188 (Remote) INR 2500K-4500K.NET | Azure | C# | Distributed Systems | Event DrivenFlexible working hours | L and D programs | Remote work | Rewards and recognition | Work-life balanceSenior-level Full TimeChennai, India R5d ago
-
Applied AI Solution Architect INR 3000K-4500KAI/ML | API Development | AWS Bedrock | AWS SageMaker | Agent memoryContinuous improvement culture | Ownership | Remote workSenior-level Full TimeIndia-Remote R5d ago
-
Data Engineer INR 1500K-2000KAWS | AWS Lambda | Amazon EC2 | Amazon EMR | Amazon RedshiftLearning and development programs | Multicultural experience | Professional growthMid-level Full TimeIndia R5d ago
-
Data Engineer INR 1500K-2000KAWS | AWS Lambda | Amazon EC2 | Amazon EMR | Amazon RedshiftCollaborative culture | Learning and development | Multicultural experience | Professional growthMid-level Full TimeIndia R5d ago
-
Azure | Azure AI | CI/CD | Kubernetes | LLMOpsCollaborative engineering culture | Flexible work arrangements | Inclusive and diverse work environment | Learning and growth opportunities | Remote-friendlySenior-level Full TimeIndia R5d ago
-
Solutions Architect INR 2400K-3500KADLS | AWS | Airflow | Apache Spark | AzureBroadband reimbursement | Medical insurance | Paid certifications | Paid training bootcamp | Professional development allowanceSenior-level Full TimeIndia - Remote R5d ago
-
Principal Solutions Architect - Data Engineering INR 3000K-3880KADLS | AWS | Agile | Airflow | Apache FlinkBonuses for approved content | Broadband reimbursement | Medical insurance | Paid certifications | Professional development allowanceSenior-level Full TimeIndia - Remote R5d ago