Principal Engineer (Big Data Engineer)
Bengaluru, KA, India
R
INR 2800K-4500K (estimate) Senior-level Full Time
Tasks
- Build data pipelines
- Compare technologies for best fit
- Create architecture and design documents
- Define non-functional requirements
- Define process flows
- Design complex data mappings
- Design message broker architecture
- Design system architecture
- Develop ETL to consumption flows
- Develop solution for functional and non functional requirements
- Gather and analyze requirements
- Implement event sourcing
- Lead technical team
- Perform performance tuning
- Resolve issues with root cause analysis
- Review architecture for scalability security and extensibility
- Troubleshoot complex bugs
- Write and review code
Perks/Benefits
Skills/Tech-stack
Amazon Web Services | Apache HBase | Apache Spark | Cassandra | Cloud platform | Data Mapping | Data pipeline | Design Patterns | ETL | Event Sourcing | Extensibility | Functional Requirements | Google Cloud | Google Cloud Platform | Java | MS SQL | Message Broker | Microsoft Azure | Non-functional Requirements | Non-functional) | Performance Tuning | PySpark | Scala | Scalability | Security | System design | Troubleshooting | Web Services
Education
N/A
Related jobs
-
Data Engineer (MS) (Remote) INR 2040K-3380KCI/CD | Data Transformation | Data Validation | Date normalization | ETLMentorship opportunities | Professional growth | Remote workSenior-level Full TimeMaharashtra, Pune, India R7h ago
-
ML / LLM Engineer (Remote) INR 2500K-3000KAmazon Web Services | Azure | Classification | Feature Engineering | Language ModelsRemote workMid-level Full TimeMaharashtra, Pune, India R7h ago
-
Data Operations Engineer INR 2040K-3380KApache Airflow | Data Pipelines | Data Refresh | Data Warehousing | Data pipelineEmergency incident response support | On-call rotationSenior-level Full TimeBengaluru, INDIA, India R15h ago
-
Computer Scientist ( Java Backend ) INR 3000K-4725KApache Kafka | CI/CD | Distributed Systems | Docker | Event DrivenSenior-level Full TimeBangalore, India R21h ago
-
Business Technology Analyst INR 3000K-4000KAWS | AWS Athena | AWS Glue | Airflow | Amazon RedshiftHeadspace access | Hybrid work | Mental health days | Retirement savings | Tuition reimbursementSenior-level Full TimeIndia, Hyderabad, Telangana R21h ago
-
Software Engineer INR 1500K-2362KAWS | Apache Flink | Apache Spark | Linux | PythonHybrid work | Remote work | Work-life balanceMid-level Full TimeRemote (IND), India R21h ago
-
Tech Lead - Gen AI with 6+ Years(Remote) INR 2500K-5000KAWS | Chatbot | Computer Vision | Dialogue flow | Distributed ComputingRemote workSenior-level Full TimeBengaluru, KA, India R1d ago
-
Software Development Engineer I INR 2139K-4500KCI/CD | Code review | Data Structures | Data Structures and Algorithms | ElasticsearchProfessional development | Remote workSenior-level Full TimeBengaluru, KA, India R1d ago
-
Senior DevOps Engineer INR 2000K-4000KAWS | AWS Lambda | Agile | Amazon CodeDeploy | Amazon LinuxGreat place to work | Remote workSenior-level Full TimeBengaluru, KA, India R1d ago
-
Senior DevOps Engineer INR 2000K-4000KAWS | AWS CodeDeploy | AWS Lambda | AWS SDK | AgileGreat place to work | PradeepIT Academy training | Remote workSenior-level Full TimeBengaluru, KA, India R1d ago
-
Senior DevOps Engineer INR 2000K-4000KAWS | AWS Lambda | Agile | Amazon Linux | AnsibleRemote work opportunitySenior-level Full TimeBengaluru, KA, India R1d ago
-
Senior DevOps Engineer INR 2000K-4000KAWS | AWS CodeDeploy | AWS Lambda | AWS SDK | AgileRemote workSenior-level Full TimeBengaluru, KA, India R1d ago
-
Senior DevOps Engineer INR 2000K-4000KAWS | AWS CodeDeploy | AWS Lambda | Agile | Amazon LinuxCareer acceleration | Remote work | Training and academy coursesSenior-level Full TimeBengaluru, KA, India R1d ago
-
Pyspark & Databricks certified Developer INR 1632K-2300KAWS | Apache Spark | Azure | Azure Databricks | Data IngestionRemote workSenior-level Full TimeMumbai, MH, India R1d ago
-
Oracle + PySpark Data Engineer (Remote) INR 1500K-2500KData Modeling | Data Quality | Data Warehousing | Distributed Computing | ETLDocumentation support | Remote workMid-level Full TimeBengaluru, KA, India R1d ago
-
Lead Software Engineer (Big Data and Azure) INR 2040K-3500KAgile | Apache Kafka | Apache Spark | Apache Storm | Azure BlobCareer growth | Great Place to Work certification | Remote work | Training coursesSenior-level Full TimeBengaluru, KA, India R1d ago
-
Senior-level Full TimeBengaluru, KA, India R1d ago
-
HVR Data Engineer|3-5 Years Exp|Remote INR 1500K-2000KAWS | Azure | Data Quality | ETL | HVRRemote work | Shift work supportMid-level Full TimeBengaluru, KA, India R1d ago
-
Devops Engineer INR 2000K-3900KAirflow | Angular | Apache Tomcat | Bootstrap | GitLabGreat Place to Work certification | Remote work | Training programsSenior-level Full TimeBengaluru, KA, India R1d ago
-
Dataops Engineer or database administration | Permanent Remote INR 1400K-2000KAWS | Amazon S3 | Ansible | Azure | CI/CDRemote workMid-level Full TimeBengaluru, KA, India R1d ago
-
Senior-level Full TimeBengaluru, KA, India R1d ago
-
Cloud Engineer INR 2200K-3500KAmazon Web Services | Configuration Management | Deployment Tools | Docker | Infrastructure as CodeRemote work flexibility | Training opportunitiesSenior-level Full TimeBengaluru, KA, India R1d ago
-
Big Data & GCP- Senior Software Engineer INR 2000K-3900KAgile | BigQuery | BigQuery SQL | Cloud Storage | Cloud platformGreat place to work | Remote work flexibilitySenior-level Full TimeBengaluru, KA, India R1d ago
-
AWS Developer INR 1800K-3500KAPI Gateway | Amazon Web Services | CI/CD | Cloud Security | CodeBuildRemote workSenior-level Full TimeBengaluru, India R1d ago
-
Snowflake Data Platform Lead(India) (Remote) INR 1500K-2000KAPIs | AWS | Access Control | Alerting | AzureSenior-level Full TimeMaharashtra, Pune, India R1d ago