Principal Engineer – Data Platform & Backend
APAC - India - Bengaluru - Sunriver
INR 3000K-4401K (estimate) Senior-level Full Time
Tasks
- Build batch data processing
- Build data intensive backend services
- Build event driven data processing
- Build real-time data processing
- Define ETL ELT standards
- Define streaming data standards
- Design data pipelines
- Develop data ingestion and transformation layers
- Ensure data quality and validation
- Implement lakehouse design
- Implement observability and monitoring
- Implement schema evolution
- Lead Data platform architecture
- Maintain metadata management
- Manage data contracts and lineage
- Mentor engineers and raise engineering bar
- Optimize data platform performance and reliability
- Orchestrate data workflows
- Own data modeling and governance
- Plan technical roadmap and modernization
- Reduce technical debt
- Serve data via APIs and integrations
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Amazon Kinesis | Apache Airflow | Apache Flink | Apache Iceberg | Apache Spark | Azure | Backend Engineering | CI/CD | DBT | Dagster | Data Governance | Data Lineage | Data Modeling | Data Validation | Databricks | Delta Lake | Distributed Systems | ELT | ETL | Event Driven | Event-driven architecture | Fivetran | Kafka | Microservices | Observability | Python | REST APIs | SQL | Snowflake
Education
Related jobs
-
Senior .NET AI Engineer- 3188 (Remote) INR 2500K-4500K.NET | Azure | C# | Distributed Systems | Event DrivenFlexible working hours | L and D programs | Remote work | Rewards and recognition | Work-life balanceSenior-level Full TimeChennai, India R15h ago
-
Senior-level Full TimeBangalore, India Office (BANGALORE)16h ago
-
ETL Tester INR 1500K-2500KData Mapping | Data Quality | Data Reconciliation | Data Transformation | Data WarehouseSenior-level Full TimeChennai, India16h ago
-
Mid-level Full TimeIN-KA-Bangalore17h ago
-
AI Engineer with RAG / MCP INR 1500K-2500KDocument processing | LLMs | Microservices | Prompt engineering | PythonMid-level Full TimeIN-AP-Hyderabad17h ago
-
Senior-level Full TimeIN-TN-Chennai17h ago
-
Data Engineer INR 1500K-2500KApache Hive | Apache Kafka | Apache Spark | Azure Data | Azure Data FactorySenior-level Full TimeIN-KA-Bangalore17h ago
-
Apache Beam | Apache Flink | Apache Kafka | Apache Spark | Google DataflowMid-level Full TimePune, Maharashtra, India17h ago
-
Data Bricks Infra Engineer INR 1500K-2500KAccess Control | Caching | Data Governance | Databricks | Databricks SQLWork from office 5 days per weekSenior-level Full TimeGurugram, Haryana, India18h ago
-
Software Engineer INR 2000K-3300KAKS | Angular | App Service | Azure | Azure AppEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India19h ago
-
Senior-level Full TimeBangalore, Karnataka, India19h ago
-
Associate Software Engineer - Scala and spark INR 1500K-2000KAgile | Apache Spark | CI/CD | Databricks | GitHubEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India19h ago
-
Semantic Data Engineer INR 2520K-3500KAmazon Redshift | Apache Airflow | Apache Superset | BigQuery | Cube.devSenior-level Full TimeNoida,Uttar Pradesh,India19h ago
-
Sr. Data Engineer INR 1500K-2500KACID | Amazon Redshift | Amazon S3 | Apache Kafka | Azure DataWork from office 5 days per weekSenior-level Full TimeBengaluru, Karnataka, India19h ago
-
AI/ML Developer INR 1500K-2500KAzure | Cloud Computing | Cloud platform | Data Preprocessing | Deep learningMid-level Full Timebangalore, India19h ago
-
Principal Software Engineer - AI Platform INR 2515K-3500KAgile | Apache Airflow | CI/CD | Cloud Native | Data AnalysisFlexible medical benefits | Life insurance | Retirement options | Volunteer programsSenior-level Full TimeIndia19h ago
-
Senior Software Engineer (Java/Python) INR 2200K-4000KAPI Gateway | AWS CLI | AWS Lambda | Amazon CloudWatch | Amazon DynamoDBSenior-level Full TimeHyderabad, India20h ago
-
Consultant - Python Developer with Gen AI and AI Foundry INR 2000K-4500KAWS | Autogen | Azure | Azure OpenAI | ClaudeSenior-level Full TimeBangalore, Karnataka, India21h ago
-
Senior Azure Data Engineer INR 1500K-2500KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimePune, Maharashtra, India21h ago
-
Mid-level Full TimeBengaluru, India21h ago
-
Senior-level Full TimeBengaluru, India21h ago
-
Data Engineer II INR 1500K-2500KAWS | Apache Airflow | Astronomer | BigQuery | CI/CDCareer growth | Holistic well-being support | Learning opportunitiesSenior-level Full TimeBengaluru, KA, India22h ago
-
Software Development Lead INR 1500K-2700KAPIs | Agile | BigQuery | Continuous Delivery | Continuous integrationSenior-level Full TimeChennai, Tamil Nadu, India22h ago
-
Staff - Software Engineering INR 2515K-3500KAWS | AWS Glue | AWS Lambda | Amazon Kinesis | Amazon SNSCareer growth and development | Flexible workSenior-level Full TimePune22h ago
-
AWS Glue | Amazon Kinesis | DBT | Power BI | PythonMid-level Full TimePune, Maharashtra, India23h ago