Staff Software Engineer – Data Platform Engineer
Bengaluru, Karnataka, India
INR 2520K-3380K (estimate) Senior-level Full Time
Tasks
- Architect data ingestion frameworks
- Automate platform operations with CI CD and infrastructure as code
- Build CDC pipelines using Debezium and Kafka
- Build autoscaling self healing Spark jobs on AWS EMR
- Define schema evolution lineage and data governance standards
- Develop data ingestion transformation and publishing tooling
- Implement observability for data pipelines
- Optimize Trino data serving performance
Perks/Benefits
- N/A
Skills/Tech-stack
AWS CloudFormation | Amazon EMR | Apache Iceberg | Apache Kafka | Apache Spark | CI/CD | Debezium | Delta Lake | Infrastructure as Code | Java | Kafka Connect | Linux | Presto | Python | Scala | Terraform | Trino | Unix | “as-code”
Education
N/A
Related jobs
-
Senior AI Engineer INR 3125K-5000KAI Studio | AWS Bedrock | AWS SageMaker | Asynchronous programming | AutogenSenior-level Full TimeBangalore, Karnataka, IN3h ago
-
AI Engineer INR 2520K-3880KActive Learning | Azure Cognitive | Azure Cognitive Services | Azure OpenAI | Azure OpenAI ServiceFamily support | Learning and development opportunities | Life Coverage | Medical coverage | Relocation supportSenior-level Full TimeHyderabad, TS, India4h ago
-
Entry-level Full TimeBengaluru, KA, IN4h ago
-
Senior Applied AI Engineer INR 3384K-5000KAI orchestration | Context Management | Data Pipelines | Experimentation | Graph DatabasesDonation matching | Flexible PTO | Lunch stipend | Medical coverage | Team building eventsSenior-level Full TimeBengaluru, Karnataka, India5h ago
-
Staff Software Engineer(MLOps) INR 2857K-4500KAWS Athena | AWS DynamoDB | AWS Glue | AWS SageMaker | Apache AirflowHybrid work model | Mentorship cultureSenior-level Full TimeBangalore7h ago
-
Staff Engineer - Database Reliability Engineering INR 2695K-2829KAWS | Audit Logging | Aurora | Caching | CassandraSenior-level Full TimeChennai, TN, India8h ago
-
Mid-level Full TimePune, IN9h ago
-
Senior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India11h ago
-
Principal Engineer - Gen AI INR 2857K-4500KAPI Design | Agentic AI | Architecture Documentation | Artificial Intelligence | AzureSenior-level Full Time111443-IND-HYDERABAD-INTL HYD WF CENTRE BLK B8 …11h ago
-
Senior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India11h ago
-
Azure ML Engineer INR 1500K-2000KActive Directory | Application Insights | Azure DevOps | Azure Key Vault | Azure Machine LearningIn person collaboration flexibilityMid-level Full TimeIN319 - IND Bangalore Electronic City …11h ago
-
Azure Data Consultant INR 2516K-3100KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksSenior-level Full TimeBengaluru, KA, IN11h ago
-
Z2_Sr. Developer|Back-end technologies INR 2500K-4144KCI/CD | Caching | Data Management | Docker | ETLSenior-level Full TimeBangalore, KA, IN11h ago
-
AI and Applied Analytics Lead INR 2520K-4170KArtificial Intelligence | Azure AI | Azure Data | Azure Data Platform | Azure MLSenior-level Full TimeGurgaon, HR, IN, 12201011h ago
-
AI Enterprise | AI RMF | AWS | Audit trails | AzureCareer development | Coaching | Flexible workSenior-level Full TimeTrivandrum, KL, IN, 69558111h ago
-
Technical Lead Software Architect INR 2500K-4500KAPI Gateway | AWS | Agent systems | Agile | AuthenticationSenior-level Full TimeIN: Lilly Hyderabad, India11h ago
-
Senior-level Full TimeIN: Lilly Hyderabad, India11h ago
-
Expert Support Engineer - Snowflake INR 2000K-2400KAWS Glue | Access policies | Advanced SQL | Agile | Apache AirflowSenior-level Full TimeBangalore, India11h ago
-
Software Engineer INR 1200K-1800KAPI Gateway | AWS Lambda | AWS RDS | AWS RDS PostgreSQL | AWS SNSContinuous learning | Onsite work 5 days per week | Relocation available | Team collaborationMid-level Full TimeChennai, Tamil Nadu, India11h ago
-
Software Engineer INR 1200K-1800KAPI Gateway | AWS CloudFormation | AWS Lambda | AWS RDS | AWS RDS PostgreSQLOnsite work five days a week | Relocation assistanceMid-level Full TimeChennai, Tamil Nadu, India11h ago
-
Senior Software Engineer-Data Engineering INR 2520K-3880KAPI Gateway | AWS | AWS CloudFormation | AWS Glue | AWS LambdaSenior-level Full TimeBangalore, Karnataka, India11h ago
-
Senior Software Engineer INR 2500K-3200KAPIs | AWS | Azure | Database performance | Database performance tuningRelocation assistanceSenior-level Full TimeChennai, Tamil Nadu, India11h ago
-
AI Engineer I (Remote) USD 30K-39KAWS | Attention Mechanisms | CI/CD | Containerization | Distributed SystemsEntry-level Full TimeIndia, Remote R14h ago
-
Senior Software Engineer– Data Platform Engineer INR 2520K-3200KAWS EMR | Apache Flink | Apache Iceberg | Apache Kafka | Apache SparkSenior-level Full TimeBengaluru, Karnataka, India16h ago
-
Software Engineer II - (Machine Learning Platform) INR 1600K-2000KA/B | A/B Testing | AWS | Airflow | B testingMid-level Full TimeBengaluru, Karnataka, India16h ago