Senior Software Engineer - Data platform
Bengaluru, Karnataka, India
INR 2200K-3200K (estimate) Senior-level Full Time
Tasks
- Architect and deliver data ingestion frameworks
- Automate platform operations with CI CD
- Build CDC pipelines using Debezium
- Build scalable multi tenant ingestion pipelines
- Define standards for schema evolution and data governance
- Implement infrastructure as code for data platform
- Implement observability for data pipelines
- Integrate security filtering and performance tuning
- Optimize data serving layers using Trino
Perks/Benefits
- N/A
Skills/Tech-stack
AWS CloudFormation | AWS EMR | Apache Flink | Apache Iceberg | Apache Kafka | Apache Spark | CI/CD | Data Governance | Data Lineage | Debezium | Delta Lake | Distributed Systems | Infrastructure as Code | Java | Kafka Connect | Kinesis | Presto | Python | Scala | Schema Validation | Streaming Data | Terraform | Trino | Unix/Linux | “as-code”
Education
N/A
Related jobs
-
API Security | Application Security | Automation | Bash | CI/CDMid-level ContractHyderabad, India6h ago
-
Mid-level Full TimeIN-MH-Mumbai8h ago
-
AWS Data Engineer- Airflow INR 1500K-2400KAWS Glue | AWS Lambda | Amazon Redshift | Amazon S3 | Apache HadoopSenior-level Full TimeIN-AP-Hyderabad8h ago
-
Senior-level Full TimeIN-AP-Hyderabad8h ago
-
Software Engineer - AI/ML with Python INR 2500K-3500KAWS | Airflow | Amazon SageMaker | Apache Airflow | Apache SparkAccess to cutting-edge technologies | Collaborative work environment | In office 5 days per week | Professional development | Training and education opportunitiesSenior-level Full TimeBangalore - Karnataka, India - Kalyani …8h ago
-
MS Fabric / Azure Data Engineer ( 5- 7 yrs ) - Immediate Joiners INR 1500K-2500KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | Data ArchitectureImmediate JoinersSenior-level Full TimeBengaluru, KA, India9h ago
-
Staff Software Engineer, Analytics INR 2520K-4000KAlgorithms | Analysis and Design | Big Data | C++ | Data IngestionSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Forward Deployed Engineer, Generative AI, Google Cloud INR 1500K-2500KAPIs | Agent systems | Cloud platform | Data Pipelines | Google CloudMid-level Full TimeMumbai, Maharashtra, India; Bengaluru, Karnataka, India9h ago
-
Forward Deployed Engineer, Generative AI, Google Cloud INR 1800K-2500KAPIs | Agent systems | Cloud platform | CrewAI | Data EngineeringMid-level Full TimeMumbai, Maharashtra, India; Gurgaon, Haryana, India9h ago
-
None Full TimeNoida, Uttar Pradesh, India9h ago
-
None Full TimeNoida, Uttar Pradesh, India10h ago
-
Snowflake COE Lead INR 1500K-2500KAPIs | Apache Airflow | Apache Spark | Azure Data | Azure Data FactorySenior-level Full TimeIndia10h ago
-
None Full TimeIndia11h ago
-
AI Software Engineer III - Platform INR 2000K-4000KAPI Gateway | APIs | AWS EC2 | AWS Lambda | Amazon APISenior-level Full TimeHyderabad, Telangana, India11h ago
-
Azure Data Engineer INR 1500K-2500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Functions | Azure SynapseMid-level Full TimeIndia13h ago
-
Mid-level Full TimeBengaluru, Karnataka, India13h ago
-
Associate Process Manager INR 800K-1500KAWS | Apache Airflow | Apache Hadoop | Apache Spark | AzureMid-level Full TimePune, Maharashtra, India13h ago
-
Website Analytics Architect INR 2520K-3880KA/B | A/B Testing | AEMaaCS | Adobe Analytics | Adobe ExperienceSenior-level Full TimeBangalore, Karnataka, IN, 56010014h ago
-
Agile | Amazon Redshift | Batch Processing | BigQuery | CI PipelineCollaborative global work environment | Cross-functional collaboration | Flexible working arrangements | Fully remote friendly | Inclusive cultureSenior-level Full TimeIndia R15h ago
-
API | Batch Processing | Data Compliance | Data Governance | Data ModelingContinuous learning | Flexible work hours | Health and wellness support | Inclusive work culture | Paid time offSenior-level Full TimeIndia15h ago
-
AI Senior Software Engineer INR 2000K-4000KAI Search | AI gateway | AI gateway patterns | API Design | AWS BedrockSenior-level Full TimeBengaluru, India15h ago
-
Senior System Administrator II [Storage Engineer] INR 1000K-1890KAWS EBS | AWS S3 | Ansible | Ceph | DASMid-level Full TimeBengaluru16h ago
-
Sr.Research Engineer - Applied AI/ML INR 2000K-4170KAPI Design | Algorithms | Apache Spark | Conversational AI | Data AnalysisSenior-level Full TimeGurugram, India17h ago
-
Application Engineer (AI Automation) INR 2500K-4500KApex | Data Modeling | Java | JavaScript | MilvusCompany-sponsored team events | Flexible time off | Wellness resourcesSenior-level Full TimeBangalore, India18h ago
-
Machine Learning Engineer INR 1400K-2000KApache Spark | Azure | Classification | Cloud platform | ClusteringMid-level Full TimeBengaluru, Karnataka, India21h ago