Data Architect - Data Engineering 4D
INR 2500K-4000K (estimate) Senior-level Full Time
Tasks
- Automate deployment monitoring and operational support with CI CD and infrastructure as code
- Build Change Data Capture pipelines
- Collaborate on messaging patterns and data contracts
- Deploy and optimize Kafka producers and consumers
- Design real-time data pipelines
- Implement event-driven integration patterns
- Implement fault tolerant messaging and disaster recovery
- Manage Kafka topics partitions replication retention and security
- Manage schema registry and schema evolution
- Monitor and optimize Kafka cluster performance
- Troubleshoot production issues in Kafka and CDC pipelines
Perks/Benefits
Skills/Tech-stack
Access Control | Access Control Lists | Amazon Web Services | Apache Flink | Apache Kafka | Authentication | Authorization | Avro | Azure | CI/CD | Change Data Capture | Cloud platform | Confluent Platform | Confluent Schema Registry | Data Capture | Debezium | Docker | Google Cloud | Google Cloud Platform | Grafana | Infrastructure as Code | JSON | Java | KSQLDB | Kafka Connect | Kafka Streams | Kubernetes | Linux | Prometheus | Protobuf | Python | REST APIs | SAP CDC | SASL | SSL/TLS | Schema Registry | Web Services | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Data Engineer INR 720K-720KAWS | Apache Airflow | Apache NiFi | Apache Superset | AzureChildcare support | Counseling sessions | Health insurance | Internet allowance | Learning SupportSenior-level Full TimeBangalore, India R3h ago
-
Junior Data Engineer INR 400K-700KAWS Glue | Amazon Redshift | Apache Airflow | Apache Spark | Azure DataEntry-level Full TimePune City, India3h ago
-
AI Software Architect INR 2500K-5000KAPI Design | Azure | CI/CD | Evaluation Pipelines | Knowledge graphSenior-level Full TimeBangalore - Karnataka - India4h ago
-
Senior AI Engineer INR 2500K-4500KAPI Development | Asynchronous programming | Azure | CI/CD | COMTRADESenior-level Full TimeBangalore - Karnataka - India4h ago
-
Senior-level Full TimeBangalore - Karnataka - India4h ago
-
Senior AI Engineer INR 2500K-4500KAsync Programming | Azure | CI/CD | Data Ingestion | Data Ingestion PipelineDiversity-focused workplace | Equity and inclusion | Learning opportunitiesSenior-level Full TimeBangalore - Karnataka - India4h ago
-
Senior AI Engineer INR 2500K-4500KAPI Development | Asynchronous programming | Azure | CI/CD | Dependency managementSenior-level Full TimeBangalore - Karnataka - India4h ago
-
Senior-level Full TimeBangalore - Karnataka - India4h ago
-
Senior-level Full TimeBangalore - Karnataka - India4h ago
-
Data Engineer ( 2 to 5 Years) INR 1500K-2100KAWS CDK | AWS CloudFormation | AWS Glue | AWS Lambda | Amazon AthenaContinuous learning | Flexible working | Hybrid working | Inclusive cultureMid-level Full TimeBangalore - Karnataka - India4h ago
-
AWS Lambda | Amazon DynamoDB | Amazon RDS | Amazon S3 | CI/CDHybrid workSenior-level ContractHyderabad, India R4h ago
-
Data Engineer INR 1500K-2700KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeHyderabad, Noida/ Chennai, India4h ago
-
Backend Engineer (Cloud & AI Integration) INR 1500K-3000KAPI Integration | AWS | Agile | Asynchronous processing | DocumentationMid-level Contract Full TimeBengaluru, KA, India5h ago
-
Mid-level Full TimePune, Maharashtra, India6h ago
-
Senior Software Engineer, AI/ML GenAI, Google Ads INR 2000K-5000KC++ | Data Processing | Data Storage | Debugging | Distributed SystemsSenior-level Full TimeBangalore, Karnataka, India6h ago
-
Backend Engineer (Cloud & AI Integration) INR 1500K-3000KAPI Integration | AWS | Agile | Asynchronous processing | DocumentationMid-level Contract Full TimeBengaluru, KA, India6h ago
-
Senior Data Engineer (Python, SQL, Snowflake, Devops, Azure/ AWS, Co-pilot, Kubernetes, Docker) INR 3200K-4131KAWS | Airflow | Automated Lineage | Azure | Azure BicepEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Mentorship | Volunteer time offSenior-level Full TimeChennai, TN, India7h ago
-
Senior Data Engineer – Snowflake Developer INR 2800K-4000KAWS | Access Control | Airflow | Azure | Azure DataSenior-level Full TimePune, Maharashtra, India7h ago
-
Senior II Data Engineer INR 3715K-4995KBI Dashboards | BICC | CI/CD | Data Augmentation | Data CatalogFlexible working options | Health benefitsSenior-level Full TimeIndia7h ago
-
Capital Market Workforce Team Member-BPS INR 1000K-2500KApache Airflow | Data Mapping | Data Modeling | Data Quality | Data pipelineEntry-level Full TimeIndia7h ago
-
Senior-level Full Timetelengana, India8h ago
-
DE&A - Data Engineer INR 1500K-2500KApache Airflow | Apache Beam | Apache Flink | Apache Kafka | Apache SparkMid-level Full TimeBangalore, Karnataka, India8h ago
-
DE&A - Data Engineer INR 3000K-4000KAccess Control | Code review | Data Access Control | Data Catalog | Data GovernanceMid-level Full TimeBangalore, Karnataka, India8h ago
-
AI/ML Engineer INR 1500K-2500KAPIs | Azure | Continuous integration | Data Pipelines | Distributed SystemsCareer advancement programs | Certification programs | Dental & vision coverage | Education reimbursement | Employee assistance programMid-level Full TimeBangalore, Karnataka, India R9h ago
-
Advanced Embedded Engr INR 1716K-3200KARINC 429 | Abstraction layer | Bitbucket | Board Support | Board Support PackageSenior-level Full TimeHyderabad, Telangana, India9h ago