Architect / POD Lead – Data Engineering
Chennai, Tamil Nadu
INR 1500K-2700K (estimate) Senior-level Full Time
Tasks
- Architect data platforms
- Automate pipeline operations
- Build data integration pipelines
- Collaborate with cross-functional teams
- Conduct architecture reviews
- Define data ingestion transformation and storage
- Define pipeline failure handling and monitoring
- Design and deploy GCP resources
- Design data pipelines
- Drive technical best practices
- Ensure data quality and validation
- Implement batch processing frameworks
- Implement data lineage and traceability
- Implement infrastructure as code governance and planning
- Lead data engineering pod
- Mentor data engineers
- Optimize pipeline performance and scalability
Perks/Benefits
- N/A
Skills/Tech-stack
API Integration | Avro | Bash Scripting | Batch Processing | Cloud platform | Data Governance | Data Lineage | Data Pipelines | Data Quality | Data Validation | Data integration | ETL | Event Driven | Event-driven architecture | GCP | Google Cloud | Google Cloud Platform | Google Pubsub | Infrastructure as Code | JSON | Kafka | Parquet | Python | Spring Batch | Terraform | “as-code”
Education
N/A
Related jobs
-
Lead Data Analyst INR 2771K-4064KAPI Integration | Dashboard automation | Dashboarding | Data Analysis | Data VisualizationSenior-level Full TimeBengaluru5h ago
-
Lead Engineer - Machine Learning INR 4000K-5500KData Pipelines | Fine Tuning | Language Models | Large Language Models | Machine LearningContinuous education | Generous leave policy | Health insurance | Meals at office | Recreation & team activitiesSenior-level Full TimeBengaluru, Mumbai8h ago
-
The Cyber Cloud, Data and AI Solution Architect INR 1600K-2772KAI Mitigation | AI Security | Adversarial AI | Adversarial AI Mitigation | Azure Well ArchitectedSenior-level Full TimeBengaluru Campus 31, India11h ago
-
Technical Lead-Data Engg INR 1500K-2700KAWS | Azure | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeINDIA - BENGALURU - HP, IN11h ago
-
Data and AI Products Architect INR 2500K-5000KAgentic patterns | Artificial Intelligence | Chunking | Cost Optimization | Data ArchitectureSenior-level Full Timebangalore, India15h ago
-
AI Solution Architect INR 2500K-5000KAI Security | Agentic Workflows | Artificial Intelligence | Caching | Data Leakage PreventionSenior-level Full Timebangalore, India15h ago
-
Senior-level Full TimeIndia17h ago
-
AI Solutions Architect INR 2500K-5000KAI Enterprise | AI architecture | AI machine learning | AWS | Amazon Web ServicesSenior-level Full TimeIndia17h ago
-
AI Architect INR 2500K-5000KAI Governance | ALM | Architecture Decision | Architecture Decision Records | AzureBoard level updates | Client-facing work | Executive communication | Leadership collaboration | Stakeholder presentationsSenior-level Full TimeBangalore, India20h ago
-
Azure Cosmos | Azure Cosmos DB | Azure Data | Azure Data Lake | Azure SynapseSenior-level Full TimeIndia R23h ago
-
Senior-level Full TimePune, Maharashtra, India1d ago
-
Associate Consultant - Data Engineer(Python/Pyspark) INR 1500K-2200KAgile | Azure | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeBangalore, Karnataka, India1d ago
-
Technical Architect- Remote, India INR 2500K-5000KAI Act | AI RMF | API Design | AWS | Access ControlRemote workSenior-level Full TimeIndia R1d ago
-
Senior Data Architect INR 1500K-2500KAI/ML | AWS | AWS Certified | AWS Certified Data Analytics | AWS Certified Data Analytics Specialty401k | Café | Fitness Center | Health insurance | Recreational facilitiesSenior-level Full TimeBengaluru, KA, India1d ago
-
Sr. Lead Software Engineer - Java, Data, OpenAPI/Swagger, Kafka INR 3000K-5000KAPI Design | Apache Kafka | Automated testing | Cause analysis | Code reviewSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Engineering Manager INR 1500K-2700KAWS Data | AWS Data Services | Airflow | Amazon Web Services | Apache FlinkMid-level Full TimeIndia Remote R1d ago
-
Principal Agentic AI Engineer / Hands-on Technical Lead INR 3600K-5000KAI tracing | Agent patterns | Authentication | Authorization | AutogenSenior-level Full TimeNoida/Gurgaon, HR, IN R1d ago
-
Senior Data Engineer, Director INR 1500K-3000KAWS EMR | Amazon Athena | Amazon DynamoDB | Amazon Kinesis | Amazon QuickSightSenior-level Full TimeGurugram, India1d ago
-
AWS S3 | Amazon EMR | Amazon Redshift | Amazon Web Services | Apache SparkFlexibility programmes | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India1d ago
-
Principal Data Engineer- Databricks & AI platform INR 3715K-5400KAWS | Airflow | Apache Spark | Asset bundles | AzureEmployee assistance program | Employee resource groups | Health benefits | Learning programs | No meeting daysSenior-level Full Time3010 - Bangalore Office, India R1d ago
-
Cost analysis | Data Governance | Data Modeling | Data Quality | Data TransformationSenior-level Full TimeHyderabad - Kondapur, India1d ago
-
Senior Engineer - Data Architect INR 3715K-5449KAccess Control | Active Directory | Alerting | Azure | Azure Active DirectoryCareer growth | Diversity and inclusion | Learning and development resources | Remote work | Volunteer opportunitiesSenior-level Full TimeBangalore IND - Sarjapur Road, India1d ago
-
Strategic Analytics Lead – Salesforce Field Services Operations INR 2771K-4064KCRM Analytics | Correlation | Dashboarding | Data Modeling | Data StorytellingSenior-level Full TimeBangalore - RGA Tech Park, India1d ago
-
Consultant/Sr. Consultant, Consumer Analytics Data Engineering INR 2520K-4720KAWS | AWS Glue | CI/CD | DBT | Data GovernanceSenior-level Full TimeIN: Lilly Bengaluru, India1d ago
-
Vice President - Data Architect INR 3000K-4500KArchitecture standards | Data Architecture | Data Flow | Data Governance | Data ModelingSenior-level Full TimePune, Gera Commerzone SEZ, India1d ago