Architect / POD Lead – Data Engineering
Chennai, Tamil Nadu
INR 1500K-2700K (estimate) Senior-level Full Time
Tasks
- Architect data platforms
- Automate pipeline operations
- Build data integration pipelines
- Collaborate with cross-functional teams
- Conduct architecture reviews
- Define data ingestion transformation and storage
- Define pipeline failure handling and monitoring
- Design and deploy GCP resources
- Design data pipelines
- Drive technical best practices
- Ensure data quality and validation
- Implement batch processing frameworks
- Implement data lineage and traceability
- Implement infrastructure as code governance and planning
- Lead data engineering pod
- Mentor data engineers
- Optimize pipeline performance and scalability
Perks/Benefits
- N/A
Skills/Tech-stack
API Integration | Avro | Bash Scripting | Batch Processing | Cloud platform | Data Governance | Data Lineage | Data Pipelines | Data Quality | Data Validation | Data integration | ETL | Event Driven | Event-driven architecture | GCP | Google Cloud | Google Cloud Platform | Google Pubsub | Infrastructure as Code | JSON | Kafka | Parquet | Python | Spring Batch | Terraform | “as-code”
Education
N/A
Related jobs
-
Senior AI - ML Engineer INR 3242K-5000KAgent systems | Agentic AI | Airflow | Amazon Web Services | AnthropicSenior-level Full TimeBengaluru East, Karnataka, India R11h ago
-
Airflow | BigQuery | CI/CD | Cloud SQL | Cloud StorageFlexible working | Inclusive work environment | Professional development opportunitiesMid-level Full TimeHyderabad, Telangana, India R11h ago
-
Senior Data Engineering Lead INR 2000K-3900KAWS CloudFormation | AWS Glue | AWS Lambda | AWS Step Functions | Amazon AthenaFamily well-being benefits | Health benefits | Hybrid remote/in-office | Paid time off | Work-life balanceSenior-level Full TimeHyderabad, India R11h ago
-
Associate Principal Engineer, AI Architect INR 2000K-4000KAgent Orchestration | Backend architecture | BigQuery | CI/CD | Cloud platformMid-level Full TimeGurugram, India13h ago
-
Lead Software Engineer - Python, AWS, BigData INR 2500K-4300KAI Assisted Development | AWS Glue | AWS Lambda | AWS Step Functions | Amazon BedrockSenior-level Full TimeBengaluru, Karnataka, India13h ago
-
Senior Technical Anchor INR 4000K-5500KApache Spark | Batch Processing | BigQuery | CI/CD | Cloud BuildSenior-level Full TimeChennai, Tamil Nadu, India R14h ago
-
Senior Manager INR 1500K-3000KAWS Secrets | AWS Secrets Manager | Adaptive Query | Adaptive query execution | Apache SparkSenior-level Full TimeBengaluru, Karnataka, India R16h ago
-
AI Security | Agent Frameworks | Amazon Bedrock | Amazon Web Services | AnthropicAccommodation support during hiring | Fully remote India | Professional growthSenior-level Full TimeIndia R17h ago
-
Lead Software Engineer - Java/Python, AWS, Spark INR 2500K-4200KAWS CloudFormation | AWS Data | AWS Data Lake | Airflow | Amazon Web ServicesSenior-level Full TimePune, Maharashtra, India17h ago
-
Technical PM- AI INR 3500K-5000KAccess Control | Batch Ingestion | CI/CD | Citations | Cloud ArchitectureSenior-level Full TimeIndia - Pune18h ago
-
Specialist Solutions Architect - AI/ML INR 2500K-4200KAI guardrails | AWS | Agents | Artificial Intelligence | AzureHybrid work | Mentorship | Travel up to 30 percentSenior-level Full TimeBengaluru, India R18h ago
-
Specialist Solutions Architect - AI/ML INR 2000K-4300KAI guardrails | Agent Orchestration | Agentic Systems | Amazon Web Services | Artificial IntelligenceMentorship | Technical training | Travel 30 percent maximumSenior-level Full TimeMumbai, India R18h ago
-
EY-GDS Consulting-AI And DATA- AI Architect-Associate Director INR 1860K-2800KAWS | AWS Bedrock | AWS CloudFormation | AgentOps | Agentic AICareer development opportunities | Coaching and feedback | Flexible working approach | Inclusive culture | Learning and skill development opportunitiesMid-level Full TimeBengaluru, KA, IN, 56004823h ago
-
EY - GDS Consulting - AIA - AI Archictect- Manager INR 1500K-2800KAI Foundry | AI Search | AWS Bedrock | Accessibility | Agentic AIMid-level Full TimeChennai, TN, IN, 60003223h ago
-
Lead Data Steward INR 3000K-4000KAgile | Data Curation | Data Governance | Data Ingestion | Data QualityContinuous learning access | Flexible time off | Health and wellness benefitsSenior-level Full TimeIN - GURUGRAM DLF DOWNTOWN BLOCK …23h ago
-
Lead Data Analyst INR 2755K-4000KAI | AWS | Automation | Azure | Data ModelingContinuing education program | Continuous learning | Family-friendly perks | Financial wellness programs | Flexible time offSenior-level Full TimeIN - HYDERABAD SKYVIEW, India23h ago
-
Lead Data Analyst INR 2755K-4000KAI | AWS | Azure | Data Modeling | Data QualityContinuing education program | Continuous learning access | Family-friendly perks | Financial wellness programs | Flexible time offSenior-level Full TimeIN - HYDERABAD SKYVIEW, India23h ago
-
Sr Software Architect - AI/ML INR 2500K-5000KAWS | Agentic Workflows | Auditability | Cloud Computing | Cloud platformSenior-level Full TimeHyderabad TS IN 26, India23h ago
-
Agentic AI Engineer, Vice president INR 4000K-5000KAWS | Automation | Autosys | Capacity Planning | Cause analysisEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysExecutive-level Full TimeBangalore, India23h ago
-
Lead Data Engineer - Snowflake Platform INR 2771K-4064KAWS Glue | AWS Lambda | AWS Redshift | AWS Step Functions | Access ControlSenior-level Full TimeIND - KA - Bangalore - … R23h ago
-
Data Engineering Manager - Azure, GenAI, RAG, Agentic AI INR 1500K-2500KAI Search | Agentic AI | Apache Spark | Azure | Azure AIMid-level Full TimePrimary location: Noida, India23h ago
-
Azure Databricks - Senior manager INR 2000K-3500KAzure | Azure Data | Azure Data Factory | Azure Databricks | Big DataSenior-level Full TimeHyderabad - My Home Twitza, India23h ago
-
GenAI-Team Lead III - AI -GR-39656-70585-JR201049 INR 1000K-3500KA/B | A/B Testing | AWS | Azure | B testingBest-in-class amenities | Flexible work environment | Health insurance | Learning and development | Recognition and rewardsSenior-level Full TimeIND-KA-Bengaluru, Bagmane Solarium City, India23h ago
-
Senior-level Full TimeIND - KA - Bangalore - … R23h ago
-
Tech Lead III - AI (IND) INR 2475K-4500KA/B | A/B Testing | AWS | Azure | B testingGrowth opportunities | Innovation-driven culture | Learning and development | Well-being focusSenior-level Full TimeIND-KA-Bengaluru, Bagmane Solarium City, India23h ago