Senior Data Engineer Lead / Architect - Senior Vice President
Pune, Maharashtra, INDIA; Chennai, Tamil Nadu, INDIA
INR 2817K-4132K (estimate) Senior-level Full Time
Tasks
- Architect scalable data infrastructure
- Build data ingestion pipelines
- Build data transformation jobs
- Build real-time streaming pipelines
- Define data engineering best practices
- Develop data serving layers
- Develop long term data strategy roadmap
- Document standards and practices
- Enforce data quality testing
- Enforce security and privacy policies
- Evaluate new data engineering tools
- Implement CI CD for data applications
- Implement data governance
- Implement data lake solutions
- Implement data warehouse solutions
- Implement observability practices
- Lead data engineering team
- Mentor engineers
- Oversee data platform development
- Partner with product managers and data scientists
- Prototype new frameworks
- Recommend data platform improvements
- Run code reviews
- Write clean, maintainable, high-performance code
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Airflow | Apache Spark | Azure | BigQuery | CI/CD | Cassandra | Code review | Dagster | Data Modeling | Data Quality | Database Design | Dataflow | Dataproc | EMR | Event Driven | Event-driven architecture | Flink | GCP | GCS | GitHub Actions | GitLab CI | Hadoop | Hive | Impala | Jenkins | Kafka | Kinesis | Microservices | MongoDB | OLAP | OLTP | Observability | Oracle | PostgreSQL | Prefect | Python | REST APIs | Redshift | S3 | SQL | Scala | Testing Frameworks
Education
Regions
Countries
States
Related jobs
-
Entry-level InternshipHyderabad, India10h ago
-
Entry-level InternshipHyderabad, India10h ago
-
Assistant Manager INR 1000K-2000KBusiness Intelligence | Data Modeling | Data Quality | Logistic Regression | Machine LearningMid-level Full TimeIndia10h ago
-
DTICI_T8_Data_engineer_Manufacturing_Operations INR 1500K-2500KAgile | Apache Spark | Azure | Azure Blob | Azure Blob StorageSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
AWS | Airflow | Apache Spark | Azure | Cause analysisSenior-level Full TimePune, Maharashtra, India11h ago
-
GCP BigQuery,DevOps,Credit Card Domain/Associate Director, Data and Analytics Specialist INR 650K-900KApache Airflow | Artificial Intelligence | BigQuery | CI/CD | Cloud ComposerMid-level Full TimeHyderabad, Telangana, India R11h ago
-
AWS Snowflake INR 1500K-2000KAmazon Web Services | DBT | Data Modeling | Data Pipelines | Data WarehousingMid-level Full TimeIN-TN-Chennai11h ago
-
Confluent Kafka Data Engineer INR 1500K-2500KApache Kafka | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeIN-KA-Bangalore11h ago
-
GEN AI Developer INR 2000K-5000KAgile | Continuous integration | Data Modeling | Generative AI | Language ProcessingSenior-level Full TimeIN-KA-Bangalore11h ago
-
AI Automation Expert INR 2000K-5000KAgentic AI | Azure OpenAI | Confluence | Copilot Studio | Enterprise IntegrationSenior-level Full TimeIN-KA-Bangalore11h ago
-
GCP Data Engineer INR 1500K-2500KAirflow | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeIN-MH-Mumbai11h ago
-
GCP Data Engineer INR 1500K-2500KADLS Gen2 | Airflow | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeIN-MH-Mumbai11h ago
-
Mid-level Full TimeIndia11h ago
-
Principal AI Engineer with Java INR 2475K-4800KAI Services | Agent Framework | Agentic AI | Alembic | AutogenEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India11h ago
-
Sr. Associate Director, Software Engineering Specialist INR 1600K-2400KAirflow | Apache Beam | Apache Flink | BigQuery | CI/CDFlexible working | Inclusive workplace | Professional development opportunitiesMid-level Full TimePune, Maharashtra, India R12h ago
-
Sr. Associate Director, Software Engineering Specialist INR 1600K-2400KAPI Design | Airflow | Apache Beam | Apache Flink | BigQueryMid-level Full TimePune, Maharashtra, India R12h ago
-
Data & Analytics Engineer - Consultant INR 1500K-2500KApache Spark | Data Director | Data Governance | Data Management | Data ModelingSenior-level Full TimeBangalore, Karnataka, India12h ago
-
Mid-level Full TimePune, Maharashtra, India12h ago
-
Senior Software Engineer, AI/ML Computer Vision, Google Cloud INR 3000K-5000KC++ | Computer Vision | Data Processing | Debugging | Image classificationSenior-level Full TimeBengaluru, Karnataka, India13h ago
-
Lead Assistant Manager INR 1500K-2800KAccess Control | Caching | Data Governance | Databricks | Databricks SQLSenior-level Full TimeBengaluru, Karnataka, India13h ago
-
Associate Director - Forward Deployed Engineer/AI Engineer INR 1500K-3000KAI Foundry | AWS Bedrock | Agent systems | App Service | Artificial IntelligenceMid-level Full TimeBangalore, Karnataka, India13h ago
-
Senior-GDC INR 2400K-3500KAPIs | Azure | Azure Data | Azure Data Factory | Azure DatabricksCoaching junior engineers | Knowledge transferSenior-level Full TimeBangalore, Karnataka, India13h ago
-
Associate Director- AI Engineer - Solution Architect INR 1500K-3000KAI Act | Agent systems | App Service | Azure App | Azure App ServiceMid-level Full TimeBangalore, Karnataka, India13h ago
-
Assistant Manager - Azure Data Engineer INR 1500K-2000KApache Spark | Azure | DBX Notebooks | Data Infrastructure | Data ModelingMid-level Full TimeBangalore, Karnataka, India14h ago
-
Security Services Data Modelling and Engineering - Associate INR 1500K-2400KAI enablement | Apache Spark | Data Architecture | Data Catalog | Data GovernanceMid-level Full TimeBengaluru, Karnataka, India14h ago