Senior Data Engineer
INR 2000K-3000K (estimate) Senior-level Full Time
Tasks
- Analyze business processes and identify data gaps
- Build real time data solutions with Scala and Apache Spark
- Collaborate with cross-functional teams to translate requirements into data solutions
- Design and develop data pipelines for real time and batch processing
- Ensure data quality with validation and monitoring frameworks
- Follow coding standards and perform peer code reviews
- Implement data governance and metadata management
- Maintain technical documentation
- Mentor junior engineers and share knowledge
- Operationalize machine learning models with stakeholders
- Recommend data-driven improvements
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Analysis Services | Apache Spark | Azure Analysis | Azure Analysis Services | Azure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Azure Event | Azure Event Hubs | Azure Machine Learning | Azure SQL | Azure SQL Database | Azure Stream | Azure Stream Analytics | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Factory | Data Governance | Data Lake | Data Modeling | Data Quality | Data Warehousing | Dimensional data | Dimensional data modeling | Event Hubs | Event Streaming | Git | Hadoop | Kafka | Machine Learning | Metadata Management | Performance Tuning | Power BI | PySpark | Python | Relational Data | Relational Data Modeling | SQL | SQL Database | SQL Server | Scala | Scrum | Stored Procedures | Stream Analytics | Synapse Analytics | T-SQL | Version control
Education
Related jobs
-
Quality Data Analytics Specialist INR 1500K-2700KAlation | Data Management | Data Quality | Data Reconciliation | Data ValidationSenior-level Full TimePune, India3h ago
-
Assistant Manager - Analytics\..RBG - Analytics INR 1200K-2500KAdobe Analytics | Churn Prediction | Classification | Clickstream | ClusteringMid-level Full TimeBengaluru, Karnataka, India3h ago
-
Assistant Manager - Analytics\..RBG - Analytics INR 1200K-2500KAdobe Analytics | Churn Prediction | Classification | Clickstream analytics | ClusteringMid-level Full TimeBengaluru, Karnataka, India3h ago
-
Mid-level Full TimeBangalore, Karnataka, India3h ago
-
Software Engineer II - Big Data (ETL) / DevOps Engineer + AWS INR 1500K-2500KAWS | Agent Frameworks | Apache Spark | Athena | AuroraMid-level Full TimeBengaluru, Karnataka, India4h ago
-
Senior Software Engineer-Data INR 2000K-4580KAI Foundry | Agent Orchestration | Apache Spark | Azure AI | Azure AI FoundrySenior-level Full TimeIndia, Telangana, Hyderabad4h ago
-
Analyst-Data Science INR 2771K-4064KActive Learning | Algorithms | Apache Hive | Apache Spark | Bayesian MethodsEntry-level Full TimeGurugram, HR, India6h ago
-
Data Engineer (LBC) INR 1500K-2500KBusiness Intelligence | DAX | Data Analysis | Data Catalog | Data QualitySenior-level Full TimePune, IN6h ago
-
Applied AI ML Lead-AI Engineer INR 3500K-5000KAgentic AI | CI/CD | Cloud Computing | Code review | ContainerizationSenior-level Full TimeBengaluru, Karnataka, India7h ago
-
GCP Data Engineer INR 1500K-2000KAnsible | Cloud Bigtable | Cloud SQL | Cloud Spanner | Cloud platformProfessional growthMid-level Full TimeBengaluru, Pune7h ago
-
Applied AI ML Lead-AI Engineer INR 3500K-5000KAgentic AI | CI/CD | Cloud Native | Cloud-native development | Code reviewSenior-level Full TimeBengaluru, Karnataka, India7h ago
-
Software Engineer III - Java & Databricks INR 2200K-3500KAgile | Amazon Web Services | Angular | Application Resiliency | C#Senior-level Full TimeHyderabad, Telangana, India8h ago
-
AI Specialist (Technical) INR 1860K-3465KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksMid-level Full TimeGurugram, HR, IN8h ago
-
Senior Robotics Engineer INR 1753K-2372KC++ | Java | Localization and mapping | MATLAB | Machine LearningFull Time Office Project Work | Relocation not provided | Travel for deployment and commissioningSenior-level Full TimeChennai, TN, IN8h ago
-
AI Specialist (ML & LLM) INR 2400K-4000KAI Search | Azure AI | Azure AI Search | Azure Functions | Azure Machine LearningMid-level Full TimeGurugram, HR, IN8h ago
-
AI Deployment Engineer INR 2000K-4800KCloud Architecture | Enterprise Architecture | Generative AI | JavaScript | Machine LearningHybrid work model | Relocation assistanceSenior-level Full TimeDelhi, India9h ago
-
Applied AI ML Associate Senior-Data Engineer INR 1000K-1800KApache Spark | CI/CD | Data Governance | Data Lineage | Data ModelingMid-level Full TimeBengaluru, Karnataka, India9h ago
-
AWS | AWS Machine Learning | Agent systems | Angular | AutogenSenior-level Full TimeChennai, TN, IN, 60003213h ago
-
AI Engineering INR 3584K-5000KAgentic Workflows | Audit Logging | Authentication | Authorization | CI/CDSenior-level Full TimeBangalore, KA, IN13h ago
-
Principal Engineer - - Generative AI Data & Analytics INR 3700K-4800KAI Observability | AIOps | Azure Data | Azure Data Engineer | Batch ProcessingSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India13h ago
-
Sr. Power BI Engineer - (SSRS & PySpark) INR 1632K-2500KPower BI | PySpark | SQL | SQL Server | SSRSSenior-level Full TimeBengaluru, Karnataka, India13h ago
-
Mid-level Full TimeBlock 1 DT, Chennai India13h ago
-
Senior-level Full TimeChennai, IN13h ago
-
Senior Agentic AI Software Engineer INR 3242K-5000KAgile methodology | Amazon Web Services | Full Stack | Full-Stack Development | GeminiSenior-level Full TimeQ8 - Bangalore, India13h ago
-
Engineer Data Platform INR 1300K-2000KAPI Gateway | AWS CDK | AWS CloudFormation | AWS Identity | AWS Identity and Access ManagementFlexible work environment | Internal mobility | Volunteering opportunities | Welcoming and inclusive environment | Well-being supportMid-level Full TimeKA Bangalore, India13h ago