Senior Data Engineer
INR 2000K-3000K (estimate) Senior-level Full Time
Tasks
- Analyze business processes and identify data gaps
- Build real time data solutions with Scala and Apache Spark
- Collaborate with cross-functional teams to translate requirements into data solutions
- Design and develop data pipelines for real time and batch processing
- Ensure data quality with validation and monitoring frameworks
- Follow coding standards and perform peer code reviews
- Implement data governance and metadata management
- Maintain technical documentation
- Mentor junior engineers and share knowledge
- Operationalize machine learning models with stakeholders
- Recommend data-driven improvements
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Analysis Services | Apache Spark | Azure Analysis | Azure Analysis Services | Azure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Azure Event | Azure Event Hubs | Azure Machine Learning | Azure SQL | Azure SQL Database | Azure Stream | Azure Stream Analytics | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Factory | Data Governance | Data Lake | Data Modeling | Data Quality | Data Warehousing | Dimensional data | Dimensional data modeling | Event Hubs | Event Streaming | Git | Hadoop | Kafka | Machine Learning | Metadata Management | Performance Tuning | Power BI | PySpark | Python | Relational Data | Relational Data Modeling | SQL | SQL Database | SQL Server | Scala | Scrum | Stored Procedures | Stream Analytics | Synapse Analytics | T-SQL | Version control
Education
Related jobs
-
Senior-level Full TimeMumbai, India6h ago
-
Staff Engineer, AJO,RTCDP INR 2520K-3880KAPI Integration | Adobe Campaign | Adobe Campaign Classic | Adobe Campaign Classic v8 | Adobe ExperienceSenior-level Full TimeRemote, India R7h ago
-
D&T Lead - Data Science INR 3000K-5000KAgentic AI | AlloyDB | Apache Airflow | Artificial Intelligence | CI/CDSenior-level Full TimePune, IN7h ago
-
Intermediate Backend Engineer - Analytics Instrumentation INR 2000K-3370KAt-Scale | Backend Development | ClickHouse | Cloud Native | Data QualityEquity compensation | Flexible paid time off | Growth and development fund | Parental leave | Remote workMid-level Full TimeRemote, India R8h ago
-
Senior-level Full TimeBengaluru, Karnataka, India8h ago
-
Dir, Machine Learning Engrg Mgmt INR 3242K-4200KAlgorithms | Code optimization | Design Patterns | Java | Machine LearningFlexible work options | In-office work options | Remote work optionsSenior-level Full TimeHyderabad, India8h ago
-
Senior Data Quality Engineer (ETL Testing) INR 2000K-3000KAWS Glue | AWS Lambda | AWS Step Functions | Agile | Amazon AthenaContract-to-hire | Remote workSenior-level Full TimeBangalore, India9h ago
-
API Design | AWS | Amazon SageMaker | Automated retraining | CI/CDAutonomy and ownership | Continuous learning | Fully remote | High-growth environment | Professional developmentSenior-level Full TimeIndia R9h ago
-
Python with ADB INR 1500K-2000KAPI Testing | Agile | Azure | Azure DevOps | CI/CDCareer growth programs | Flexible work hours | Generative AI Certifications Support | Remote work | Work-life balanceMid-level Full TimeHyderabad, IN14h ago
-
Senior-level Full TimeBangalore, KA, IN14h ago
-
AI Research IC Leadership role INR 2500K-5000KAgentic AI | Artificial Intelligence | Language Models | Large Language Models | Machine LearningAcademic collaborations | Career growth | Conference participation | Flexible R and D environment | Hybrid workSenior-level Full TimeBengaluru, Karnataka, India14h ago
-
Senior Data Engineer INR 3200K-4200KAWS | Airflow | Apache Spark | CI/CD | Cloud ComputingCompany-matched student loan contribution | Continuous learning resources | Family-friendly perks | Financial wellness programs | Flexible time offSenior-level Full TimeIN - HYDERABAD SKYVIEW, India14h ago
-
Databricks Solution Architect INR 2000K-3000KAWS | Azure | CI/CD | CloudWatch | Data GovernanceOn-site client work | Remote work flexibilitySenior-level Full TimeIndia - Remote R14h ago
-
Senior Consultant (Databricks) INR 2000K-2800KAmazon Web Services | Apache Airflow | Apache Spark | Azure | Azure DataSenior-level Full TimeIndia - Remote R14h ago
-
Software Development Senior Analyst INR 2000K-4500KAPI Gateway | AWS CloudFormation | AWS Lambda | Agile | Amazon BedrockSenior-level Full TimeChennai, TN, IN14h ago
-
Senior Staff Engineer (AI Full-stack Developer) INR 2000K-5000KAWS | Access Controls | Agentic Workflows | Asynchronous programming | Audit LoggingSenior-level Full TimeMumbai, India1d ago
-
Senior Staff Engineer (AI Solution Design) INR 4000K-5500KAlerting | Artificial Intelligence | Data Architecture | Data Lakes | Data PipelinesSenior-level Full TimeMumbai, India1d ago
-
Senior-level Full TimeMumbai, MH, India1d ago
-
Mid-level Full TimeIndia - Remote R1d ago
-
Senior-level Full TimePune, India1d ago
-
AI Engineer INR 2000K-4500KAI Foundry | AI Services | API Development | Azure AI | Azure AI FoundryMid-level Full TimeBangalore, IN1d ago
-
Senior Data Engineer - Consulting INR 2500K-4000KAJAX | AWS ECS | Agile | Azure Data | Azure Data FactorySenior-level Full TimeHyderabad, Telangana1d ago
-
Data Engineer - Delivery INR 1500K-2000KAmazon Web Services | Azure Blob | Azure Blob Storage | Blob Storage | Data ManagementCollaborative team | Professional growth | Training completionMid-level Full TimeHyderabad, Telangana1d ago
-
Senior-level Full TimeBengaluru, KA, IN2d ago
-
Sr SDE (Java + AI) INR 3000K-5000KAI orchestration | AWS | Alerting | Automated testing | AzureDesign review leadership | MentorshipSenior-level Full TimePune City, India2d ago