DE&A - Core - Data Engineering - Microsoft SQL Server
Pune, Maharashtra, India
INR 2000K-2040K (estimate) Senior-level Full Time
Tasks
- Build data pipelines extracting from SQL Server
- Convert data to Parquet format
- Design on‑prem data lake on MinIO
- Ensure data accuracy and integrity
- Implement Data Lifecycle Management (DLM)
- Implement validation, reconciliation, and audit frameworks
- Optimize storage and resource utilization
Perks/Benefits
- N/A
Skills/Tech-stack
Archival strategies | Data Movement | Data Reconciliation | Data Retention | Data Validation | Data extraction | Data pipeline | Data pipeline design | Fault‑tolerant pipelines | High‑compression workflows | Large‑scale data movement | Minio | Object Stores | Parquet | Performance optimization | Pipeline Design | S3-compatible | S3-compatible object stores | SQL Server
Education
N/A
Roles
Related jobs
-
AI Automation Forward Deployment Engineer INR 2857K-4590KAI orchestration | Agentic AI | BigQuery | Cause analysis | Data ModelingDonation match | Flexible location | Flexible schedule | Health coverage | Paid vacationSenior-level Full TimeBangalore, India21h ago
-
Consultant- Data Support INR 316K-500KAlteryx | Azure Data | Azure Data Engineering | Azure Data Lake | Azure Databricks24/7 rotation | Customer service focusEntry-level Full TimeBangalore, Karnataka, India1d ago
-
Lead Data Engineer INR 1200K-2000KAzure | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryUK shift workSenior-level Full TimeBengaluru, KA, India1d ago
-
DevOps - Senior DevOps Engineer - 532 INR 2229K-3500KAWS | Ansible | Auto Scaling | CI/CD | CloudFormationSenior-level Full TimeNoida, Uttar Pradesh1d ago
-
Senior Software Engineer INR 3200K-4225KAccess Control | Airflow | Artificial Intelligence | Astronomer | CI/CDSenior-level Full TimePune, India R1d ago
-
Data Engineer INR 2520K-3380KAzure Data | Azure Data Services | Azure DevOps | DAX | Data GovernanceLearning and career developmentSenior-level Full TimeChennai, IN, 600 0321d ago
-
Data Quality Engineer - SAP HANA, SAP Information Steward INR 1317K-2000KCode review | Data Modeling | Data Quality | Data Quality Rules | Data ServicesContinuous learning | Flexible working model | Health and wellbeing | Skill growthMid-level Full TimeBangalore, IN, 5600661d ago
-
Data Engineer INR 2000K-2400KBig Data | Cloud Data | Cloud Data Platforms | Data Lakes | Data QualitySenior-level Full TimeBangalore, India1d ago
-
Software Engineering SMTS- Tableau INR 3150K-4500KAgile | Amazon Web Services | C# | C++ | CI/CDAdoption Assistance | Executive coaching | Fertility benefits | Hybrid work model | Parental leaveSenior-level Full TimeIndia - Bangalore1d ago
-
Agile | Azure Data | Azure Data Factory | Azure SQL | Data ComplianceFlexible work programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBhubaneswar - Ihub, India1d ago
-
Amazon Web Services | Apache Airflow | Apache Hadoop | Azure | Azure DataFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India1d ago
-
Agile | Azure Data | Azure Data Factory | Azure Data Lake | Azure SQLFlexible work arrangements | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBhubaneswar - Ihub, India1d ago
-
PA2026Q1JB031 -Senior Data Engineer INR 1800K-2000KAWS | Access Control | Airflow | Apache Iceberg | Apache KafkaSenior-level Full TimeHyderabad India - Block B1d ago
-
PA2026Q1JB035 - Principal Data Pipeline Lead INR 2000K-2400KApache Airflow | Apache Flink | Apache Iceberg | Apache Kafka | Apache SparkSenior-level Full TimeHyderabad India - Block B1d ago
-
IN_Senior Associate_AI ML Engineer_GCC_Advisory_Hyderabad INR 2535K-4225KCNTK | Caffe | Computer Vision | Data Warehouse | Data WarehousingSenior-level Full TimeHyderabad - Salarpuria, India1d ago
-
Lead- Data Solutions and Analytics INR 2500K-3380KAgile | Alerting | Azure Data | Azure Data Factory | Azure Data LakeEmployee resource groups | Hybrid work | Learning and development opportunities | Paid Company Holidays | Paid vacationSenior-level Full TimeIN025 Embassy Manyata Business Park, India1d ago
-
Senior-level Full TimeBangalore, Karnataka, IN India, 5600871d ago
-
Senior Data Engineer INR 2520K-3880KAWS Glue | AWS Step Functions | Amazon Athena | Amazon DynamoDB | Amazon EMRSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Techno Functional INR 1500K-2500KAutomation | Business Intelligence | Data Quality | Data Reconciliation | Data ValidationMid-level Full TimeNoida, Uttar Pradesh, India1d ago
-
Senior Data Engineer INR 2520K-3100KCDC | DBT | Data Lineage | Data Modeling | Data PipelinesOn-call rotationSenior-level Full TimePune, MH, India1d ago
-
Lead Consultant-SSIS Developer! INR 2500K-3380KData Warehousing | Data integration | Design Patterns | Dimensional Modeling | ETLAI certifications | Mentorship | TrainingSenior-level Full TimeIndia-Bangalore2d ago
-
Lead Consultant - Site Reliability Engineers/L2 INR 2535K-4225KAWS | Angular | Azure | C# | Chaos EngineeringSenior-level Full TimeIndia-Bangalore2d ago
-
Pyspark Data Engineer INR 1200K-2000KAgile | Apache Spark | Data Governance | Data Lake | Data ModelingSenior-level Full TimeIN-KA-Bangalore2d ago
-
Azure Data Engineer - AM- MFT KGS CH INR 2000K-2000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksSenior-level Full TimeBangalore, Karnataka, India2d ago
-
Azure Data Engineer - Senior- MFT KGS CH INR 2000K-2000KAccess Control | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksSenior-level Full TimeBangalore, Karnataka, India2d ago