DE&A - Core - Data Engineering - Microsoft SQL Server
Pune, Maharashtra, India
INR 2000K-2040K (estimate) Senior-level Full Time
Tasks
- Build data pipelines extracting from SQL Server
- Convert data to Parquet format
- Design on‑prem data lake on MinIO
- Ensure data accuracy and integrity
- Implement Data Lifecycle Management (DLM)
- Implement validation, reconciliation, and audit frameworks
- Optimize storage and resource utilization
Perks/Benefits
- N/A
Skills/Tech-stack
Archival strategies | Data Movement | Data Reconciliation | Data Retention | Data Validation | Data extraction | Data pipeline | Data pipeline design | Fault‑tolerant pipelines | High‑compression workflows | Large‑scale data movement | Minio | Object Stores | Parquet | Performance optimization | Pipeline Design | S3-compatible | S3-compatible object stores | SQL Server
Education
N/A
Roles
Related jobs
-
Practice Customer Engineer, Data Analytics INR 1200K-2000KApache Spark | C++ | DMZ | DNS | Data LakeEqual opportunity work environment | Travel as requiredSenior-level Full TimeMumbai, Maharashtra, India; Bengaluru, Karnataka, India8h ago
-
AWS Data Engineer- Assistant Manager INR 1200K-2000KAWS Data | AWS Data Pipeline | AWS Glue | AWS Kinesis | AWS Lake FormationSenior-level Full TimeBangalore, Karnataka, India10h ago
-
Data Engineer INR 938K-1200KAzure Data | Azure Data Factory | Azure Databricks | Data Factory | ETLEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India12h ago
-
IT Data Analytics Analyst INR 1500K-2000KAI machine learning | API Integration | Amazon Web Services | CI/CD | ClusteringMid-level Full TimePune, India14h ago
-
IN-Associate 2_Azure Data Engineer_OC D&A_Advisory_Bhubaneswar INR 1500K-2000KAgile | Azure | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeBhubaneswar - Ihub, India20h ago
-
Mid-level Full TimeIndia - Hyderabad20h ago
-
Senior Engineer Data - MDM INR 1628K-2146KAgile | Amazon Web Services | Azure | Cloud Platforms | Cloud platformFlexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balanceSenior-level Full TimeKA Bangalore, India20h ago
-
Lead Engineer Data - MDM INR 1500K-2040KAPIs | Agile | Amazon Web Services | Azure | Cloud platformFlexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balanceSenior-level Full TimeKA Bangalore, India20h ago
-
EY - GDS Consulting - AI And DATA - Snowflake -Senior INR 1200K-2000KAgile | Data Analysis | Data Reconciliation | Data Testing | Data WarehousingSenior-level Full TimeHyderabad, TG, IN, 50008120h ago
-
Mid-level Full TimePune, PDC3C, India20h ago
-
AWS Glue | Agile | Amazon Redshift | Amazon Web Services | AzureFlexible work arrangements | Hybrid work arrangements | Visa sponsorshipEntry-level Full TimeIND - Telangana - Hyderabad (HITEC …20h ago
-
Mid-level Full TimeBengaluru, India20h ago
-
Data Flow Engineer III INR 1431K-2040KAPI Integration | Automation | Data Transformation | Data Validation | FTPSenior-level Full TimeOffice - Mumbai, India20h ago
-
Mid-level Full TimeBengaluru, Karnataka, India1d ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Dashboards | Data CleansingSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Data Science Engineer INR 1500K-2000KAgile | Apache Airflow | Automated testing | Azure | Cloud platformAnnual leave | Casual leave | Public holidays | Sick leaveMid-level Full TimeGurugram, India1d ago
-
GenAI Engineer INR 1800K-2500KAmazon Web Services | Apache Spark | Azure | Chunking | Data StructuresMid-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior Data Engineer INR 1200K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Alerting | Amazon EMRSenior-level Full TimeHyderabad, IN1d ago
-
Senior Data Engineer II INR 2520K-3380KAPI Development | AWS | AWS RDS | Amazon Redshift | Apache SparkFlexible working model | Health and parental leave plans | Professional development stipend | Remote work optionSenior-level Full TimeBengaluru - BLR1 R1d ago
-
Amazon Redshift | DBT | Data Architecture | Data Modeling | Data QualityFully remote work | Healthcare coverage | Home office equipment allowance | Learning and development budget | Paid parental leaveSenior-level Full TimeIndia R1d ago
-
Data Engineer INR 1000K-1350KAmazon Redshift | Apache Airflow | Apache Beam | Apache Flink | Apache HadoopMid-level Full TimeGurugram, India1d ago
-
AWS | Apache Airflow | Apache Hadoop | Azure Data | Azure Data FactoryFlexible work programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeKolkata Y-14, India1d ago
-
Lead Software Engineer - AI/ML INR 3125K-4512KAgentic Systems | CI/CD | Containerization | Data Modeling | Data analyticsRelocation assistanceSenior-level Full TimeIND - Bangalore, India1d ago
-
IN_Associate 2_Azure Data Engineering _OC D&A_Advisory_Kolkata INR 1500K-2000KAgile | Apache Airflow | Apache Hadoop | Apache Spark | AzureFlexible work arrangements | Inclusive benefits | Learning programs | Mentorship | Travel Not RequiredMid-level Full TimeKolkata Y-14, India1d ago
-
Senior Data Analytics Engineer - GenAI INR 2500K-2829KAPI Development | Access Control | Batch Processing | Data Engineering | Data LineageSenior-level Full TimeGurgaon Office, India1d ago