DE&A - Core - Data Engineering - Microsoft SQL Server
Pune, Maharashtra, India
INR 2000K-2040K (estimate) Senior-level Full Time Found 5d ago
Tasks
- Build data pipelines extracting from SQL Server
- Convert data to Parquet format
- Design on‑prem data lake on MinIO
- Ensure data accuracy and integrity
- Implement Data Lifecycle Management (DLM)
- Implement validation, reconciliation, and audit frameworks
- Optimize storage and resource utilization
Perks/Benefits
- N/A
Skills/Tech-stack
Archival strategies | Data Movement | Data Reconciliation | Data Retention | Data Validation | Data extraction | Data pipeline | Data pipeline design | Fault‑tolerant pipelines | High‑compression workflows | Large‑scale data movement | Minio | Object Stores | Parquet | Performance optimization | Pipeline Design | S3-compatible | S3-compatible object stores | SQL Server
Education
N/A
Roles
Language: en |
Views: 1 |
Clicks: 0
Related jobs
-
Data Engineer INR 1500K-2500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Functions | Azure SQLMid-level Full TimeIN-AP-Hyderabad1d ago
-
Group BI Engineer I INR 2000K-2040KAgile | Azure Analysis | Azure Analysis Service | Azure Data | Azure Data LakeMid-level Full TimeBangalore, Karnataka, India1d ago
-
Senior-level Full TimeBangalore, INDIA, India2d ago
-
Senior-level Full TimeBengaluru, KA, IN; Hyderabad, TS, IN2d ago
-
Lead Software Engineer - Data Engineering (Python, AWS, ETL) INR 2000K-2200KAWS | AWS Glue | Agile | Athena | CI/CDSenior-level Full TimeMumbai, Maharashtra, India2d ago
-
Software Development Advisor INR 2520K-3380KAWS CDK | AppFlow | Aurora | Data Pipeline Architecture | Data ProcessingSenior-level Full TimeChennai, TN, IN2d ago
-
ADK | AI | AI Implementation | Agent Engine | Analytical ThinkingMid-level Full TimeHyderabad - Salarpuria, India2d ago
-
Data Engineer INR 2000K-3000KCross-Functional Collaboration | Cross-functional | Data Generation | Data Governance | Data IntegrityMid-level Full TimeBengaluru, BDC11A, India2d ago
-
IN_Senior Associate_ AWS Data Engineer_D&A_Advisory_PAN India INR 2000K-2400KAWS | AWS Glue | Data Infrastructure | Data Lake | Data QualityFlexible programs | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India2d ago
-
IN_Senior Associate_ETL Informatica _D&A _Advisory _Mumbai INR 2000K-2040KAWS | Agile Scalability | Apache Airflow | Azure Data | Azure Data FactorySenior-level Full TimeMumbai Shivaji Park, India2d ago
-
IN_Senior Associate_ AWS Data Engineer_D&A_Advisory_PAN India INR 2000K-2400KAWS | AWS Glue | Apache Airflow | Apache Hadoop | Azure DataFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India2d ago
-
Data Engineering Professional I INR 220K-280KAWS S3 | Apache Airflow | CI/CD | Data Governance | Data PipelinesMid-level Full TimeIND - Bengaluru, India2d ago
-
Senior-level Full TimeGera Commerzone SEZ, Pune, India2d ago
-
Software Engineer, EDMCS INR 885K-1475KAgile | Architecture | Automation | Bug tracking | Bug tracking toolsMid-level Full TimeGurugram, India2d ago
-
Software Engineer, EDMCS INR 885K-1475KAgile methodologies | Architecture | Automation | Bug tracking | Configuration ManagementMid-level Full TimeGurugram, India2d ago
-
Mid-level Full TimeHyderabad, India2d ago
-
IN_Senior Associate_ETL Informatica _D&A _Advisory _Mumbai INR 2000K-2040KAWS | Agile | Apache Airflow | Azure Data | Azure Data FactoryFlexible programs | Inclusive benefits | MentorshipSenior-level Full TimeMumbai Shivaji Park, India2d ago
-
Data Quality Engineer INR 1524K-2541KAPI Testing | Automation frameworks | Big Data | CI/CD | Cloud PlatformsMid-level Full TimeGera Commerzone SEZ, Pune, India2d ago
-
Data Engineer II, Ads Billing INR 2040K-2400KAWS | Airflow | Anomaly Detection | Cradle | Data ModelingMid-level Full TimeBengaluru, Karnataka, IND2d ago
-
Senior-level Full TimeIN-TN-Chennai2d ago
-
Mid-level Full TimeBengaluru, India2d ago
-
Architect GCP Data Engineer (Remote) INR 2000K-2400KAirflow | Analytics Architectures | Apache Beam | Automation | BigQueryCareer development | Certifications reimbursement | Flexible hours | International projects | Merit-based incrementsSenior-level Full TimeHaryana, Gurugram, India R2d ago
-
Senior Staff Engineer - Data Platform - Bengaluru - GNS INR 2000K-2400KAWS | Backend Engineering | Big Data | Big Data Technologies | BigQuerySenior-level Full TimeKarnataka, Bengaluru, India2d ago
-
Senior-level Full TimePune, Maharashtra, India2d ago
-
Data Engineer INR 1500K-2500KAgile methodology | Apache Airflow | Command Line | Command line utilities | Data PipelinesHybrid work modelMid-level Full TimeBengaluru, INDIA, India3d ago