India - Senior Data Engineer ( Contractual Remote Opportunity)
Tasks
- Apply security and resilience NFR requirements
- Build ETL/ELT pipelines
- Build reusable components with Fabric dataflows and Spark notebooks
- Collaborate on schemas naming and integration patterns
- Create bronze silver and gold tables
- Evaluate Microsoft Fabric features and recommend adoption
- Implement data quality controls and CDC
- Implement lineage and transformations documentation
- Ingest data from ERP CRM and third party sources
- Maintain metadata and data access controls
- Monitor pipeline health and alerts
- Optimize pipeline performance and cost
- Transform cleanse and conform raw data
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Azure | Azure Event | Azure Event Hubs | CDC | CI/CD | Data Governance | Data Lineage | Data Management | Data Quality | Data Security | Data Warehousing | Dataflows Gen2 | Delta Lake | ELT | ETL | Event Hubs | Incremental loading | Kafka | Lakehouse | Master Data | Master Data Management | Medallion Architecture | Metadata Management | Microsoft Fabric | Monitoring | Observability | Parquet | Purview | Python | SQL | Scala | Spark | Spark SQL | Version control
Education
Roles
Related jobs
-
Senior Consultant_Python, Java AI / ML Engineer INR 2500K-4500KAPI Gateway | AWS | AgentCore) | Amazon Bedrock | AngularSenior-level Full TimeHyderabad, IN, 500081 R23h ago
-
AWS | Agile | Azure | CI/CD | Cloud platformFully remote | Professional growthSenior-level Full TimeIndia R23h ago
-
Data Engineer INR 1500K-2100KAWS | Agile | Apache Airflow | CI/CD | Data GovernanceHybrid work environment | Work-life flexibilityMid-level Full TimeBengaluru, India R1d ago
-
Software Development Advisor INR 1000K-1700KAPI Gateway | AWS | Agile | Amazon Connect | Amazon EKSMid-level Full TimeBangalore, KA, IN R1d ago
-
Offshore ETL Engineer (DBT SME) INR 1500K-2040KAnalytics modeling | CI | CI/CD | DBT | Data ModelingMid-level Full TimeBangalore, KA, IN R1d ago
-
AI/MLOps SRE Lead Engineer INR 3000K-4680KAKS | AWS CDK | Amazon SageMaker | Anomaly Detection | Automated remediationHybrid work environmentSenior-level Full TimeHyderabad, India R1d ago
-
Senior-level Full TimeBangalore, KA, IN R1d ago
-
Technical & Solution Architect INR 2771K-4300KAWS | Agile | Airflow | Angular | Angular MaterialCareer growth | Healthcare benefits | Hybrid work environment | Online learning platform | Paid time offSenior-level Full TimeIND-Pune-Equifax Analytics-PEC, India R1d ago
-
Senior Python Data Engineer INR 3000K-4000KAWS | Apache Airflow | Automated testing | Azure | CI/CDCertification programs | Health insurance | Internal mobility | Internship opportunities | Language coursesSenior-level Full TimeAll Cities, India R1d ago
-
Staff Enterprise Engineer (Storage) INR 3000K-4000KAnsible | Azure Backup | CI/CD | Capacity Planning | Disaster RecoveryHybrid workSenior-level Full TimeBengaluru, KA, India R1d ago
-
Agentic Engineer Level II/III INR 2000K-5000KAPI Integration | Authentication | Debugging | Error Handling | IdempotencySenior-level Full TimeRemote - India R1d ago
-
AI/ML Engineer INR 2000K-3500KAzure | Data Pretraining | Data Structures | DeepSpeed | Distributed SystemsCar lease benefits | Career advancement programs | Certification programs | Continuous learning opportunities | Corporate NPSMid-level Full TimeBangalore, Karnataka, India R1d ago
-
Java Full Stack AI Engineer- LINA GI INR 2200K-3200KAPI Security | Angular | App Service | Azure | Azure AppCertification programs | Corporate NPS | Dental insurance | Education reimbursement | Employee assistance programSenior-level Full TimeTelangana, India R1d ago
-
Junior AI Specialist INR 336K-480KAWS | Airflow | Azure | DBT | Data AnalysisCertification programs | Health insurance | Internship opportunities | Language courses | MentorshipEntry-level Full TimeAll Cities , India R1d ago
-
Python, LLM, GenAI/Senior Consultant Specialist INR 3000K-5000KAsynchronous programming | Authentication | Authorization | CI/CD | CachingContinuous professional development | Flexible workingSenior-level Full TimePune, Maharashtra, India R1d ago
-
Mid-level Full TimeBangalore, KA, IN R2d ago
-
Engineers (Agentic / Automation) INR 2475K-4680K.Net Core | API Security | AWS Lambda | Agile | Amazon RDSSenior-level Full TimeGurgaon, HR, IN R2d ago
-
Applied AI Engineer INR 3000K-4500KAI Foundry | AI Governance | AIOps | Azure AI | Azure AI FoundrySenior-level Full TimeIndia - Remote R2d ago
-
Senior-level Full TimeIndia - Remote R2d ago
-
Senior Data Engineer INR 3000K-4200KData Migration | Data Quality | Data Reconciliation | Data Validation | EHI ExportCollaborative workspaces | Commuter support | Employee assistance program | Employee resource groups | Remote work flexibilitySenior-level Full TimeChennai India R2d ago
-
Sr Engr Cslt-Data Science INR 2817K-4995KBigQuery | Chatbot | Conversational Analytics | Data Modeling | Data ValidationHybrid work | Work from homeSenior-level Full TimeVDSI, OLYMPIA TECH PARK BLOCK-B 1, … R2d ago
-
Data Analyst / Engineer INR 3000K-4000KBusiness Intelligence | Dashboard Development | Data Engineering | Data Governance | Data LineageBe Well programs | Hybrid-friendly work environmentSenior-level Full TimeINMANBP Bangalore (INMANBP) Manyatha, India R2d ago
-
Data Analyst / Engineer INR 3000K-4000KBusiness Intelligence | Dashboard Development | Data Analysis | Data Engineering | Data GovernanceBe Well programs | Employee development | Flexible supportive environment | Hybrid workSenior-level Full TimeINMANBP Bangalore (INMANBP) Manyatha, India R2d ago
-
Data Engineer Lead INR 3000K-4200KData Governance | Data Modeling | Data Quality | Data Reconciliation | Data WarehousingSenior-level Full TimeINMANBP Bangalore (INMANBP) Manyatha, India R2d ago
-
Machine Learning Associate Analyst - HIH - Evernorth INR 1200K-2500KAPIs | CSV | Classification | Cloud Computing | ClusteringMid-level Full TimeHIH - Hyderabad, India R2d ago