Subcontractor
INDIA - NOIDA- BIRLASOFT OFFICE, IN
INR 1500K-2800K (estimate) Senior-level Contract
Tasks
- Apply RBAC and governance standards
- Build Medallion Architecture layers
- Build PySpark ingestion transformation and validation frameworks
- Design batch and near real time data pipelines
- Develop and optimize T-SQL queries and stored procedures
- Ensure data security access with Azure Key Vault and managed identities
- Implement ETL and ELT pipelines with Azure Data Factory
- Implement logging monitoring and data quality checks
- Optimize query and performance across Azure SQL and Databricks
- Set up CI CD pipelines for data workloads with Azure DevOps
- Use Git for version control and code reviews
Perks/Benefits
- N/A
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure Key Vault | Azure SQL | Azure SQL Database | CI/CD | Data Factory | Data Modeling | Data integration | Delta Lake | Dimensional Modeling | ELT | ETL | Git | Key Vault | Managed Identities | Medallion Architecture | Monitoring | PySpark | RBAC | SQL | SQL Database | Service principals | T-SQL | Virtual Network
Education
N/A
Related jobs
-
Microsoft Fabric Data Engineer - India INR 1500K-2400KApache Spark | Azure Cognitive | Azure Cognitive Search | Azure Data | Azure Data FactoryMid-level Full TimeNew Delhi, India6h ago
-
Senior-level Full TimeIN-KA-Bangalore7h ago
-
Senior-level Full TimeIN-KA-Bangalore7h ago
-
Senior-level Full TimeIN-KA-Bangalore7h ago
-
Senior-level Full TimePune, MAHĀRĀSHTRA, India8h ago
-
DE&A - Core - Project Management - Project Management INR 3000K-4000KAWS | Apache Airflow | Apache Spark | Azure | CCPASenior-level Full TimePune, Maharashtra, India8h ago
-
Senior-level Full TimeGurugram, Haryana, India8h ago
-
Mid-level Full TimeBengaluru, Karnataka, India9h ago
-
Associate Consultant - Technology Solutions Delivery INR 800K-1000KActive Directory | Agile | Amazon Web Services | Artificial Intelligence | Automation24 7 systems escalation availabilityMid-level Full TimeNoida, Uttar Pradesh, India9h ago
-
Mid-level Full TimePune, Maharashtra, India12h ago
-
Senior Data Engineer - Managed Services INR 3000K-4000KARM Templates | Azure Cloud | Azure Cloud Adoption | Azure Cloud adoption framework | Azure DataOccasional out of hours support | Remote work flexibilitySenior-level Full TimePune, MH, India12h ago
-
AWS | AWS Glue | AWS IAM | AWS Lambda | Amazon EMRMid-level Full TimeHyderabad, Telangana, India12h ago
-
Senior-level Full Timetelengana, India13h ago
-
Sr. Data Engineer INR 2700K-3900KAWS Lambda | AWS S3 | AWS SageMaker | AWS Step Functions | AlertingCommunity outreach programs | Employee Resource Group | Employee stock purchase program | Flexible benefits | Health and wellness incentivesSenior-level Full TimeBangalore, KA, IN, 56007614h ago
-
Staff Data and AI Engineer, Finance INR 2500K-3900KAnomaly Detection | Apache Spark | Business Intelligence | CI/CD | DashboardsSenior-level Full TimeBengaluru, India14h ago
-
Senior Data and AI Engineer - Finance INR 2000K-3584KAnomaly Detection | Apache Spark | CI/CD | Dashboards | Data ModelingSenior-level Full TimeBengaluru, India14h ago
-
Mid-level Full TimeBangalore, Karnataka, India14h ago
-
Assistant Manager - AWS Data Engineering INR 1500K-2541KAWS Data | AWS Data Pipeline | Amazon Web Services | Data Modeling | Data pipelineMid-level Full TimeHyderabad, Telangana, India14h ago
-
Lead Consultant_Python MachineLearning INR 1500K-2500KAWS | Apache Airflow | Apache Kafka | Apache Spark | AzureHybrid workSenior-level Full TimeBangalore, IN, 56006615h ago
-
Data Engineer INR 1500K-2500KAzure Data | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | CI/CDSenior-level Full TimeChennai, IN, 60003215h ago
-
Manager_Python Engineer L4 Expert INR 1500K-3500KAWS Glue | AWS Lambda | Agile | Amazon S3 | Apache AirflowSenior-level Full TimeThane, IN, 40060415h ago
-
Senior Consultant_ETL QA INR 1500K-2500KAgile | Case design | Data Governance | Data Migration | Data Migration TestingHybrid workSenior-level Full TimeThane, IN, 40060415h ago
-
AI Engineer INR 3264K-5876KAIOps | AWS | Alert Correlation | Azure | CI/CDAgile working opportunities | Birthday off | Flexible working hours | Flexible working optionsMid-level Full TimeGurgaon15h ago
-
Senior Technical Specialist - DBT INR 1500K-2500KAWS CloudFormation | Amazon QuickSight | Amazon Redshift | Apache Airflow | DBTSenior-level Full TimeMumbai, Maharashtra, India15h ago
-
Staff Data Engineer INR 2475K-3100KAWS | Agile | Amazon Redshift | Apache Airflow | CI/CDEducation assistance program | Fitness benefits | Flexible working hours | Health checkups | Hybrid work environmentSenior-level Full TimeBengaluru, Karnataka, India15h ago