Big Data Lead
Tasks
- Build reporting using Microsoft Fabric
- Collaborate with stakeholders for requirements
- Design push down execution rules
- Design scalable data solutions
- Develop data quality studio framework
- Implement SCD type 2 patterns
- Implement data pipelines in Azure or Microsoft Fabric
- Implement medallion architecture
- Ingest vendor data sources
- Support business continuity and disaster recovery
Perks/Benefits
Skills/Tech-stack
API first | API first resilience | Azure Cosmos | Azure Cosmos DB | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure SQL | Azure SQL Database | Azure Synapse | Azure Synapse Analytics | Cosmos DB | Data Lake Storage | Data Quality | Databricks | Delta Lake | ETL | Microsoft Fabric | Power BI | PySpark | Python | SCD Type-2 | SQL Database | Synapse Analytics | T-SQL | Type 2)
Education
N/A
Roles
Related jobs
-
Software Engineer INR 1300K-2200KAcceptance Testing | Angular | Apache Solr | ArizeAI | Behavior-Driven DevelopmentMid-level Full TimeBangalore, Karnataka, India11h ago
-
Junior Data Scientist- Computer Vision INR 350K-360KComputer Vision | Convolutional Neural Networks | Deep learning | Machine Learning | MatplotlibEntry-level Full TimeBengaluru, India11h ago
-
Data Engineer INR 1500K-2500KAWS Cloud | AWS Cloud Development Kit | AWS Glue | AWS IAM | AWS LambdaMid-level Full TimeIN-TN-Chennai12h ago
-
Gen Ai INR 2000K-3000KAI Agents | AI Governance | AWS CodePipeline | Agent architecture | AuthenticationMid-level Full TimeIN-KA-Bangalore12h ago
-
Senior-level Full TimeIN-KA-Bangalore12h ago
-
Mid-level Full TimeIN-TN-Chennai12h ago
-
Agentic AI Engineer INR 1800K-2500KAI orchestration | API Integration | Automated testing | Automation | Azure DevOpsMid-level Full TimeIndia, West Bengal, Kolkata12h ago
-
DE&A - AIML - Generative AI INR 1573K-3000KAI Agents | AI orchestration | API Gateway | AWS | Agent systemsMid-level Full TimeBangalore, Karnataka, India13h ago
-
Senior-level Full TimeGurugram, India14h ago
-
Data & Analytics Engineer - AM INR 1500K-2500KApache Spark | Data Modeling | Data Warehousing | Databricks | Delta LakeSenior-level Full TimeBangalore, Karnataka, India14h ago
-
DE&A - AIML - Deep Learning - Generative AI INR 2000K-4000K.NET | Agent Orchestration | Autogen | Azure DevOps | Azure OpenAIMid-level Full TimeBangalore, Karnataka, India14h ago
-
DE&A - AIML - Deep Learning - Generative AI INR 2000K-4000KAgent Orchestration | Autogen | Azure DevOps | Azure OpenAI | CI/CDMid-level Full TimeBangalore, Karnataka, India14h ago
-
Senior QA Engineer(Data Platform Testing) INR 2515K-2829KAPI Gateway | API Testing | AWS Lambda | Alerting | CI/CDReward and recognition | Volunteering opportunities | Wellness | Work-life balanceSenior-level Full TimeHyderabad, India14h ago
-
AI Engineer- Associate Consultant INR 2000K-3000KAgent Orchestration | Amazon Web Services | Autonomous Agents | Azure | ClassificationCollaborative work environment | Continuous learning | Inclusive cultureMid-level Full TimeBangalore, Karnataka, India14h ago
-
ROP - SE2/SSE - Azure Data INR 1500K-2500KAzure Cosmos | Azure Cosmos DB | Azure Data | Azure Data Factory | Azure DevOpsMid-level Full TimeBengaluru, KA, IN15h ago
-
Applied AI ML Associate INR 3799K-5000KAWS | Artificial Intelligence | Cloud platform | Data Analysis | Data PipelinesEntry-level Full TimeBengaluru, Karnataka, India15h ago
-
Lead Software Engineer INR 4000K-5000KAWS | Agent Development | Agent systems | Amazon ECS | Amazon EKSSenior-level Full TimeBengaluru, Karnataka, India15h ago
-
Data Scientist and AI Engineer INR 2500K-5000KAlteryx | CI/CD | Classification | Cloud Build | Cloud FunctionsSenior-level Full TimeChennai, Tamil Nadu, India15h ago
-
Senior-level Full TimeIndia15h ago
-
API Testing | Allure | BDD | CI/CD | CucumberExecutive-level Full TimePune, India15h ago
-
GCP Data Engineer INR 1500K-2500KAPI Integration | BigQuery | Cloud platform | Data Governance | Data ModelingSenior-level Full TimeGurugram, Haryana, India17h ago
-
Data Engineer (AWS+Pyspark) INR 1500K-2000KAWS Glue | Amazon Athena | Amazon Aurora | Amazon DynamoDB | Amazon EC2Mid-level Full TimeHyderabad, Telangana, India17h ago
-
Associate Process Manager INR 1500K-3000KAI Agents | AI Governance | AI monitoring | AWS | AWS BedrockMid-level Full TimePune, Maharashtra, India18h ago
-
Senior Consultant_AWS Developer INR 1500K-3500KAWS Glue | AWS Lambda | AWS Step Functions | AWS Storage Gateway | AWS storageSenior-level Full TimeThane, IN, 40060419h ago
-
Applied AI ML Lead INR 3264K-5000KAI Libraries | API Development | AWS | Agentic AI | Agentic AI librariesSenior-level Full TimeBengaluru, Karnataka, India19h ago