Consultant - Databricks Azure
INR 1000K-2700K (estimate) Mid-level Full Time
Tasks
- Build data pipelines
- Build data quality frameworks
- Build medallion architecture
- Create metadata driven ingestion frameworks
- Design data infrastructure
- Develop analytical pipelines
- Develop data ingestion pipelines
- Implement ETL pipelines
- Implement data security and privacy
- Integrate data sources
- Monitor data flows
- Optimize processing cost efficiency
- Optimize storage performance
- Perform data transformations
- Process Big Data
- Troubleshoot data flows
Perks/Benefits
- N/A
Skills/Tech-stack
Access Control | Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure DevOps | Azure Functions | Azure RBAC | Azure Storage | Azure Storage Blob | Big Data | Big Data File Formats | Data Factory | Data Ingestion | Data Lake Storage | Data Processing | Data Quality | Data file formats | Data quality frameworks | Database Management System | ETL | File Compression | File Formats | Git | IAM | Management System | Medallion Architecture | Metadata Driven | Metadata Driven Ingestion | Microsoft Fabric | OneLake | Power BI | PySpark | Python | Quality frameworks | RDBMS | Relational Database | Relational Database Management | Relational Database Management System | Role-Based Access | Role-Based Access Control | SCD Type 1 | SCD Type-2 | SQL | SQL Server | Spark SQL | Storage Blob | Synapse Analytics | Team Services | Type 1 | Type 2) | Visual Studio | Visual Studio Team Services
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Senior-level Full TimeMADURAI, TAMIL NADU, India1d ago
-
Senior AI Engineer INR 3264K-5000KAI Foundry | Access Control | Agent Frameworks | Authentication | AzureSenior-level Full TimeIndia1d ago
-
Entry-level Full TimeBangalore, Karnataka, India1d ago
-
Senior Software Engineer II (Java Microservices) INR 3000K-4500KAWS | Agile | Apache Kafka | Apache Spark | AzureCareer development | Distributed collaboration | Learning opportunities | Work from Anywhere cultureSenior-level Full TimeIndia R1d ago
-
AI Engineer (Manager level) INR 1200K-2500KApache Spark | Azure AI | Azure CI | Azure CI/CD | Azure CognitiveMid-level Full TimeHyderabad, India1d ago
-
Assistant Manager - Databricks Azure INR 1500K-2000KADLS | Amazon Kinesis | Apache Kafka | Apache Spark | Azure ADMid-level Full TimeBangalore, Karnataka, India1d ago
-
Associate Consultant - Databricks Azure INR 1500K-2000KADLS | Azure | Azure Data | Azure Data Factory | Azure DatabricksMid-level Full TimeBangalore, Karnataka, India1d ago
-
Associate Consultant - Databricks AWS INR 1500K-2000KADLS | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryMid-level Full TimeBangalore, Karnataka, India1d ago
-
Consultant - Databricks AWS INR 1500K-2500KAWS Data | AWS Data Pipeline | AWS Glue | AWS Lake | AWS Lake FormationMid-level Full TimeBangalore, Karnataka, India1d ago
-
Senior Data Engineer INR 1500K-2700KAWS Glue | AWS Kinesis | AWS Lake | AWS Lake Formation | AWS LambdaSenior-level Full TimeBangalore, Karnataka, India1d ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous work culture | Competitive salary | Laid back environment | Remote-first cultureMid-level Full TimeKolkata, India1d ago
-
Senior-level Full TimeBangalore, Karnataka, India1d ago
-
Developer II INR 2000K-5000KAWS EKS | Data Structures | Data Structures and Algorithms | Docker | FlaskSenior-level Full TimeBengaluru, KA, India1d ago
-
AI Architect INR 2500K-5000KAWS SageMaker | Azure Machine Learning | Cloud Computing | Data Governance | Deep learningCollaborative working environment | Continuous learning | Global organisationSenior-level Full TimePune, MH, India1d ago
-
Bash | Data Processing | Docker | GCP | LinuxMid-level Full TimeGurgaon, India1d ago
-
Data Engineer II INR 3000K-4000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Senior-level Full TimeHyderabad, TG, IN1d ago
-
Senior-level Full TimeDGS India - Bengaluru - Manyata …1d ago
-
AI Agents | AI Data | AI data governance | API Security | Cloud SecurityMid-level Full TimeBengaluru, Karnataka, India R1d ago
-
AWS | AWS Glue | Agile | Amazon S3 | CI/CDSenior-level Full TimeHyderabad, Telangana, India - Remote R1d ago
-
AI Quality Engineer (Contract) INR 2000K-4680KAWS | Automated testing | Azure | CI/CD | DeepEvalContract role | Work from OfficeSenior-level ContractHyderabad, Telangana, India1d ago
-
Agent systems | Agentic AI | Anomaly Detection | Cloud Computing | Cloud platformCross-functional collaboration | Matrixed organization leadership | Mid-shift schedule | Onsite workSenior-level Full Time111442-IND-BENGALURU-INTL BLR BLK B3 PETUNIA, India1d ago
-
Business segmentation | Cloud platform | Clustering | Customer profiling | Decision TreesSenior-level Full Time111442-IND-BENGALURU-INTL BLR BLK B3 PETUNIA, India1d ago
-
TTT - Full Stack .Net Developer - Gen AI - Staff INR 2400K-3217K.NET | ADO.NET | ASP.NET MVC | ASP.Net Core | AgileContinuous learning | Diverse and inclusive culture | Flexible tools and support | Transformative leadershipSenior-level Full TimeBengaluru, KA, IN, 5600161d ago
-
Senior AI and Machine Learning Engineer INR 3000K-4680KConvolutional Neural Networks | Data Mining | Data Preprocessing | Data Visualization | Decision TreesCareer Development Programs | Flexible work arrangements | Health and wellbeing benefits | Hybrid work schedule | Inclusion initiativesSenior-level Full TimeBengaluru, Karnātaka, India R1d ago
-
API | JSON | Java | JavaScript | PythonOpportunity to work on AI projects | Remote workMid-level ContractIndia; Pakistan; Nigeria; Kenya; Egypt; Ghana; … R1d ago