Assistant Manager - Databricks Azure
Bangalore, Karnataka, India
INR 1500K-2000K (estimate) Mid-level Full Time
Tasks
- Build Power BI reports and dashboards
- Build data ingestion and analytical pipelines
- Build medallion architecture
- Create data quality frameworks
- Design and maintain Databricks data pipelines
- Develop and deploy ETL pipelines on Azure
- Develop data streaming pipelines
- Implement Azure data security with RBAC and IAM
- Implement data ingestion with Azure services
- Implement metadata-driven ingestion
- Process large datasets using Apache Spark
- Transform data using SCD type 1 and SCD type 2
Perks/Benefits
- N/A
Skills/Tech-stack
ADLS | Amazon Kinesis | Apache Kafka | Apache Spark | Azure AD | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure Functions | Azure RBAC | Big Data | Big Data File Formats | Data Factory | Data Ingestion | Data Modeling | Data Quality | Data Streaming | Data Warehousing | Data file formats | Delta Lake | ETL | File Compression | File Formats | Git | Microsoft Fabric | OneLake | Power BI | PySpark | Python | SCD Type 1 | SCD Type-2 | SQL | SQL Server | Spark SQL | Synapse Analytics | Type 1 | Type 2) | Unity Catalog
Education
Related jobs
-
Senior-level Full TimeMADURAI, TAMIL NADU, India1d ago
-
Entry-level Full TimeBangalore, Karnataka, India1d ago
-
Senior Software Engineer II (Java Microservices) INR 3000K-4500KAWS | Agile | Apache Kafka | Apache Spark | AzureCareer development | Distributed collaboration | Learning opportunities | Work from Anywhere cultureSenior-level Full TimeIndia R1d ago
-
AI Engineer (Manager level) INR 1200K-2500KApache Spark | Azure AI | Azure CI | Azure CI/CD | Azure CognitiveMid-level Full TimeHyderabad, India1d ago
-
Consultant - Databricks Azure INR 1000K-2700KAccess Control | Azure | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeBangalore, Karnataka, India1d ago
-
Associate Consultant - Databricks Azure INR 1500K-2000KADLS | Azure | Azure Data | Azure Data Factory | Azure DatabricksMid-level Full TimeBangalore, Karnataka, India1d ago
-
Associate Consultant - Databricks AWS INR 1500K-2000KADLS | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryMid-level Full TimeBangalore, Karnataka, India1d ago
-
Consultant - Databricks AWS INR 1500K-2500KAWS Data | AWS Data Pipeline | AWS Glue | AWS Lake | AWS Lake FormationMid-level Full TimeBangalore, Karnataka, India1d ago
-
Senior Data Engineer INR 1500K-2700KAWS Glue | AWS Kinesis | AWS Lake | AWS Lake Formation | AWS LambdaSenior-level Full TimeBangalore, Karnataka, India1d ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous work culture | Competitive salary | Laid back environment | Remote-first cultureMid-level Full TimeKolkata, India1d ago
-
Developer II INR 2000K-5000KAWS EKS | Data Structures | Data Structures and Algorithms | Docker | FlaskSenior-level Full TimeBengaluru, KA, India1d ago
-
AI Architect INR 2500K-5000KAWS SageMaker | Azure Machine Learning | Cloud Computing | Data Governance | Deep learningCollaborative working environment | Continuous learning | Global organisationSenior-level Full TimePune, MH, India1d ago
-
Bash | Data Processing | Docker | GCP | LinuxMid-level Full TimeGurgaon, India1d ago
-
Data Engineer II INR 3000K-4000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Senior-level Full TimeHyderabad, TG, IN1d ago
-
Senior-level Full TimeDGS India - Bengaluru - Manyata …1d ago
-
AI Agents | AI Data | AI data governance | API Security | Cloud SecurityMid-level Full TimeBengaluru, Karnataka, India R1d ago
-
AWS | AWS Glue | Agile | Amazon S3 | CI/CDSenior-level Full TimeHyderabad, Telangana, India - Remote R1d ago
-
AI Quality Engineer (Contract) INR 2000K-4680KAWS | Automated testing | Azure | CI/CD | DeepEvalContract role | Work from OfficeSenior-level ContractHyderabad, Telangana, India1d ago
-
Agent systems | Agentic AI | Anomaly Detection | Cloud Computing | Cloud platformCross-functional collaboration | Matrixed organization leadership | Mid-shift schedule | Onsite workSenior-level Full Time111442-IND-BENGALURU-INTL BLR BLK B3 PETUNIA, India1d ago
-
TTT - Full Stack .Net Developer - Gen AI - Staff INR 2400K-3217K.NET | ADO.NET | ASP.NET MVC | ASP.Net Core | AgileContinuous learning | Diverse and inclusive culture | Flexible tools and support | Transformative leadershipSenior-level Full TimeBengaluru, KA, IN, 5600161d ago
-
Senior AI and Machine Learning Engineer INR 3000K-4680KConvolutional Neural Networks | Data Mining | Data Preprocessing | Data Visualization | Decision TreesCareer Development Programs | Flexible work arrangements | Health and wellbeing benefits | Hybrid work schedule | Inclusion initiativesSenior-level Full TimeBengaluru, Karnātaka, India R1d ago
-
API | JSON | Java | JavaScript | PythonOpportunity to work on AI projects | Remote workMid-level ContractIndia; Pakistan; Nigeria; Kenya; Egypt; Ghana; … R1d ago
-
AI QA & Evaluation Engineer INR 3584K-4580KAWS | Artificial Intelligence | Azure | Benchmarking | CI/CDFlexible schedule | Health insurance | Parental leave | Vacation days | Volunteer timeMid-level Full TimeBangalore, India2d ago
-
Senior Snowflake Engineer INR 2000K-4200KAPI Development | AWS | Apache Airflow | Automated testing | AzureCertification programs | Health insurance | Internal mobility | Language courses | MentorshipSenior-level Full TimeAll Cities, India R2d ago
-
Senior-level Full TimeBangalore, India Office (BANGALORE) R2d ago