IN_Senior Associate_Azure Databricks_D&A_Advisory_Noida
Tasks
- Apply data security controls
- Build lakehouse Delta tables
- Build near real time data pipelines
- Design batch data pipelines
- Develop Databricks jobs
- Develop Databricks notebooks
- Implement data orchestration
- Implement data quality checks
- Maintain curated lakehouse layers
- Manage pipeline dependencies
- Manage secrets for PII data
- Optimize Azure Databricks costs
- Optimize data pipelines
- Perform incident triage
- Schedule data workflows
- Set up logging metrics alerts
- Translate business requirements into data solutions
- Tuning Spark workloads
- Write SQL for analytics datasets
Perks/Benefits
- N/A
Skills/Tech-stack
Alerting | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure DevOps | CI/CD | Data Factory | Data Lake Storage Gen2 | Data Quality | Databricks | Delta Lake | Delta Live Tables | Delta Live) | Encryption | Git | Lakehouse | Logging | Metrics | Microsoft Azure | Observability | PySpark | Python | RBAC | SQL | Secrets management | Spark SQL | Unity Catalog | Z-Order
Education
Bachelor of Engineering | Bachelor of Technology | Master of Engineering | Master of Technology | PhD
Roles
Related jobs
-
AWS | Agent systems | Agentic AI | Amazon SageMaker | Autonomous AgentsSenior-level Full TimeBengaluru Millenia, India2h ago
-
AWS SageMaker | Agent systems | Agentic AI | Autonomous Agents | Azure Machine LearningSenior-level Full TimeBengaluru Millenia, India2h ago
-
Agent systems | Amazon SageMaker | Autonomous Agents | Azure ML | Computer VisionFlexible work arrangements | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India2h ago
-
Agent systems | Agentic AI | Amazon SageMaker | Autonomous Agents | Azure Machine LearningFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India2h ago
-
Azure Databricks | CI/CD | Data Pipelines | Data integration | ETLSenior-level Full TimeGurugram 10 C, India2h ago
-
Azure Databricks | Data integration | ETL | Filtering | JoiningSenior-level Full TimeGurugram 10 C, India2h ago
-
IN_Associate_Python/Gen AI_AI in Delivery_Advisory_Bangalore INR 3000K-4000KAWS | Azure | CI/CD | Data Augmentation | Data PreprocessingFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India2h ago
-
IN_Associate_Python/Gen AI_AI in Delivery_Advisory_Bangalore INR 3000K-4000KAWS | Adversarial Networks | Autoregressive models | CI/CD | Cloud platformFlexible work arrangements | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India2h ago
-
IN_Associate_Python/Gen AI_AI in Delivery_Advisory_Bangalore INR 3000K-4000KAWS | Adversarial Networks | Autoregressive models | Azure | CI/CDFlexibility program | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India2h ago
-
Sr. DevOps Engineer INR 2500K-3500KAIOps | AKS | ARM | Azure Container | Azure Container RegistryRotational on-call supportSenior-level Full TimeHyderabad, India11h ago
-
Database Engineer INR 1500K-2400KAWS RDS | Azure SQL | Backup and Recovery | Data Modeling | Data WarehousingSenior-level Full TimeIN-TN-Chennai13h ago
-
Database Engineer INR 1500K-2500KAWS RDS | Azure SQL | Azure SQL Database | Cassandra | Cloud DatabasesSenior-level Full TimeIN-TN-Chennai13h ago
-
Gen AI Developer INR 2000K-3000KAPI Integration | Claude API | Context Management | CrewAI | FastAPIMid-level Full TimeIN-MH-Pune13h ago
-
Senior-level Full TimeIN-TN-Chennai13h ago
-
Aws Etl INR 1500K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeIN-AP-Hyderabad13h ago
-
Aws Etl INR 1500K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeIN-AP-Hyderabad13h ago
-
Aws Etl INR 1500K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeIN-AP-Hyderabad13h ago
-
Senior-level Full TimeIndia14h ago
-
Azure | Azure Blob | Azure Blob Storage | Azure DevOps | Azure MLSenior-level Full Timebengaluru, India14h ago
-
Staff Software Engineer, Android Embedded Software INR 2000K-3200KAndroid | C++ | Distributed Systems | Java | Performance optimizationSenior-level Full TimeBengaluru, Karnataka, India15h ago
-
DE&A - AWS - Data Engineer + Data Platform Support INR 3000K-4000KAmazon Bedrock | Amazon EC2 | Amazon EMR | Amazon S3 | Amazon SageMakerSenior-level Full TimePune, Maharashtra, India15h ago
-
Mid-level Full TimeMumbai, Maharashtra, India15h ago
-
Manager - Python with Gen AI INR 1800K-3000KAutogen | Claude | CrewAI | Data Pipelines | Event DrivenMid-level Full TimeBangalore, Karnataka, India18h ago
-
Lead Software Engineer - Big Data INR 2040K-3380KAmazon DynamoDB | Apache Avro | Apache Hive | Apache Kafka | Apache ParquetSenior-level Full TimeMumbai, Maharashtra, India18h ago
-
Mid-level Full TimeBangalore, Karnataka, India19h ago