IN_Senior Associate_Data Engineer_Application Technology_Advisory_Kolkata
INR 2040K-3500K (estimate) Senior-level Full Time
Tasks
- Automate Databricks deployment
- Build ETL/ELT pipelines
- Configure CI/CD pipelines
- Deploy data infrastructure with IaC
- Design bronze silver gold architecture
- Develop reusable Python libraries
- Ensure audit logging and run tracking
- Implement data quality checks
- Implement deployment promotion workflows
- Implement network security
- Integrate databases and message queues
- Manage Databricks Unity Catalog
- Manage secrets key vault integration
- Optimize Spark transformations
- Package Python into wheels
- Perform data performance tuning
- Write unit tests and error handling
Perks/Benefits
- N/A
Skills/Tech-stack
Access Control | Access Control Lists | Asset bundles | Azure Bicep | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure DevOps | Azure Event | Azure Event Hubs | Azure Key Vault | Azure Synapse | Azure Synapse Analytics | CI/CD | Cosmos DB | DAG | Data Factory | Data Governance | Data Lake Storage Gen2 | Databricks | Databricks (asset) | Databricks Asset Bundles | Databricks Repos | Databricks Unity | Databricks Unity Catalog | Delta Lake | Delta Live Tables | Delta Live) | Django | Event Hubs | Flask | Git | GitHub Actions | Kafka | Key Vault | Lineage | Private Link | PySpark | Pytest | Python | Spark SQL | Synapse Analytics | Terraform | Unit Testing | Unity Catalog | Virtual Network
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Software Engineer – AI & Automation - Senior Manager INR 3000K-5000KAPI Development | Agent workflow | Cost Optimization | Guardrails | Hallucination mitigationEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India6h ago
-
Senior-level Full TimeIndia Office11h ago
-
Senior Software Engineer (Java Full Stack /AWS) INR 2775K-4200KAWS | AWS Security | Agile | CI/CD | Container OrchestrationFamily well-being benefits | Health benefits | Paid time offSenior-level Full TimeHyderabad, India15h ago
-
Sr. Data Engineer INR 1500K-2400KAWS Glue | Amazon S3 | Apache Airflow | Apache Flink | Apache KafkaSenior-level Full TimeBangalore North, India16h ago
-
Specialist, Data Management & Quantitative Analysis II INR 1400K-2000KAmazon S3 | CI/CD | Dashboards | Data APIs | Data VisualizationFlexible benefits | Paid time off | Paid volunteer time | Training and demos | Wellbeing programsMid-level Full TimePune, MH, India17h ago
-
GenAI Engineer INR 2500K-4500KAWS Bedrock | Amazon Web Services | Azure OpenAI | ChromaDB | Efficient Fine TuningSenior-level Full TimeIN-TN-Chennai17h ago
-
Senior-level Full TimeIN-AP-Hyderabad17h ago
-
Senior-level Full TimeIN-MH-Pune17h ago
-
Lead Data Engineer #3194 INR 3000K-5000KAccess Control | Code Repository | Compute Optimization | Data Governance | Data LineageFlexible working hours | Global collaboration | Learning and development programs | Opportunity for advanced tools and technologies | Performance rewards and recognitionSenior-level Full TimeChennai, India17h ago
-
Lead AI/ML Engineer INR 3000K-5000KAzure | Data Normalization | Data Preprocessing | Data cleaning | Deep learningCar lease | Career advancement opportunities | Certification programs | Corporate NPS | Dental insuranceSenior-level Full TimeBangalore, Karnataka, India17h ago
-
Assistant Manager - Cloud & AI Architect INR 3000K-5000KAI Foundry | Agentic AI | Ansible | Artifact management | AzureSenior-level Full TimeBangalore, Karnataka, India18h ago
-
Assistant Manager - Cloud & AI Architect INR 3000K-5000KAI Foundry | Agent Builder | Ansible | Artifact management | AzureClient advisory | Executive presentations | Team mentoringSenior-level Full TimeBangalore, Karnataka, India18h ago
-
Assistant Manager - Cloud & AI Architect INR 3000K-5000KAI Foundry | Agent Orchestration | Ansible | Artifact management | AzureBusiness development | Client advisory | Client relationship management | Growth mindset | MentorshipSenior-level Full TimeBangalore, Karnataka, India18h ago
-
Assistant Manager - Cloud & AI Architect INR 3000K-5000KAI Foundry | Agentic AI | Ansible | Artifact management | AzureSenior-level Full TimeBangalore, Karnataka, India18h ago
-
Databricks Developer / Data Architect INR 1500K-2500KAWS | Apache Airflow | Apache Spark | Azure | Azure DataSenior-level Full TimePune, Maharashtra, India18h ago
-
AI | Android | Bandwidth Optimization | C# | C++Remote work optionSenior-level Full TimeIndiranagar, India18h ago
-
Data Architect - Offshore INR 3000K-4000KAzure Data | Azure Data Lake | Azure Data Lake Storage | Azure SQL | Data ArchitectureSenior-level Full TimePune, Maharashtra, India19h ago
-
SQL,GCP/Consultant Specialist INR 500K-1500KAWS | Agile Scrum | Backup and Recovery | Cloud Computing | Cloud Platform (GCPMid-level Full TimePune, Maharashtra, India R19h ago
-
C# | C++ | Compilers | Consistency | Database InternalsEntry-level Full TimeBengaluru, Karnataka, India19h ago
-
Data Scientist - Senior INR 3000K-5000KAgile | Amazon Web Services | Anomaly Detection | Azure | Big DataSenior-level Full TimePune, Maharashtra, India19h ago
-
Digital Finance CoE - Azure Data Engineer - Executive INR 1500K-6000KAWS Glue | Azure | Azure Data | Azure Data Factory | Azure DatabricksExecutive-level Full TimeBangalore, Karnataka, India19h ago
-
Senior-level Full TimeIndia20h ago
-
Consultant - AI Engineer with Claude INR 2500K-5000KAWS | Autogen | Azure | Cloud platform | ContainerizationSenior-level Full TimeBangalore, Karnataka, India20h ago
-
Vice President - AI/ML Technical Developer INR 4000K-5199KAgentic Frameworks | Automated testing | Code review | Deployment | EvaluationExecutive-level Full TimeBengaluru, Karnataka, India20h ago
-
Group Manager - Data Engineering INR 1500K-2500KAgile | Apache Airflow | Apache Spark | BigQuery | CI/CDMid-level Full TimeGurgaon, HR, India21h ago