IN_Senior Associate_Data Engineer_Application Technology_Advisory_Kolkata
Kolkata Y-14, India
INR 2040K-3500K (estimate) Senior-level Full Time
Tasks
- Automate Databricks deployment
- Build ETL/ELT pipelines
- Configure CI/CD pipelines
- Deploy data infrastructure with IaC
- Design bronze silver gold architecture
- Develop reusable Python libraries
- Ensure audit logging and run tracking
- Implement data quality checks
- Implement deployment promotion workflows
- Implement network security
- Integrate databases and message queues
- Manage Databricks Unity Catalog
- Manage secrets key vault integration
- Optimize Spark transformations
- Package Python into wheels
- Perform data performance tuning
- Write unit tests and error handling
Perks/Benefits
- N/A
Skills/Tech-stack
Access Control | Access Control Lists | Asset bundles | Azure Bicep | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure DevOps | Azure Event | Azure Event Hubs | Azure Key Vault | Azure Synapse | Azure Synapse Analytics | CI/CD | Cosmos DB | DAG | Data Factory | Data Governance | Data Lake Storage Gen2 | Databricks | Databricks (asset) | Databricks Asset Bundles | Databricks Repos | Databricks Unity | Databricks Unity Catalog | Delta Lake | Delta Live Tables | Delta Live) | Django | Event Hubs | Flask | Git | GitHub Actions | Kafka | Key Vault | Lineage | Private Link | PySpark | Pytest | Python | Spark SQL | Synapse Analytics | Terraform | Unit Testing | Unity Catalog | Virtual Network
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
API Design | AWS | Azure | Cloud Architecture | Cloud platformContinuous learning | Inclusive collaborative culture | Performance bonuses | Professional development | Remote friendly work environment within IndiaSenior-level Full TimeIndia3h ago
-
Asynchronous processing | Backend architecture | CI/CD | Caching | Computer VisionCareer growth opportunities | Collaborative and inclusive culture | High ownership and autonomy | Opportunity to work on cutting-edge AISenior-level Full TimeIndia3h ago
-
Software Engineer – AI & Automation - Senior Manager INR 3000K-5000KAPI Development | Agent workflow | Cost Optimization | Guardrails | Hallucination mitigationEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India8h ago
-
Senior-level Full TimeIndia Office13h ago
-
Senior Software Engineer (Java Full Stack /AWS) INR 2775K-4200KAWS | AWS Security | Agile | CI/CD | Container OrchestrationFamily well-being benefits | Health benefits | Paid time offSenior-level Full TimeHyderabad, India17h ago
-
Sr. Data Engineer INR 1500K-2400KAWS Glue | Amazon S3 | Apache Airflow | Apache Flink | Apache KafkaSenior-level Full TimeBangalore North, India18h ago
-
Bash | Data Pipelines | Distributed Systems | Docker | GCPAccess to cutting-edge technologies | Autonomy | Bonus opportunities | Collaborative culture | Distributed first work environmentSenior-level Full TimeIndia R18h ago
-
Specialist, Data Management & Quantitative Analysis II INR 1400K-2000KAmazon S3 | CI/CD | Dashboards | Data APIs | Data VisualizationFlexible benefits | Paid time off | Paid volunteer time | Training and demos | Wellbeing programsMid-level Full TimePune, MH, India19h ago
-
Senior Clinical Data Engineer INR 2000K-2500K21 CFR Part 11 | Audit trails | CDISC | CFR Part 11 | Dashboard DevelopmentSenior-level Full TimeBangalore, Karnataka, India19h ago
-
GenAI Engineer INR 2500K-4500KAWS Bedrock | Amazon Web Services | Azure OpenAI | ChromaDB | Efficient Fine TuningSenior-level Full TimeIN-TN-Chennai19h ago
-
Senior-level Full TimeIN-AP-Hyderabad19h ago
-
Senior-level Full TimeIN-MH-Pune19h ago
-
Senior Software Engineer INR 2500K-3380KAPI Development | AWS | Apache Airflow | Apache Hive | Apache SparkSenior-level Full TimeBengaluru, Karnataka, India19h ago
-
Lead Data Engineer #3194 INR 3000K-5000KAccess Control | Code Repository | Compute Optimization | Data Governance | Data LineageFlexible working hours | Global collaboration | Learning and development programs | Opportunity for advanced tools and technologies | Performance rewards and recognitionSenior-level Full TimeChennai, India19h ago
-
Lead AI/ML Engineer INR 3000K-5000KAzure | Data Normalization | Data Preprocessing | Data cleaning | Deep learningCar lease | Career advancement opportunities | Certification programs | Corporate NPS | Dental insuranceSenior-level Full TimeBangalore, Karnataka, India19h ago
-
Assistant Manager - Cloud & AI Architect INR 3000K-5000KAI Foundry | Agentic AI | Ansible | Artifact management | AzureSenior-level Full TimeBangalore, Karnataka, India20h ago
-
Assistant Manager - Cloud & AI Architect INR 3000K-5000KAI Foundry | Agent Builder | Ansible | Artifact management | AzureClient advisory | Executive presentations | Team mentoringSenior-level Full TimeBangalore, Karnataka, India20h ago
-
Assistant Manager - Cloud & AI Architect INR 3000K-5000KAI Foundry | Agent Orchestration | Ansible | Artifact management | AzureBusiness development | Client advisory | Client relationship management | Growth mindset | MentorshipSenior-level Full TimeBangalore, Karnataka, India20h ago
-
Assistant Manager - Cloud & AI Architect INR 3000K-5000KAI Foundry | Agentic AI | Ansible | Artifact management | AzureSenior-level Full TimeBangalore, Karnataka, India20h ago
-
Databricks Developer / Data Architect INR 1500K-2500KAWS | Apache Airflow | Apache Spark | Azure | Azure DataSenior-level Full TimePune, Maharashtra, India20h ago
-
AI | Android | Bandwidth Optimization | C# | C++Remote work optionSenior-level Full TimeIndiranagar, India20h ago
-
Data Architect - Offshore INR 3000K-4000KAzure Data | Azure Data Lake | Azure Data Lake Storage | Azure SQL | Data ArchitectureSenior-level Full TimePune, Maharashtra, India20h ago
-
SQL,GCP/Consultant Specialist INR 500K-1500KAWS | Agile Scrum | Backup and Recovery | Cloud Computing | Cloud Platform (GCPMid-level Full TimePune, Maharashtra, India R21h ago
-
C# | C++ | Compilers | Consistency | Database InternalsEntry-level Full TimeBengaluru, Karnataka, India21h ago
-
AWS | Algorithms | Apache Calcite | Apache Hive | Apache ImpalaCareer development opportunities | Employee resource groups | Health and wellness programs | Internet reimbursement | Paid time offSenior-level Full TimeIndia21h ago