Lead Assistant Manager
Bengaluru, Karnataka, India
INR 1500K-2800K (estimate) Senior-level Full Time
Tasks
- Automate infrastructure deployment with IaC
- Build and optimize Databricks pipelines
- Build batch and real-time data pipelines
- Configure Databricks workspaces and clusters
- Design data lakehouse solutions on Databricks
- Develop Delta Live Tables pipelines
- Develop streaming ingestion pipelines
- Implement CI CD pipelines for Databricks workloads
- Implement Delta Lake tables and optimizations
- Implement data quality and monitoring
- Integrate data with cloud storage and streaming systems
- Maintain data ingestion frameworks
- Manage Unity Catalog governance
- Monitor pipeline and cost performance
- Optimize Pyspark performance
- Prepare technical documentation and runbooks
- Support machine learning workloads with Databricks
Perks/Benefits
- N/A
Skills/Tech-stack
AWS EMR | AWS Glue | Amazon S3 | Apache Kafka | Auto Loader | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure DevOps | Azure Event | Azure Event Hubs | CI/CD | Data Lake Storage | Data Lineage | Databricks | Databricks Feature Store | Delta Lake | Delta Live Tables | Delta Live) | Event Hubs | Feature Store | GitHub Actions | GitLab CI | Great Expectations | Infrastructure as Code | MLflow | Mosaic AI | PySpark | Retrieval-Augmented Generation | Spark SQL | Structured Streaming | Terraform | Unity Catalog | Vector Search | “as-code”
Education
Roles
Related jobs
-
Advanced Engineer - AI/ML with Devops(GCP,AWS) INR 2500K-4200KAWS | Airflow | Amazon Web Services | Apache Spark | Artificial IntelligenceAccess to cutting-edge technologies | Collaborative work environment | Professional development | Training opportunitiesSenior-level Full TimeBangalore - Karnataka, India - Kalyani …5h ago
-
Sr AI Solutions Engineer (Generative AI & Agentic AI) INR 3242K-4062KAI Agent Builder | Agent Builder | Agent Orchestration | BigQuery | Claude APISenior-level Full TimePune, MH, India6h ago
-
Data Engineer INR 3000K-4000KAWS | Amazon Aurora | Automation | Azure | Data ManagementBike to work | Career development program | Educational assistance | Employee assistance program | Employee discountSenior-level Full TimeBengaluru, KA, India R7h ago
-
Software Engineer INR 1200K-2500KAgentic AI | Agile | Artifactory | Azure DevOps | Backend DevelopmentEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India7h ago
-
Principal Software Engineer INR 2475K-4800KAPI Design | Agent Orchestration | Agentic Systems | Automation | By DesignAgile environment | Feature flags | High autonomy | Inclusive culture | Mentorship and coachingSenior-level Full TimeIndia, Telangana, Hyderabad8h ago
-
Associate Engineer INR 1500K-2500KAnalysis Services | Analysis Services Tabular | Azure Analysis | Azure Analysis Services | Azure Analysis Services TabularMid-level Full TimeHyderabad, IN8h ago
-
Senior Data Engineer- Managed services INR 3000K-4000KAzure Cloud | Azure Cloud Adoption | Azure Cloud adoption framework | Azure Data | Azure Data FactoryRemote work opportunitySenior-level Full TimePune, MH, India8h ago
-
Software Engineer III - Data Engineer - Java, Spark, Databricks INR 2000K-3000KAmazon Web Services | Apache Spark | Application Programming | Application Programming Interfaces | Artificial IntelligenceSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
Software Engineer III - Python, PySpark, Databricks, Big Data INR 2000K-2700KAPI Design | AWS Bedrock | Airflow | Amazon Web Services | Apache IcebergSenior-level Full TimeHyderabad, Telangana, India8h ago
-
Senior Analyst, Analytics Engineer INR 2771K-4000KApplication Monitoring | DBT | Data Compliance | Data Governance | Data ModelingRelocation assistance within countrySenior-level Full TimeMumbai, MH, IN10h ago
-
Senior-level Full TimeNoida, Uttar Pradesh, India10h ago
-
Process Manager INR 2000K-5000KAI Agents | AI Foundry | AWS | AWS Bedrock | Agentic AIClient-facing role | Customer workshops | PoC supportSenior-level Full TimePune, Maharashtra, India10h ago
-
Senior-level Full TimePune, Maharashtra, India10h ago
-
IT Solution database engineer INR 1500K-2700KAgile | Azure Data | Azure Data Factory | Azure DevOps | Azure SQLSenior-level Full TimeBengaluru, KA, India11h ago
-
Senior-level Full TimePune, Maharashtra, India11h ago
-
Senior-level Full TimeHyderabad, TS, India12h ago
-
Senior-level Full TimeUttar Pradesh, India12h ago
-
Embedded Software Engineer INR 2475K-3500KARM | Agile | Board Bring-up | Boundary Scan | Bring-upEmployee assistance program | Employee resource groups | Flexible time off | Health insurance | Holiday leaveSenior-level Full TimeHYDERABAD, TELANGANA, India12h ago
-
Python, Pyspark Developer INR 2800K-4000KAgile | AngularJS | Ansible | Big Data | BootstrapDevelopment courses | Digital wellbeing platform | Employee assistance programme | Flexible working | Life insuranceSenior-level Full TimeChennai, IN12h ago
-
Mid-level Full TimeIN-Pune12h ago
-
Senior-level Full TimeIndia13h ago
-
API | AWS SageMaker | Azure Machine Learning | CI/CD | Context engineeringAdvanced AI exposure | Collaborative environment | Continuous learning | Contract engagement | End-to-end ownershipSenior-level Contract Full TimeIndia R14h ago
-
Azure | Azure AD | Azure Data | Azure Data Factory | Azure Data LakeFlexible work arrangements | Healthcare benefits | Insurance | Paid time off | Professional training and developmentSenior-level Full TimeIndia R16h ago
-
Senior Agentic Engineer, AI Platform INR 3000K-5000KAPI Development | AWS | Agent Orchestration | Authentication | AutoscalingSenior-level Full TimeBengaluru R17h ago
-
Mid-level Full TimeKochi, India18h ago