Custom Software Engineer
Hyderabad, HDC4A, India
INR 700K-1500K (estimate) Mid-level Full Time
Tasks
- Automate monitoring and housekeeping with scripts
- Collaborate with data engineers and architects on ETL operations
- Maintain runbooks and troubleshooting guides
- Manage Databricks access controls permissions and entitlements
- Manage and troubleshoot integrations with Azure services
- Manage connections to ADLS Gen2 Azure SQL Synapse ADF and Event Hubs
- Monitor platform health and job performance
- Perform incident management and root cause analysis
- Perform performance tuning for PySpark jobs and SQL queries
- Provide operational support for Azure Databricks clusters jobs notebooks and workspaces
- Resolve L2 L3 Databricks problem tickets
- Resolve checkpoint corruption consumer lag and schema drift
- Support Delta Lake operations
- Support Delta Sharing and Unity Catalog data governance
- Support real time streaming pipelines
- Troubleshoot cross tenant workspace data access
- Troubleshoot pipeline cluster and data latency issues
Perks/Benefits
Skills/Tech-stack
Autoscaling | Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Key Vault | Azure Monitor | Azure SQL | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Factory | Data Lake Storage Gen2 | Databricks | Delta Lake | Delta Sharing | Event Hubs | Git | Jira | Key Vault | Log Analytics | Powershell | PySpark | Python | Repos | SQL | ServiceNow | Synapse Analytics | Terraform | Unity Catalog
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Senior-level Full TimeKochi, India6h ago
-
DevOps Engineer (AI Platform) INR 2000K-4800KAccess Control | Application Insights | Azure DevOps | Bicep | Cloud NetworkingSenior-level Full TimePune, Maharashtra, India7h ago
-
ML Developer (with Computer Vision Expertise)- Eurasia INR 2500K-5000KAWS | Adversarial Networks | Algorithms | Azure | Convolutional Neural NetworksSenior-level Full TimePune City, India7h ago
-
Software Developer (AIML) INR 1800K-2700KAWS | Azure | CI/CD | Computer Vision | Convolutional Neural NetworksFlexible working hours | Growth and learning | Referral bonus | Team building events | Training and booksMid-level Full TimePune, India7h ago
-
Robotic Process Automation (RPA) Professional INR 2500K-4000K.NET | AI Center | API Integration | Automation Cloud | Azure CopilotSenior-level Full TimePune - Maharashtra - India8h ago
-
Mid-level Full TimeKarnataka, Bengaluru, India8h ago
-
Senior-level Full TimePune, Maharashtra, India9h ago
-
AI and Automation Engineer INR 2000K-4800KAI Security | BigQuery | Chain-of-Thought | Claude API | Cloud FunctionsAnnual leave | Casual leave | Public holidays | Sick leaveSenior-level Full TimeGurugram, India10h ago
-
Sr.Data Engineering INR 1500K-2500KAzure | Azure Data | Azure Data Factory | Azure Databricks | Azure Key VaultSenior-level Full Timebengaluru, India10h ago
-
Associate Consultant - Data Engineer(Python/Pyspark) INR 1500K-2200KAgile | Azure | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeBangalore, Karnataka, India11h ago
-
Engineering Lead - Data & Analytics INR 1600K-3000KAWS | Agentic Analytics | Agile | Artificial Intelligence | Automated DeploymentSenior-level Full TimePune, MAHĀRĀSHTRA, India11h ago
-
Java Fullstack Engineer with GenAI & React INR 1500K-2500KAgile Development | Azure | Design Patterns | Docker | Extreme programmingEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India12h ago
-
Data Scientist INR 1800K-3000KApache Spark | Artificial neural networks | Chunking | Data Structures | Deep learningMid-level Full TimeKarnataka, India13h ago
-
Senior-level Full TimeMumbai, Maharashtra, India13h ago
-
Data Engineer III INR 2000K-3000KAI tools | Data Modeling | Data Pipelines | Data analytics | NoSQLSenior-level Full TimeBengaluru, Karnataka, India13h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India13h ago
-
Embedded Hardware Development INR 2500K-4460KCAN-FD | Codebeamer | DSO | EMMC | Engineering Test ManagementSenior-level Full Timebengaluru, India13h ago
-
Software Engineer INR 1500K-2100KAWS | Agile | Bash | CI/CD | CloudWatchFamily wellbeing benefits | Health and wellbeing benefits | Hybrid work | Paid time off | Work-life balance benefitsMid-level Full TimeHyderabad, India R14h ago
-
CDP,Snowflake,SQL,Java, API, AWS - (6-9 Yrs) - CHN INR 2000K-3000KAPI Integration | AWS | Audience Management | Customer Data | Customer Data PlatformSenior-level Full TimeIndia14h ago
-
Lead Assistant Manager INR 1500K-3000KAWS | Agile | Angular | Application Monitoring | Artificial IntelligenceMentoring | Team collaboration | Technical leadershipSenior-level Full TimePune, Maharashtra, India14h ago
-
ML Engineer INR 2000K-3500KAutomated Pipelines | C# | C++ | Classification | ClusteringAnnual leave | Employee assistance programme | Employee wellbeing platform | Flexible benefits | Flexible workingSenior-level Full TimeBangalore, IN15h ago
-
Control Path Engineer INR 2000K-3000KAPI Design | Automation | C++ | CI/CD | Configuration ManagementSenior-level Full TimePune Office16h ago
-
Private Investments Analytics- Associate INR 1400K-2400KAdvanced Analytics | Artificial Intelligence | Automation | Cloud Computing | Data EngineeringMid-level Full TimeMumbai, Maharashtra, India16h ago
-
AWS | Artificial Intelligence | Azure | CI/CD | Computer VisionCareer development | Inclusive culture | Professional learning | Remote workSenior-level Full TimeIndia R18h ago
-
Data / Retrieval Engineer INR 3200K-4720KAPIs | Access Control | Attribute-Based Access Control | Attribute-based access | ChunkingSenior-level Full TimeNoida/Gurgaon, UP, IN R20h ago