Custom Software Engineer
Gurugram, DDC2A, India
INR 1500K-1700K (estimate) Mid-level Full Time
Tasks
- Apply performance tuning to PySpark jobs and SQL queries
- Automate monitoring and housekeeping scripts
- Collaborate with data engineers and architects on ETL operations
- Handle incident management and RCA
- Maintain runbooks and troubleshooting guides
- Manage ADLS Gen2 and external data source connections
- Manage permissions and access controls
- Monitor platform health and job performance
- Participate in on-call rotation for production support
- Provide operational support for Azure Databricks clusters
- Support Delta Lake schema evolution and versioning
- Support Delta Sharing and Unity Catalog data governance
- Support real time streaming pipelines
- Troubleshoot cross tenant data access
- Troubleshoot pipelines clusters and data latency
Perks/Benefits
Skills/Tech-stack
Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Key Vault | Azure Monitor | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Factory | Data Lake Storage Gen2 | Databricks | Delta Lake | Delta Sharing | Event Hubs | Firewall Rules | Git | Jira | Key Vault | Log Analytics | Networking | Powershell | Private Endpoint | PySpark | Python | SQL | ServiceNow | Synapse Analytics | Terraform | Unity Catalog | Virtual Network
Education
Associate Degree | Bachelor of Engineering | Bachelor of Science | High School Diploma | Master of Science | PhD
Roles
Related jobs
-
Data Engineer INR 400K-1200KApache Airflow | CI/CD | DBT | Data Quality | Dimensional ModelingOn-call rotationSenior-level Full TimeIN-KA-Bangalore4h ago
-
Python Robot QA INR 1524K-2541KAgile Software Development | Agile software | Azure DevOps | Backup and Recovery | C#Senior-level Full TimeIN-AP-Hyderabad4h ago
-
AI/ML | API Integration | Automation workflows | Chatbot Integration | Document processingEntry-level Full TimeNashik, MH, India5h ago
-
Group Manager - Data Engineering INR 1500K-2000KAPI | Authentication | BeautifulSoup | Data Governance | Data QualityMid-level Full TimeBangalore, KA, India5h ago
-
Machine Learning Engineer INR 2500K-3000KC plus plus | C# | Data Modeling | Data Structures | Deep learningMid-level Full TimeHyderabad, India5h ago
-
Associate Business Intelligence Analyst INR 850K-1200KAgile | Classification | Clustering | Data Analysis | Data PreprocessingMid-level Full TimeHyderabad, Telangana, India5h ago
-
Mid-level Full TimeGurgaon, Haryana, India6h ago
-
Linguistic Engineer INR 2200K-3000KBias Mitigation | Conversational AI | Hack | Knowledge graphs | Language ProcessingMid-level Full TimeHyderabad, India6h ago
-
Assistant Manager - Gen AI INR 1000K-1250KAPIs | AgentOps | Amazon SageMaker | Apache Airflow | Azure MLMid-level Full TimeBangalore, Karnataka, India6h ago
-
Assistant Manager - Gen AI INR 1000K-1250KAPIs | AWS | AWS SageMaker | Airflow | AzureAccess to AI research labs | Access to cloud innovation platforms | Certifications | Opportunity to lead POCsMid-level Full TimeBangalore, Karnataka, India6h ago
-
Assistant Manager - Gen AI INR 1000K-1250KAPI Design | AWS SageMaker | Airflow | Azure Machine Learning | CI/CDAccess to AI research labs | Cloud innovation platforms | Professional certificationsMid-level Full TimeBangalore, Karnataka, India6h ago
-
Assistant Manager - Gen AI INR 1000K-1350KAPIs | Amazon SageMaker | Apache Airflow | Apache Spark | Azure MLAccess to certifications | Access to cloud innovation platforms | Work on AI research labsMid-level Full TimeBangalore, Karnataka, India6h ago
-
Mid-level Full TimeBengaluru, Karnataka, India6h ago
-
Entry-level Full TimeIndia6h ago
-
Senior Software Engineer (C, C++ and embedded Linux.) INR 1500K-2200KAgile | Bash | C# | C++ | Cloud ComputingSenior-level Full TimeHyderabad, TS, India7h ago
-
Sr. C++ Embedded Developer with Network INR 1800K-2500KBitbucket | C plus plus | CAN | CANopen | CMakeSenior-level Full Timebangalore, India7h ago
-
Senior-level Full Timebangalore, India7h ago
-
Associate Process Manager INR 1800K-3000KData Preprocessing | Elasticsearch | Embeddings | Faiss | FastAPIMid-level Full TimeMumbai, Maharashtra, India8h ago
-
API Integration | Agile | Alert Correlation | Ansible | ApacheSenior-level Full TimeBengaluru, INDIA, India9h ago
-
Senior AI/ML Engineer I INR 2500K-4000KAgentic AI | BERT | Continuous integration | Decoder Architecture | Distributed SystemsCareer growth opportunities | Certification programs | Continuous learning programs | Corporate NPS | Education reimbursement programsSenior-level Full TimeHyderabad, Telangana, India9h ago
-
Platform Engineering Professional - Data Engineer INR 2800K-4000KAWS | Ab Initio | Apache NiFi | Apache Spark | BigQueryCareer development | Inclusive workplace | Learning opportunitiesMid-level Full TimeBengaluru, IN, 5601039h ago
-
Manager, Data Science and Analytics INR 1500K-2000KClustering | Data Pipelines | Experimentation | Language Processing | Model MonitoringMid-level Full TimeBangalore, India10h ago
-
Staff Data Engineer (Bigdata + Golang/ Java/ Rust/ C/C++) INR 2250K-3500KAmazon Web Services | Azure | C++ | Cloud platform | Data ProcessingHybrid workSenior-level Full TimeBengaluru, INDIA, India10h ago
-
Mid-level Full TimeBengaluru, Karnataka, India12h ago
-
Data Engineer /ETL Lead Sr Technical Lead-Data Engg INR 300K-370KAWS | Ab Initio | Agile | CI/CD | Cost OptimizationSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …17h ago