Custom Software Engineer
Pune, PDC3B, India
INR 2400K-3200K (estimate) Senior-level Full Time
Tasks
- Build lakehouse pipelines
- Collaborate with cross-functional teams
- Deploy data sets for BI ML and GenAI
- Develop custom software solutions
- Evaluate and improve development processes
- Implement Unity Catalog governance
- Integrate ADLS ADF Synapse
- Manage CI/CD pipelines
- Mentor junior team members
- Optimize Delta Lake
- Own ELT pipelines
- Own streaming pipelines
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Apache Kafka | Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure Synapse | Azure Synapse Analytics | CDC | CI/CD | Data Factory | Data Lake Storage | Databricks Workflows | Delta Lake | Delta Lake Optimization | DevOps | Feature Store | Java | MLflow | Machine Learning | Microsoft Azure | Microsoft Azure Databricks | Power BI | PySpark | Python | RAG | SQL | Scala | Streaming | Synapse Analytics | Terraform | Unity Catalog | Vector Search
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Roles
Related jobs
-
Senior Software Engineer (Infra) INR 2400K-3500KC++ | Distributed Systems | Java | Networking | PythonSenior-level Full TimeBengaluru, India9h ago
-
Senior Software Engineer - Search INR 2500K-4200KInformation Retrieval | Language Models | Language Processing | Large Language Models | Machine LearningSenior-level Full TimeBengaluru, India10h ago
-
Data Engineering Manager - GCP INR 1500K-2500KAirflow | Apache Spark | BigQuery | CI/CD | Cloud ComposerSenior-level Full TimeHyderabad, TS, India21h ago
-
Anthropic Claude | Application Insights | Asynchronous programming | Automated testing | Azure Application InsightsFlexible working environment | Long-term engagement | Mentorship opportunities | Remote workSenior-level Contract Full TimeIndia R22h ago
-
Mid-level Full TimeBangalore, India Office (BANGALORE)22h ago
-
Senior-level Full TimeHyderabad, Noida, Chennai, India23h ago
-
AI Foundry | AWS | AWS SageMaker | Agentic AI | Amazon Bedrock401k match | Career development resources | Dental insurance | Flexible work arrangements | Health Savings Account medical planSenior-level Full TimeIndia23h ago
-
Engineer, Storage and Data Protection INR 1500K-2600KAlerting | Ansible | Automation | Backup | BashMid-level Full TimeGurugram, Haryana1d ago
-
AWS Glue | AWS Lambda | AWS Step Functions | Amazon EC2 | Amazon EMRSenior-level Full TimeNoida, India1d ago
-
Associate Engineer - Data engineer INR 1000K-1700KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksCollaborative work environment | Professional development | Training opportunitiesMid-level Full TimeBangalore - Karnataka, India - Kalyani …1d ago
-
Senior-level Full TimeGurugram, India1d ago
-
Senior Forward Deployed Engineer INR 1500K-2800KAI APIs | AWS | Apache Spark | Azure | CI/CDCustomer-facing role | Travel 20 percent of the timeSenior-level Full TimeBengaluru, India1d ago
-
Senior Software Engineer, AI/ML INR 2000K-5000K3D mathematics | Agent systems | Autonomous Agents | C plus plus | Computational GeometrySenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Data Engineer (GCP, Azure) INR 1500K-2500KAmazon Web Services | Apache Kafka | Apache Spark | Cloud platform | Data PipelinesSenior-level Full TimePune, Maharashtra, India1d ago
-
Mid-level Full TimeBangalore, Karnataka, India1d ago
-
Applied AI/ML Senior Associate INR 2817K-4680KApache Hive | Apache Spark | Keras | Language Processing | Machine LearningSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Software Engineer - Workflow INR 3715K-5000KAWS | Apache Flink | Apache Kafka | Apache Spark | AzureSenior-level Full TimeIndia (Bengaluru)1d ago
-
Member of Technical Staff INR 3242K-4580KConcurrency | Containerization | Go | Idempotency | KubernetesCompany-sponsored team events | Flexible time off | Wellness resourcesSenior-level Full TimeBangalore, India1d ago
-
Software Engineer, Data Science INR 1000K-2000KD3 | Data Governance | Data Modeling | Data Pipelines | ETLHealth and wellness programs | Time awayMid-level Full TimeBengaluru, KA, India R1d ago
-
Entry-level Full TimePune, Maharashtra, India1d ago
-
Data Engineer 3 INR 1500K-2500KApache Hive | Apache Kafka | Apache Spark | Continuous integration | Data CatalogMid-level Full TimePune, Maharashtra, India1d ago
-
Senior Consultant - Data Engineering-Data Analysis INR 2400K-3500KAWS Redshift | Confluence | ETL | Git | NumPySenior-level Full TimeNoida, Uttar Pradesh, India1d ago
-
Lead Software Engineer - Java AWS Kafka INR 2500K-3500KAWS | Agile | Apache Kafka | CI/CD | CachingSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior Staff Engineer, Supply chain optimization INR 3000K-4500KAMPL | AWS | Agent-Based Simulation | Agent-based | AnyLogicSenior-level Full TimeRemote, India R1d ago
-
D&T Lead - Data Engineer INR 1500K-2500KBatch Processing | CI/CD | Cloud Data | Cloud data warehousing | ConfluenceSenior-level Full TimePune, IN1d ago