Custom Software Engineer
Tasks
- Build lakehouse pipelines
- Collaborate with cross-functional teams
- Create datasets for BI and ML
- Deliver streaming and CDC solutions
- Deploy CI/CD pipelines
- Develop ELT and streaming pipelines
- Implement Unity Catalog governance
- Integrate Azure data services
- Mentor junior engineers
- Monitor and improve data pipeline performance
- Optimize Delta Lake
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure Synapse | Azure Synapse Analytics | CI/CD | Change Data Capture | Data Capture | Data Factory | Data Lake Storage | Databricks | Delta Lake | Feature Store | Java | MLflow | Microsoft Azure | Power BI | PySpark | Python | RAG | SQL | Scala | Streaming | Synapse Analytics | Terraform | Unity Catalog | Vector Search
Education
N/A
Roles
Related jobs
-
Senior Software Development Engineer INR 2500K-4000KAgile | Artificial Intelligence | CI/CD | Data Engineering | Data LakeSenior-level Full TimeIndia8h ago
-
Qualtrics/Tableau - Analytics - Associate INR 4000K-4000KAgile | CI/CD | Dashboard governance | Data Modeling | Data pipelineExecutive-level Full TimeBengaluru, Karnataka, India9h ago
-
Software Engineer -Snowflake Development INR 1000K-1500KAWS | Acceptance Testing | Agile | Azure | CSVFlexible hybrid work model | Health insurance | Life insurance | Paid time off | Pension/retirement benefitsMid-level Full TimeChennai, India9h ago
-
Senior Embedded DevOps Engineer INR 2000K-3000KBuild Tools | CI/CD | Change Management | Cloud Computing | Configuration ManagementSenior-level Full TimeBangalore, IN10h ago
-
AI/ML Architect INR 2500K-5000KAmazon Web Services | Anomaly Detection | Azure | Cloud platform | Data IngestionSenior-level Full TimeChennai, TN, India11h ago
-
Data Engineer INR 1500K-2500KAnalysis Services | Azure Analysis | Azure Analysis Services | Azure Blob | Azure Blob StorageMid-level Full TimeHyderabad, IN11h ago
-
Member of Technical Staff 4 INR 3242K-4580KAWS | Amazon Redshift | Azure Synapse | Azure Synapse Analytics | Backend architectureFlexible working arrangement | In-office 3 days per weekSenior-level Full TimeHyderabad, India12h ago
-
Senior Data Engineer, BizTech INR 3080K-4400KAmazon Redshift | Apache Flink | Apache Kafka | Apache Spark | Batch Data ProcessingSenior-level Full TimeBangalore, India13h ago
-
Dashboard & Analytics Lead INR 2475K-3900KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeNew Delhi, IN14h ago
-
Senior-level Full TimeIN-Pune14h ago
-
VP - Applied AI ML Lead INR 2817K-4680KApache Hive | Apache Spark | Keras | Language Models | Language ProcessingSenior-level Full TimeBengaluru, Karnataka, India15h ago
-
AI Agents | APIs | AWS | Application Modernization | AutomationCertification support | Employee Wellness Initiatives | Flexible work arrangements | Health insurance | Learning and developmentSenior-level Full TimeIndia15h ago
-
API Development | Access Control | CI/CD | MySQL | Next.jsSenior-level Full TimePAN India, KA, IN19h ago
-
Testing Engineering Specialist Advisor INR 2475K-3380K.NET | AI Search | AWS | Application Insights | AzureSenior-level Full TimeNoida, UP, IN R19h ago
-
AI Solutions Engineer - Mergers & Acquisitions PLN 14K-26KAPI Gateway | AWS ECS | AWS Lambda | Authentication | AuthorizationMid-level Full TimePune DIA, India19h ago
-
Data Engineer III INR 2800K-4000KAWS | AWS CDK | AWS Glue | AWS Glue Workflows | AWS KinesisAccident insurance | Casual leave | Compassionate leave | Employee assistance program | Flexible working arrangementSenior-level Full TimeIndia-Chennai (Ascendas Tech park)19h ago
-
Systems Integration Specialist Advisor_Storage Cloud INR 800K-1099KAWS | Access Control | Automation | Block Storage | CI/CDMid-level Full TimeBangalore, KA, IN R19h ago
-
Entry-level Full TimeBangalore, KA, IN19h ago
-
Mid-level Full TimeBengaluru, BDC6F, India19h ago
-
Packaged/SaaS Application Engineer INR 1000K-2100KAI Search | AI Studio | API Development | API Management | AgileMid-level Full TimeHyderabad, HDC4A, India19h ago
-
Data Engineer INR 100K-1000KData Governance | Data Modeling | Data Pipelines | Data Quality | Data TransformationMid-level Full TimeGurugram, Haryana, India19h ago
-
AI / ML Engineer INR 1200K-2500KAI Services | Chatbot Development | Cloud AI | Cloud AI services | Deep learningMid-level Full TimeBengaluru, BDC11A, India19h ago
-
DE-Azure Cognitive VA And AI Developer-GDSN02 INR 1500K-2800KAI Studio | API Integration | Access Control | Agile | AzureMid-level Full TimeCoimbatore, TN, IN, 64104919h ago
-
Mid-level Full TimeBengaluru, BDC9A, India19h ago
-
AI / ML Engineer INR 1000K-2100KAI Foundry | Azure AI Foundry | Azure Machine Learning | Azure OpenAI Service | CI/CDMid-level Full TimeHyderabad, HDC3B, India19h ago