Senior Talend Developer / Lead Data Engineer
Tasks
- Architect Azure data integration using Azure Data Factory Azure Synapse and Azure Data Lake Storage
- Architect end-to-end integration solutions
- Build ETL workflows using Talend
- Build data lineage metadata and traceability
- Configure job execution tasks triggers and error recovery
- Create observability dashboards
- Define data mapping standards and transformation rules
- Deploy jobs using Talend JobServer and ESB Runtime
- Design reusable data pipelines
- Develop SAP integration workflows using IDoc BAPI RFC OData and extract files
- Develop scalable batch and near real time pipelines
- Develop transformations using Databricks PySpark and Delta Lake
- Ensure RBAC encryption key vault auditing and secure configuration
- Evaluate streaming architectures using Kafka or Azure Event Hub
- Implement data profiling cleansing validation transformation mapping and auditing
- Implement data quality frameworks validation and health checks
- Integrate SAP databases APIs and files
- Integrate Talend with Azure DevOps or GitHub Actions CI CD
- Manage Talend deployments scheduling and monitoring
- Mentor and guide data engineers and perform code reviews
- Migrate legacy file transfers and XML interfaces
- Optimize pipeline performance and cloud cost
- Support Databricks ML for data quality and anomaly detection
Perks/Benefits
- N/A
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOps | Azure Event | Azure Event Hub | Azure Key Vault | Azure Monitor | Azure Synapse | BAPI | CI/CD | Data Factory | Data Lake Storage | Data Lineage | Data Quality | Data integration | Databricks | Delta Lake | ESB Runtime | Encryption | Event Hub | GitHub Actions | Grafana | Groovy | IDOC | Kafka | Key Vault | MQ | MongoDB | OData | PySpark | Python | RBAC | RFC | RabbitMQ | SAP ECC | SAP S4HANA | SQL | Solace | TAC | TMC | Talend | Talend DI | Talend Data Integration | Talend ESB | Talend Git | Talend JobServer | Talend TAC | Talend TMC | Version control | XML | XSD | XSD schema
Roles
Data Engineer | Developer | Engineer | Lead | Lead Data | Lead Data Engineer | Senior Talend Developer | Talend Developer
Related jobs
-
Senior AI Engineer INR 3000K-5000KAPI deployment | Adversarial Testing | Auto Retraining | Azure ML | CI/CDSenior-level Full TimeBangalore5h ago
-
Azure Data | Azure Data Factory | CI/CD | Data Factory | Data ReconciliationSenior-level Full TimeBangalore, India5h ago
-
Solutions Architect INR 2400K-3500KADLS | AWS | Airflow | Azure | CassandraBootcamp training | Broadband reimbursement | Continuous learning opportunities | Medical insurance | Paid certificationsSenior-level Full TimeIndia - Remote R7h ago
-
Sr. SW Engineer, Machine Learning INR 2475K-3465KA/B | A/B Testing | Agent systems | B testing | CI/CDFinancial wellness support | Hybrid work | Mental health support | Time offSenior-level Full TimeBengaluru, India7h ago
-
Sr GIS Data Engineer -Python l AI ML l SQL INR 1800K-2500KArcGIS | Batch Processing | Data Pipelines | Data Quality | FMESenior-level Full TimeMumbai, MH, India7h ago
-
Mid-level Full TimeIT Centre Bengaluru GDTC, India11h ago
-
Senior Data Engineer INR 1500K-2500KAccess Control | Azure | Azure Data | Azure Data Factory | Azure SQLSenior-level Full TimeHyderabad, IN, 500 00811h ago
-
Java Technical Lead- Career INR 2000K-3000KAWS | Airflow | Apache Beam | Atlassian | AzureHealthcare package | Hybrid work | Learning platform with guided career tracks | Paid time offSenior-level Full TimeIND-Trivandrum-Equifax Analytics-PEC, India11h ago
-
A/B | A/B Testing | AutoGPT | B testing | Dimensionality ReductionExecutive-level Full TimeMumbai Goregaon, India15h ago
-
Machine Learning Engineer IV INR 4443K-7998KAPIs | Amazon Web Services | Automated testing | Cloud Native | Cloud platformBonuses | Disability insurance | Employee resource groups | Inclusive culture | Life insuranceSenior-level Full TimeRemote, India R17h ago
-
Mid-level Full TimeGurugram20h ago
-
Senior-level Full TimePune City, India21h ago
-
Senior AI Engineer INR 3000K-4500KAPI Development | Anthropic Claude | Bias Mitigation | BigQuery | Cloud ComputingContinued development opportunities | Discretionary bonus scheme | Enhanced maternity leave | Enhanced paternity leave | Flexible workingSenior-level Full TimeKarnataka21h ago
-
Mid-level Full TimePune, Maharashtra, India21h ago
-
AM - Cloud Data Engineer INR 1500K-2500KAWS N/A | Apache Airflow | Apache Kafka | Apache Spark | Azure DataClient-facing experience | Consulting experience | Growth mindset cultureSenior-level Full TimeBangalore, Karnataka, India21h ago
-
AI Engineer – Reliability & Warranty Analytics INR 1800K-3000KBacktesting | BigQuery | CI/CD | Calibration | Cloud RunMid-level Full TimeChennai, Tamil Nadu, India22h ago
-
Associate III Business Intelligence-SUPPORT SERVICES-Data & Analytics - In House Engineering INR 800K-1800KBig Data | Big data concepts | C++ | Data Visualization | Data conceptsMid-level Full TimeBangalore, Karnataka, India23h ago
-
AI Engineer – Retail/CPG Domain INR 1800K-2500KAWS | Azure | Data Governance | Data Modeling | Data SecurityMid-level Full TimeGurugram, Haryana, India1d ago
-
Senior-level Full TimeIndia, Bengaluru (Hybrid) R1d ago
-
Senior Staff Engineer, Gen AI with Java INR 2000K-4000KAI language | Agent Orchestration | Algorithms | Azure AI | Azure AI LanguageSenior-level Full TimeRemote, India R1d ago
-
Consultant - Python Developer with Gen AI and AI Foundry INR 2000K-4000KAWS | Autogen | Azure | Azure OpenAI | Azure OpenAI ServiceSenior-level Full TimeBangalore, Karnataka, India1d ago
-
Customer Implementation Engineer ( Python | AI/ML) INR 2500K-4500KAWS | Azure | CI/CD | Cause analysis | Cloud platformFlexible-hybrid work | Health insurance | Paid parental leave | Paid time offMid-level Full TimeBengaluru1d ago
-
Associate Principal Engineer (India Office) INR 1500K-2000KADLS | Azure Data | Azure Data Factory | Azure DevOps | CDCMid-level Full TimeBangalore, Karnataka, India1d ago
-
Senior-level Full TimePune, Maharashtra, India1d ago
-
Full Stack Developer :: Acon INR 2500K-4500KAI Search | AI Studio | Agentic RAG | Application Security | Arize PhoenixSenior-level Full TimeIndia1d ago