Data Ingestion Specialist (HVR, PySpark, Python, SAP Datasphere SLT, SQL)
IN-KA-BANGALORE-NEON BUILDING WEST TOWER, India
INR 850K-1400K (estimate) Mid-level Full Time
Tasks
- Automate data ingestion workflows
- Build reusable ingestion frameworks and scripts
- Collaborate with ERP teams on data structures and business logic
- Design data ingestion pipelines for ERP systems
- Document processes standards and best practices
- Implement near real time and batch ingestion
- Integrate SAP data using SAP Datasphere SLT
- Monitor ingestion pipelines
- Optimize ingestion scalability performance and cost
- Participate in agile technical and business discussions
- Replicate data using HVR
- Troubleshoot pipeline incidents
- Validate, cleanse, and reconcile data
Perks/Benefits
- Additional benefits
- Disability programs
- Flexible working hours
- Life insurance
- Private medical care
- Wellbeing activities
Skills/Tech-stack
AWS | Azure | Azure Data | Azure Data Factory | CI/CD | Data Factory | Databricks | DevOps | ELT | ETL | HVR | Informatica | OCI | Oracle | PySpark | Python | Qlik | SAP Datasphere | SAP Datasphere SLT | SQL | Tableau | Talend
Education
N/A
Related jobs
-
Fullstack Data Engineer (Remote) INR 800K-2000KAPI Keys | AWS IAM | AWS S3 | AWS VPC | Apache SparkRemote work | UK shift scheduleSenior-level Full TimeMaharashtra, Pune, India R10h ago
-
Principal Consultant - GenAI Engineer INR 3000K-4144KAWS | Agentic AI | Azure | Azure OpenAI | Cloud ComputingSenior-level Full TimeIndia-Pune11h ago
-
Principal Consultant - GenAI Engineer INR 3000K-4725KAWS | Agentic AI | Azure OpenAI | Cloud platform | Deep learningSenior-level Full TimeIndia-Kolkata11h ago
-
Senior DevOps Engineer (AWS | MLOps | Kubernetes) INR 2500K-4000KAWS IAM | Amazon EKS | Amazon S3 | Amazon Web Services | Argo CDHybrid workSenior-level Full TimeMaharashtra, Pune, India11h ago
-
GenAI Azure INR 1800K-2500K.NET | API Management | ASP.Net Core | Access Control | Active DirectoryMid-level Full TimeIN-AP-Hyderabad11h ago
-
Senior-level Full TimeHyderabad, India12h ago
-
Staff Software Engineer, Cloud SQL Postgres INR 1500K-2400KC++ | Database Administration | PostgreSQL | Query Optimization | Relational databasesSenior-level Full TimeBengaluru, Karnataka, India13h ago
-
Actuarial - Data Science INR 1500K-3000KClassification | Data Preprocessing | Data Quality | Explainable AI | Feature EngineeringMid-level Full TimeBangalore, KA, India13h ago
-
Data Engineer II - Python, AWS & Pyspark INR 1500K-2200KAWS | Data Migration | Data Modeling | Data Warehouse | Data pipelineMid-level Full TimeHyderabad, Telangana, India14h ago
-
AWS | Alerting | Audit Logging | Azure | CI/CDSenior-level Full TimePune, MH, India15h ago
-
Consultant - Gen AI Engineer INR 550K-610KAPI Integration | Generative AI | Language Processing | Machine Learning | Natural LanguageEntry-level Full TimeBangalore, Karnataka, India16h ago
-
Manager INR 1000K-1400KData Engineering | Data Quality | Data Sanity | Data Sanity Checking | Data TestingMid-level Full TimeGurugram, Haryana, India16h ago
-
Apache Iceberg | Apache Spark | Avro | CI/CD | Cause analysisEntry-level Full TimeHyderabad, Telangana, India16h ago
-
Engineering-L2-Bengaluru-Vice President-Software Engineering INR 1500K-6000KApache Iceberg | Apache Spark | Avro | CI/CD | DatabricksExecutive-level Full TimeBengaluru, Karnataka, India16h ago
-
Software Engineer III - Data Engineer, AWS, ETL, Python INR 2000K-3500KAWS | CI/CD | Data Governance | Data Lake | Data ProcessingSenior-level Full TimeBengaluru, Karnataka, India17h ago
-
Gen AI Lead engineer INR 3000K-4800KAgentic Frameworks | CI/CD | Data Visualization | Git | LangchainSenior-level Full TimeChennai, Tamil Nadu, India17h ago
-
Engineering-L2-Bengaluru-Associate-Software Engineering INR 1800K-3200KANSI SQL | Apache Iceberg | Apache Spark | Avro | CI/CDSenior-level Full TimeBengaluru, Karnataka, India17h ago
-
Full Stack Developer :: Acon INR 2500K-3500KAI Search | AI Studio | Application Security | Arize Phoenix | Azure AISenior-level Full TimeIndia17h ago
-
Lead Assistant Manager INR 2500K-4500KASR | AWS EC2 | Amazon ECS | Amazon SageMaker | Amazon Web ServicesSenior-level Full TimeNoida, Uttar Pradesh, India17h ago
-
Data Engineer INR 2755K-3500KAPI Development | AWS | Amazon Redshift | Azure | BashHybrid working | Inclusive culture | Learning and development programmesSenior-level Full TimeHyderabad, India17h ago
-
Director of Software Engineering - Big Data, Cloud INR 2000K-6000KAI machine learning | AWS | Agile | Azure | Big DataExecutive-level Full TimeMumbai, Maharashtra, India18h ago
-
Engineering Manager - Batch Compute Infrastructure INR 1800K-2525KAWS | AWS Cloud | Amazon S3 | Apache Airflow | Apache KafkaMid-level Full TimeBengaluru18h ago
-
Assistant Manager-GDC INR 1500K-2000KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageMid-level Full TimeBangalore, Karnataka, India19h ago
-
Data Engineer- AWS+MS Fabric+ Purview INR 2000K-3500K.NET | AWS CloudFormation | AWS Lambda | Amazon EC2 | Amazon RDSSenior-level Full TimePune, Maharashtra, India20h ago
-
Software Engineer III - Databricks, SQL , Python INR 2000K-2800KApache Spark | Cloud technologies | Data Lake | Data Warehouse | DatabricksSenior-level Full TimeBengaluru, Karnataka, India20h ago