Software Engineering - Data, Lakehouse and AI Data Platform Engineer-Hyderabad-Vice President
Bengaluru, Karnataka, India
INR 3000K-6000K (estimate) Executive-level Full Time
Tasks
- Apply data modelling principles
- Build batch and streaming data pipelines
- Communicate progress risks dependencies and design choices
- Define testing monitoring and issue resolution standards
- Deliver outcomes with engineers and data consumers
- Develop raw refined and curated datasets
- Develop reusable data tooling
- Ensure production ready pipelines
- Implement data quality validation
- Improve testing monitoring and reconciliation tooling
- Perform data reconciliation and investigations
- Provide technical leadership and task breakdown
- Refactor data flows for reliability and performance
- Shape data products with stakeholders
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Iceberg | Apache Spark | Avro | CI/CD | Containerization | Data Modeling | Data Quality | Data Reconciliation | Databricks | Hadoop | JSON | Java | Kafka | Kubernetes | Parquet | Python | SQL | Snowflake | Testing | Version control
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Pyspark Bigdata INR 1500K-2500KArchitecture | Big Data | Data Engineering | Data pipeline | Development Life CycleMid-level Full TimeIN-MH-Pune4h ago
-
Cognitive Engineer INR 1500K-3000KAPI Integration | Agent architecture | Application Default Credentials | Asynchronous programming | Automated testingMid-level Full TimeIndia4h ago
-
Applied AI/ML Senior Associate INR 3799K-5000KApache Hive | Apache Spark | Keras | Language Processing | Machine LearningSenior-level Full TimeBengaluru, Karnataka, India6h ago
-
AI Agents Applied Research/Engineering Lead - Executive Director INR 2500K-5000KA/B | A/B Testing | Adversarial Testing | Agent Orchestration | AuditabilityDiversity and inclusion | Publication opportunities | Research deployment to productionSenior-level Full TimeBengaluru, Karnataka, India6h ago
-
AWS | AWS Lake Formation | AWS Lambda | Airflow | Amazon EMRCareer development opportunities | Employee Assistance Program (EAP) | Financial wellness tools | Flexible working environment | LinkedIn LearningSenior-level Full TimePune, MH, India6h ago
-
Lead Software Engineer - Java, AWS, React INR 2500K-5000KAWS | Agile | Analysis and Design | Asynchronous Communication | Automated testingSenior-level Full TimeHyderabad, Telangana, India7h ago
-
Senior AI Engineer INR 3264K-5000KAI Services | Access Management | Anomaly Detection | Azure | Azure AISenior-level Full TimeIndia7h ago
-
Cognitive Engineer INR 1500K-3000KAPI Integration | Agent architecture | Application Default Credentials | Asynchronous programming | Automated testingMid-level Full TimeIndia7h ago
-
Consultant - Python Developer with Gen AI using GCP INR 2000K-5000KAPI Development | Cloud platform | Gemini Enterprise | Google ADK | Google CloudClient site work 5 days per weekSenior-level Full TimeBangalore, Karnataka, India7h ago
-
Automated testing | Business Intelligence | CI/CD | Dashboards | Data MartMid-level Full TimeHyderabad, Telangana, India7h ago
-
DataOps Engineer INR 1600K-4000KAWS | AWS Direct Connect | AWS PrivateLink | AWS Transit Gateway | AWS VPNSenior-level Full TimeMumbai, India8h ago
-
DataOps Engineer INR 1600K-4000KAWS | AWS Direct Connect | AWS PrivateLink | AWS Transit Gateway | AWS VPNSenior-level Full TimeMumbai, India8h ago
-
Assistant Manager - RNA INR 1500K-2525KAWS | AgentFlow | Asynchronous programming | Autogen | AzureMid-level Full TimeBangalore, KA, India9h ago
-
Lead Data Integration Engineer INR 2000K-3000KAgile Scrum | CI/CD | Data Lake | Data Modeling | Data PipelinesHealth and life insurance | Hybrid work model | Paid time off | Pension/retirement benefits | Personal/family careSenior-level Full TimeChennai, India R9h ago
-
Senior-level Full TimeIndia9h ago
-
Senior-level Full TimeBangalore, KA, IN,10h ago
-
Mid-level Full TimeTelangana, India10h ago
-
QA Engineer (C1) - Agentic AI INR 1000K-2500KAI Observability | AI Safety | API Testing | AWS | Agent OrchestrationMid-level Full TimeIndia11h ago
-
Associate Consultant - Data Engineer(Python/Pyspark) INR 1500K-2000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure SynapseMid-level Full TimeBangalore, Karnataka, India11h ago
-
AVP, Salesforce Engineer - IB Tech & CRM/ Analytics INR 2000K-3000KAgile | Apex | Git | JSON | Lightning WebExecutive-level Full TimePune, India11h ago
-
Mid-level Full TimeBengaluru, KA, India12h ago
-
Senior Data Engineer - Remote INR 2520K-3380KAWS Athena | AWS CloudWatch | AWS Glue | AWS IAM | Amazon SQSFlexible schedule | Night shift flexibility | Remote workSenior-level Full TimeChennai, TN, IN R14h ago
-
Software Engineering Expert (AI Training) USD 200K-460KAlgorithms | C++ | Code Refactoring | Data Structures | DebuggingFast onboarding | Flexible contractor schedule | Remote workMid-level Contract Full TimeIndia - Remote R16h ago
-
Lead Analytics Consultant INR 2755K-4064KCloud Data | Dashboard administration | Data Analysis | Data Lake | Data ValidationSenior-level Full Time110741-IND-BENGALURU-INTL BLR BLK 2A ASTER, India16h ago
-
Data Engineer II INR 720K-2000KAWS Redshift | Apache Airflow | Azure Data | Azure Data Factory | Azure DevOpsCalm app subscription | Casual leave | Employee assistance program | Employee reimbursement for fitness journey | Financial aid for crècheMid-level Full TimeIndia16h ago