Software Engineer - Data Engineering/Generative AI
111443-IND-HYDERABAD-INTL HYD WF CENTRE BLK B8 Twr-4, India
INR 625K-1000K (estimate) Mid-level Full Time
Tasks
- Apply security and compliance requirements with independent judgment
- Build and optimize batch data processing pipelines
- Collaborate with technology colleagues and stakeholders
- Design and optimize data pipelines for high volume processing
- Design code test debug and document data engineering solutions
- Implement CI CD pipelines and remediate vulnerabilities
- Improve service quality and availability
- Monitor schedule and orchestrate batch jobs
- Participate in software installation upgrades and deployments
- Recommend resolutions and escalate issues
- Research evaluate and select technology alternatives
- Use LLMs for automation
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Hadoop | Apache Hive | Apache Spark | Autosys | Bash | Batch Processing | Big Data | Big Data Pipelines | CI/CD | Cloud platform | Data Governance | Data Modeling | Data Pipelines | Data Quality | Data Warehousing | Data quality assurance | Database Design | Delta Lake | Dremio | GCP | Google Cloud | Google Cloud Platform | Hadoop | Hadoop Ecosystem | Hive | Iceberg | Java | LLM | Object storage | Python | Quality Assurance | RDBMS | REST APIs | SQL | Unix Shell
Education
N/A
Related jobs
-
AI Engineer : Mumbai INR 2500K-4170KAPI Development | AWS | Agentic AI | Ansible | AzureEquity compensation | Mentoring | Training programsSenior-level Full TimeMaharashtra, Mumbai, India2h ago
-
Software Engineer III - Data Engineer INR 2000K-2755KAWS | Apache Airflow | Azure | Big Data | Data GovernanceSenior-level Full TimeMumbai, Maharashtra, India5h ago
-
Lead Software Engineer - Pyspark / Bigdata INR 1800K-3200KAgile | Application Resiliency | Application development | Big Data | CI/CDSenior-level Full TimeBengaluru, Karnataka, India6h ago
-
Associate III- Business Intelligence-HO & SUPPORT-CVM CoE - Corporate Centre of Excellence INR 1000K-1500KAdvanced Excel | Caret | Classification | Clustering | Data AnalysisMid-level Full TimeBangalore, Karnataka, India6h ago
-
Advanced Excel | Caret | Classification | Clustering | Data AnalysisMid-level Full TimeBangalore, Karnataka, India7h ago
-
Mid-level Full TimeBangalore, Karnataka, India7h ago
-
Sr Lead Software Engineer INR 2500K-4000KAWS | AWS Security | Agentic AI | Amazon Bedrock | Context windowSenior-level Full TimeMumbai, Maharashtra, India7h ago
-
Data Science Engineer INR 2400K-3500KCloud Database | Data Modeling | Database Design | ELT | ETLCommercial awareness | Onshore Offshore model experience | UK client experienceSenior-level Full TimeMumbai, MH, India8h ago
-
Engineering Manager- DevOps(Vendor) INR 2200K-4000KAWS Lambda | Agile | Amazon S3 | Amazon Web Services | AnsibleSenior-level Full TimeNoida, Uttar Pradesh8h ago
-
Engineering Manager- Data Devops(Vendor) INR 1500K-2000KAWS CloudFormation | AWS IAM | AWS Lambda | Amazon CloudFront | Amazon CloudWatchMid-level Full TimeNoida, Uttar Pradesh8h ago
-
Applied AI ML Lead - Global Banking INR 2500K-3500KAPI Design | AWS | Accessibility | Authentication | AuthorizationSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
Senior-level Full Timebangalore, India9h ago
-
Senior Data Engineer INR 2516K-3356KAWS | Airflow | Apache Iceberg | Azure | CI/CDEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India9h ago
-
Lead Machine Learning Engineer INR 3100K-4500KApache Airflow | Argo Workflows | Deep learning | GenAI | JavaSenior-level Full TimeBangalore, India R9h ago
-
Senior-level Contract Full TimeBengaluru, Karnataka, India10h ago
-
Senior-level Full TimeIND - Bengaluru - Esko-Graphics India …15h ago
-
Data Engineer (5+ Years of Exp in Data Warehouse Modeling + Big Data + SSIS + BI + Agile + PowerApps + Shell + SQL) INR 1500K-2000KAI | AWS | Agile | Azure | Azure DevOpsMid-level Full TimeBengaluru, India15h ago
-
IN_Associate_Chatbots/Voicebots_GCC_Advisory_Bangalore INR 1000K-1400KAPI | AWS | AWS Lex | Agent Assist | Auto-QAMid-level Full TimeBengaluru Millenia, India15h ago
-
Mid-level Full TimeIndia Offsite (ZIN99) R15h ago
-
Cloud Engineer AIOps INR 2000K-2700KApache Spark | Auto Scaling | CI/CD | Compliance | Data LineageAccident insurance | Childcare assistance reimbursement | Coaching | Continuous learning culture | Employee assistance programEntry-level Full TimePune - Business Bay, India15h ago
-
Senior Data Engineer, ITC INR 1753K-2800KAWS DynamoDB | AWS Lambda | AWS Step Functions | Amazon S3 | Amazon Web ServicesSenior-level Full TimeINDIA TECHNOLOGY CENTER, India15h ago
-
Senior-level Full TimeBangalore, KA, IN15h ago
-
Agile | C# | Data Engineering | Data Modeling | Data WarehouseContinuing education program | Continuous learning access | Generous time off | Health care coverage | Retirement planningSenior-level Full TimeIN - HYDERABAD SKYVIEW, India15h ago
-
Amazon Web Services | Apache Airflow | Apache Hadoop | Azure | Azure DataFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeChennai - Menon Eternity, India15h ago
-
Amazon Web Services | Apache Airflow | Apache Hadoop | Azure | Azure DataFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeChennai - Menon Eternity, India15h ago