Software Engineer II - Big Data (ETL) / DevOps Engineer + AWS
Bengaluru, Karnataka, India
INR 1500K-2500K (estimate) Mid-level Full Time
Tasks
- Analyze complex data sets
- Apply quality assurance best practices
- Create test coverage
- Develop ETL pipelines
- Develop and test interfaces
- Enhance ETL logic
- Handle CI CD automation
- Implement data asset quality guidelines
- Perform performance testing
- Run code scanning and security scanning
- Transform data using AWS and Hadoop
- Troubleshoot software components
- Validate and verify data transformations
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Agent Frameworks | Apache Spark | Athena | Aurora | Automated testing | CI/CD | Code Scanning | Data Quality | EC2 | ETL | Glue | Hadoop | Kafka | LLM | Lambda | Performance Testing | Prompt engineering | Python | RDS | Redshift | S3 | SQL | Secure Coding | Shell Scripting | Spark SQL | Streaming | Unit Testing | Unix Shell | Unix/Shell Scripting
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
DevOps | DevOps Engineer | ETL Engineer | Engineer | Engineer II | Software Engineer | Software Engineer II
Related jobs
-
Quality Data Analytics Specialist INR 1500K-2700KAlation | Data Management | Data Quality | Data Reconciliation | Data ValidationSenior-level Full TimePune, India2h ago
-
Assistant Manager - Analytics\..RBG - Analytics INR 1200K-2500KAdobe Analytics | Churn Prediction | Classification | Clickstream | ClusteringMid-level Full TimeBengaluru, Karnataka, India2h ago
-
Assistant Manager - Analytics\..RBG - Analytics INR 1200K-2500KAdobe Analytics | Churn Prediction | Classification | Clickstream analytics | ClusteringMid-level Full TimeBengaluru, Karnataka, India2h ago
-
Mid-level Full TimeBangalore, Karnataka, India3h ago
-
Senior Software Engineer-Data INR 2000K-4580KAI Foundry | Agent Orchestration | Apache Spark | Azure AI | Azure AI FoundrySenior-level Full TimeIndia, Telangana, Hyderabad4h ago
-
Analyst-Data Science INR 2771K-4064KActive Learning | Algorithms | Apache Hive | Apache Spark | Bayesian MethodsEntry-level Full TimeGurugram, HR, India5h ago
-
Data Engineer (LBC) INR 1500K-2500KBusiness Intelligence | DAX | Data Analysis | Data Catalog | Data QualitySenior-level Full TimePune, IN5h ago
-
Applied AI ML Lead-AI Engineer INR 3500K-5000KAgentic AI | CI/CD | Cloud Computing | Code review | ContainerizationSenior-level Full TimeBengaluru, Karnataka, India7h ago
-
GCP Data Engineer INR 1500K-2000KAnsible | Cloud Bigtable | Cloud SQL | Cloud Spanner | Cloud platformProfessional growthMid-level Full TimeBengaluru, Pune7h ago
-
Applied AI ML Lead-AI Engineer INR 3500K-5000KAgentic AI | CI/CD | Cloud Native | Cloud-native development | Code reviewSenior-level Full TimeBengaluru, Karnataka, India7h ago
-
Software Engineer III - Java & Databricks INR 2200K-3500KAgile | Amazon Web Services | Angular | Application Resiliency | C#Senior-level Full TimeHyderabad, Telangana, India7h ago
-
AI Specialist (Technical) INR 1860K-3465KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksMid-level Full TimeGurugram, HR, IN8h ago
-
Senior Robotics Engineer INR 1753K-2372KC++ | Java | Localization and mapping | MATLAB | Machine LearningFull Time Office Project Work | Relocation not provided | Travel for deployment and commissioningSenior-level Full TimeChennai, TN, IN8h ago
-
AI Specialist (ML & LLM) INR 2400K-4000KAI Search | Azure AI | Azure AI Search | Azure Functions | Azure Machine LearningMid-level Full TimeGurugram, HR, IN8h ago
-
AI Deployment Engineer INR 2000K-4800KCloud Architecture | Enterprise Architecture | Generative AI | JavaScript | Machine LearningHybrid work model | Relocation assistanceSenior-level Full TimeDelhi, India8h ago
-
Applied AI ML Associate Senior-Data Engineer INR 1000K-1800KApache Spark | CI/CD | Data Governance | Data Lineage | Data ModelingMid-level Full TimeBengaluru, Karnataka, India9h ago
-
AWS | AWS Machine Learning | Agent systems | Angular | AutogenSenior-level Full TimeChennai, TN, IN, 60003213h ago
-
AI Engineering INR 3584K-5000KAgentic Workflows | Audit Logging | Authentication | Authorization | CI/CDSenior-level Full TimeBangalore, KA, IN13h ago
-
Principal Engineer - Gen AI INR 3419K-5000KAI guardrails | Abuse detection | Agent architectures | Agentic AI | AuditabilitySenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India13h ago
-
Sr. Power BI Engineer - (SSRS & PySpark) INR 1632K-2500KPower BI | PySpark | SQL | SQL Server | SSRSSenior-level Full TimeBengaluru, Karnataka, India13h ago
-
Mid-level Full TimeBlock 1 DT, Chennai India13h ago
-
Senior-level Full TimeChennai, IN13h ago
-
Senior Agentic AI Software Engineer INR 3242K-5000KAgile methodology | Amazon Web Services | Full Stack | Full-Stack Development | GeminiSenior-level Full TimeQ8 - Bangalore, India13h ago
-
Engineer Data Platform INR 1300K-2000KAPI Gateway | AWS CDK | AWS CloudFormation | AWS Identity | AWS Identity and Access ManagementFlexible work environment | Internal mobility | Volunteering opportunities | Welcoming and inclusive environment | Well-being supportMid-level Full TimeKA Bangalore, India13h ago
-
Principal QA Engineer – GenAI Testing - Manager INR 1500K-2829KAdversarial Testing | Artificial Intelligence | BDD | Benchmarking | CI/CDEmployee networks | Flexible work/life support | Hybrid work model | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHyderabad, India13h ago