Software Engineer II - Big Data (ETL) / DevOps Engineer + AWS
Bengaluru, Karnataka, India
INR 1500K-2500K (estimate) Mid-level Full Time
Tasks
- Analyze complex data sets
- Apply quality assurance best practices
- Create test coverage
- Develop ETL pipelines
- Develop and test interfaces
- Enhance ETL logic
- Handle CI CD automation
- Implement data asset quality guidelines
- Perform performance testing
- Run code scanning and security scanning
- Transform data using AWS and Hadoop
- Troubleshoot software components
- Validate and verify data transformations
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Agent Frameworks | Apache Spark | Athena | Aurora | Automated testing | CI/CD | Code Scanning | Data Quality | EC2 | ETL | Glue | Hadoop | Kafka | LLM | Lambda | Performance Testing | Prompt engineering | Python | RDS | Redshift | S3 | SQL | Secure Coding | Shell Scripting | Spark SQL | Streaming | Unit Testing | Unix Shell | Unix/Shell Scripting
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
DevOps | DevOps Engineer | ETL Engineer | Engineer | Engineer II | Software Engineer | Software Engineer II
Related jobs
-
Analyst-Data Science INR 2771K-4064KActive Learning | Algorithms | Apache Hive | Apache Spark | Bayesian MethodsEntry-level Full TimeGurugram, HR, India5h ago
-
Data Engineer (LBC) INR 1500K-2500KBusiness Intelligence | DAX | Data Analysis | Data Catalog | Data QualitySenior-level Full TimePune, IN5h ago
-
Applied AI ML Lead-AI Engineer INR 3500K-5000KAgentic AI | CI/CD | Cloud Computing | Code review | ContainerizationSenior-level Full TimeBengaluru, Karnataka, India6h ago
-
GCP Data Engineer INR 1500K-2000KAnsible | Cloud Bigtable | Cloud SQL | Cloud Spanner | Cloud platformProfessional growthMid-level Full TimeBengaluru, Pune6h ago
-
Applied AI ML Lead-AI Engineer INR 3500K-5000KAgentic AI | CI/CD | Cloud Native | Cloud-native development | Code reviewSenior-level Full TimeBengaluru, Karnataka, India6h ago
-
Software Engineer III - Java & Databricks INR 2200K-3500KAgile | Amazon Web Services | Angular | Application Resiliency | C#Senior-level Full TimeHyderabad, Telangana, India7h ago
-
AI Specialist (Technical) INR 1860K-3465KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksMid-level Full TimeGurugram, HR, IN7h ago
-
Senior Robotics Engineer INR 1753K-2372KC++ | Java | Localization and mapping | MATLAB | Machine LearningFull Time Office Project Work | Relocation not provided | Travel for deployment and commissioningSenior-level Full TimeChennai, TN, IN7h ago
-
AI Specialist (ML & LLM) INR 2400K-4000KAI Search | Azure AI | Azure AI Search | Azure Functions | Azure Machine LearningMid-level Full TimeGurugram, HR, IN7h ago
-
AI Deployment Engineer INR 2000K-4800KCloud Architecture | Enterprise Architecture | Generative AI | JavaScript | Machine LearningHybrid work model | Relocation assistanceSenior-level Full TimeDelhi, India8h ago
-
Applied AI ML Associate Senior-Data Engineer INR 1000K-1800KApache Spark | CI/CD | Data Governance | Data Lineage | Data ModelingMid-level Full TimeBengaluru, Karnataka, India8h ago
-
AWS | AWS Machine Learning | Agent systems | Angular | AutogenSenior-level Full TimeChennai, TN, IN, 60003212h ago
-
AI Engineering INR 3584K-5000KAgentic Workflows | Audit Logging | Authentication | Authorization | CI/CDSenior-level Full TimeBangalore, KA, IN12h ago
-
Principal Engineer - Gen AI INR 3419K-5000KAI guardrails | Abuse detection | Agent architectures | Agentic AI | AuditabilitySenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India12h ago
-
Sr. Power BI Engineer - (SSRS & PySpark) INR 1632K-2500KPower BI | PySpark | SQL | SQL Server | SSRSSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
Mid-level Full TimeBlock 1 DT, Chennai India12h ago
-
Senior-level Full TimeChennai, IN12h ago
-
Senior Agentic AI Software Engineer INR 3242K-5000KAgile methodology | Amazon Web Services | Full Stack | Full-Stack Development | GeminiSenior-level Full TimeQ8 - Bangalore, India12h ago
-
Engineer Data Platform INR 1300K-2000KAPI Gateway | AWS CDK | AWS CloudFormation | AWS Identity | AWS Identity and Access ManagementFlexible work environment | Internal mobility | Volunteering opportunities | Welcoming and inclusive environment | Well-being supportMid-level Full TimeKA Bangalore, India12h ago
-
Principal QA Engineer – GenAI Testing - Manager INR 1500K-2829KAdversarial Testing | Artificial Intelligence | BDD | Benchmarking | CI/CDEmployee networks | Flexible work/life support | Hybrid work model | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHyderabad, India12h ago
-
Generative AI Quality Engineer - Senior Associate INR 1860K-3000KArtificial Intelligence | BDD | Benchmarking | CI/CD | GherkinEmployee resource networks | Flexible work/life support | Hybrid work model | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHyderabad, India12h ago
-
Senior Data Engineer INR 3600K-4995KAmazon Redshift | Amazon Web Services | Apache Airflow | Batch Processing | DBTSenior-level Full TimeIndia R17h ago
-
Data Science Manager INR 1500K-2100KAWS | Adversarial Networks | Attribution Modeling | Azure | Cloud ComputingMid-level Full TimePune1d ago
-
Senior GIS Enginer INR 900K-2500KAPI Integration | ArcGIS | Coordinate systems | Data Transformation | Data cleaningSenior-level Full TimeHyderabad, TS, IN / Hyderabad, Telangana, …1d ago
-
Test Lead - Data Automation INR 1500K-2500KCase design | ETL | Manual Testing | Python | Regression testingSenior-level Full TimeIndia2d ago