Data Engineer II
Bengaluru, KA, India
INR 2771K-4064K (estimate) Senior-level Full Time
Tasks
- Build and deploy containerized applications
- Build scalable data pipelines
- Collaborate on enterprise data platform architecture
- Create infrastructure as code
- Create platform components for onboarding and transformation
- Design data ingestion frameworks
- Develop microservices and APIs
- Develop production data pipelines
- Implement data quality and schema validation
- Implement monitoring, logging, and alerting
- Improve engineering standards with automation and CI/CD
- Perform code reviews and technical design
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Apache Kafka | Apache Spark | BigQuery | CI/CD | Cloud Run | Cloud Storage | Cloud platform | Data Catalog | Data Governance | Data Lineage | Data Modeling | Data Processing | Data Quality | Distributed data | Distributed data processing | Docker | Elasticsearch | GKE | Git | Google Cloud | Google Cloud Platform | Grafana | IAM | Infrastructure as Code | JWT | Kafka | Kibana | Kubernetes | Logging | Metadata Management | Metrics | Microservices | Monitoring | OAuth2 | Observability | PowerBI | PubSub | Python | REST APIs | SQL | Schema Validation | Tableau | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Mid-level Full TimeHaveli, India2h ago
-
Mid-level Full TimeHyderabad, India3h ago
-
Senior-level Full TimeGurugram, Haryana, India4h ago
-
Senior-level Full TimeIN-TN-Chennai4h ago
-
Senior-level Full TimeIN-AP-Hyderabad4h ago
-
Senior-level Full TimeIN-AP-Hyderabad4h ago
-
Senior Artificial Intelligence/Machine Learning Engineer INR 3000K-5000KAPI Integrations | Agentic AI | Alerting | Atlassian Bamboo | Atlassian BitbucketCompany-paid certifications | Financial consultations | Language courses | Legal consultations | Medical insuranceSenior-level Full TimeIndia5h ago
-
Staff Engineer INR 4200K-6944KAgentic Workflows | Anomaly Detection | Apache Kafka | BigQuery | Cloud platformSenior-level Full TimeChennai, Tamil Nadu, India5h ago
-
Associate - Data Scientist INR 1500K-2500KAmazon Web Services | Apache Spark | Artificial neural networks | Chunking | DatabricksMid-level Full TimeGurugram, Haryana, India6h ago
-
Partner Forward Deployed Engineer, GenAI, Google Cloud INR 2500K-5000KAgent systems | Agent workflows | Application Programming | Application Programming Interfaces | Computer VisionSenior-level Full TimeMumbai, Maharashtra, India6h ago
-
Staff Software Engineer, AI/ML GenAI, Google Ads INR 2000K-5000KC++ | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeBengaluru, Karnataka, India6h ago
-
Staff Software Engineer, Cloud AI INR 2500K-5000KAPI Gateways | API Management | Agentic AI | C++ | Cloud ArchitectureSenior-level Full TimeHyderabad, Telangana, India6h ago
-
Assistant Manager INR 1500K-2200KACID | Azure Cloud | Azure Data | Azure Data Factory | CI/CDWork from office 5 daysMid-level Full TimeBengaluru, Karnataka, India6h ago
-
Azure Data Engineer INR 1500K-2500KAzure Cloud | Azure Cloud Platform | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeHyderabad, Telangana, India6h ago
-
Staff Data Engineer (HPC cluster software such as Slurm, NC, LSF or Grid Engine) experience with 9 to 13 years INR 1500K-3000KAnsible | Docker | Grid Engine | Infiniband | IsilonSenior-level Full TimeBengaluru, KA, India7h ago
-
Senior Software Engineer _Cloud Developer INR 3715K-5000KAPI Development | API Integration | AWS Glue | AWS Lambda | AWS Step FunctionsEqual opportunity | Inclusive culture | On-call rotationSenior-level Full TimeHyderabad, India7h ago
-
Senior Artificial Intelligence/Machine Learning Engineer INR 3000K-5000KAPIs | Agentic AI | Apache Flink | Apache Spark | CI/CDCompany-paid certifications | Financial consultations | Language courses | Legal consultations | Medical insuranceSenior-level Full TimeIndia7h ago
-
Data & Analytics Engineer - AM INR 1500K-2700KApache Spark | Data Modeling | Data Warehousing | Databricks | Delta LakeSenior-level Full TimeBangalore, Karnataka, India7h ago
-
Senior Artificial Intelligence/Machine Learning Engineer INR 2500K-4800KAWS | Agent Frameworks | Agent systems | Autogen | CI/CDCompany-paid certifications | Financial consultations | Language courses | Legal consultations | Medical insuranceSenior-level Full TimeIndia7h ago
-
Lead Software Engineer Java INR 2500K-4000KAPI Gateway | AWS Glue | AWS Lambda | AWS OpenSearch | AWS SageMakerSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
Data and Analytics Engineer , Enablement INR 3000K-4000KApache Spark | Azure Data | Azure Data Platform | CI/CD | Data AnalysisDocumentation enablement content creation | Mentoring and onboarding supportSenior-level Full TimeMumbai, Maharashtra, India8h ago
-
Data and Analytics Engineer , Enablement INR 3000K-4000KAgile | Apache Spark | Data Governance | Data Modeling | Data VisualizationSenior-level Full TimeMumbai, Maharashtra, India8h ago
-
Data and Analytics Engineer , Enablement INR 3000K-4000KAgile | Apache Spark | Azure Data | Azure Data Platform | CI/CDSenior-level Full TimeMumbai, Maharashtra, India8h ago
-
Data and Analytics Engineer , Enablement INR 3000K-4000KCI/CD | Data Analysis | Data Modeling | Databricks | Exploratory Data AnalysisMid-level Full TimeMumbai, Maharashtra, India8h ago
-
Senior Software Engineer INR 3264K-5000KAPI Testing | AWS | Amazon Web Services | Ansible | Artificial IntelligenceFamily wellbeing benefits | Health and wellbeing benefits | Paid time offSenior-level Full TimeHyderabad, India9h ago