Data Engineer II
Bengaluru, KA, India
INR 2771K-4064K (estimate) Senior-level Full Time
Tasks
- Build and deploy containerized applications
- Build scalable data pipelines
- Collaborate on enterprise data platform architecture
- Create infrastructure as code
- Create platform components for onboarding and transformation
- Design data ingestion frameworks
- Develop microservices and APIs
- Develop production data pipelines
- Implement data quality and schema validation
- Implement monitoring, logging, and alerting
- Improve engineering standards with automation and CI/CD
- Perform code reviews and technical design
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Apache Kafka | Apache Spark | BigQuery | CI/CD | Cloud Run | Cloud Storage | Cloud platform | Data Catalog | Data Governance | Data Lineage | Data Modeling | Data Processing | Data Quality | Distributed data | Distributed data processing | Docker | Elasticsearch | GKE | Git | Google Cloud | Google Cloud Platform | Grafana | IAM | Infrastructure as Code | JWT | Kafka | Kibana | Kubernetes | Logging | Metadata Management | Metrics | Microservices | Monitoring | OAuth2 | Observability | PowerBI | PubSub | Python | REST APIs | SQL | Schema Validation | Tableau | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Mid-level Full TimeHaveli, India1h ago
-
Mid-level Full TimeHyderabad, India3h ago
-
Senior-level Full TimeGurugram, Haryana, India3h ago
-
Senior-level Full TimeIN-TN-Chennai3h ago
-
Senior-level Full TimeIN-AP-Hyderabad3h ago
-
Senior Artificial Intelligence/Machine Learning Engineer INR 3000K-5000KAPI Integrations | Agentic AI | Alerting | Atlassian Bamboo | Atlassian BitbucketCompany-paid certifications | Financial consultations | Language courses | Legal consultations | Medical insuranceSenior-level Full TimeIndia4h ago
-
Associate - Data Scientist INR 1500K-2500KAmazon Web Services | Apache Spark | Artificial neural networks | Chunking | DatabricksMid-level Full TimeGurugram, Haryana, India5h ago
-
Partner Forward Deployed Engineer, GenAI, Google Cloud INR 2500K-5000KAgent systems | Agent workflows | Application Programming | Application Programming Interfaces | Computer VisionSenior-level Full TimeMumbai, Maharashtra, India5h ago
-
Staff Software Engineer, AI/ML GenAI, Google Ads INR 2000K-5000KC++ | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeBengaluru, Karnataka, India5h ago
-
Staff Software Engineer, Cloud AI INR 2500K-5000KAPI Gateways | API Management | Agentic AI | C++ | Cloud ArchitectureSenior-level Full TimeHyderabad, Telangana, India5h ago
-
Azure Data Engineer INR 1500K-2500KAzure Cloud | Azure Cloud Platform | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeHyderabad, Telangana, India5h ago
-
Staff Data Engineer (HPC cluster software such as Slurm, NC, LSF or Grid Engine) experience with 9 to 13 years INR 1500K-3000KAnsible | Docker | Grid Engine | Infiniband | IsilonSenior-level Full TimeBengaluru, KA, India6h ago
-
Senior Software Engineer _Cloud Developer INR 3715K-5000KAPI Development | API Integration | AWS Glue | AWS Lambda | AWS Step FunctionsEqual opportunity | Inclusive culture | On-call rotationSenior-level Full TimeHyderabad, India6h ago
-
Senior Artificial Intelligence/Machine Learning Engineer INR 3000K-5000KAPIs | Agentic AI | Apache Flink | Apache Spark | CI/CDCompany-paid certifications | Financial consultations | Language courses | Legal consultations | Medical insuranceSenior-level Full TimeIndia6h ago
-
Data & Analytics Engineer - AM INR 1500K-2700KApache Spark | Data Modeling | Data Warehousing | Databricks | Delta LakeSenior-level Full TimeBangalore, Karnataka, India6h ago
-
Senior Artificial Intelligence/Machine Learning Engineer INR 2500K-4800KAWS | Agent Frameworks | Agent systems | Autogen | CI/CDCompany-paid certifications | Financial consultations | Language courses | Legal consultations | Medical insuranceSenior-level Full TimeIndia7h ago
-
Lead Software Engineer Java INR 2500K-4000KAPI Gateway | AWS Glue | AWS Lambda | AWS OpenSearch | AWS SageMakerSenior-level Full TimeBengaluru, Karnataka, India7h ago
-
Data and Analytics Engineer , Enablement INR 3000K-4000KApache Spark | Azure Data | Azure Data Platform | CI/CD | Data AnalysisDocumentation enablement content creation | Mentoring and onboarding supportSenior-level Full TimeMumbai, Maharashtra, India7h ago
-
Data and Analytics Engineer , Enablement INR 3000K-4000KAgile | Apache Spark | Data Governance | Data Modeling | Data VisualizationSenior-level Full TimeMumbai, Maharashtra, India7h ago
-
Data and Analytics Engineer , Enablement INR 3000K-4000KAgile | Apache Spark | Azure Data | Azure Data Platform | CI/CDSenior-level Full TimeMumbai, Maharashtra, India7h ago
-
Data and Analytics Engineer , Enablement INR 3000K-4000KCI/CD | Data Analysis | Data Modeling | Databricks | Exploratory Data AnalysisMid-level Full TimeMumbai, Maharashtra, India7h ago
-
Senior Software Engineer INR 3264K-5000KAPI Testing | AWS | Amazon Web Services | Ansible | Artificial IntelligenceFamily wellbeing benefits | Health and wellbeing benefits | Paid time offSenior-level Full TimeHyderabad, India8h ago
-
Software Engineer III - Data Lake INR 2000K-3100KAWS | AWS Glue | Agile methodologies | Amazon S3 | Apache CassandraSenior-level Full TimeHyderabad, Telangana, India9h ago
-
Senior Software Engineer INR 3264K-4720KAI Engineering | Best practices | Business Intelligence | Cloud Computing | Data ArchitectureFamily support benefits | Flexible working options | Health benefits | Paid time off | Retirement benefitsSenior-level Full TimeIndia9h ago
-
Staff Software Engineer - Database Engineering INR 2771K-4064KAmazon Aurora | Ansible | Cassandra | Citus | Configuration ManagementSenior-level Full TimeBangalore, India R9h ago