Lead Developer, Java, Spark and GCP
Tasks
- Automate batch trigger management
- Build scalable batch processing platform
- Improve batch trigger and LFE configuration management
- Improve operational efficiency reliability and time to market
- Migrate on premises infrastructure to OneTru GCP
- Standardize daily batch configurations
- Support batch processing in production
Perks/Benefits
Skills/Tech-stack
AI | Apache Hadoop | Apache Hive | Apache Spark | Cloud platform | GCP | Google Cloud | Google Cloud Platform | Hadoop | Java | Logical Flow Engine | Microservices | PostgreSQL | Python | Spark SQL | Vue.js
Education
N/A
Roles
Engineer | Lead | Lead Software Engineer | Software Engineer
Related jobs
-
ETL,K8, NiFi, Kafka, Prod Support/Senior Consultant Specialist INR 2800K-4200KAIOps | AWS | Agile | Ansible | AzureFlexible working | Professional development opportunitiesSenior-level Full TimeHyderabad, Telangana, India R6h ago
-
MongoDB, Python, MSA/Consultant Specialist INR 1200K-2000KAWS | Aggregation Pipeline | Azure | CI/CD | Data ModelingContinuous professional development | Flexible working | Inclusive workplace cultureSenior-level Full TimeHyderabad, Telangana, India R7h ago
-
Mid-level Full TimeBengaluru, Karnataka, India R9h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India R9h ago
-
Mid-level Full TimeNoida, Uttar Pradesh, India R9h ago
-
AWS Data Engineer INR 1500K-2500KAWS | AWS Glue | Amazon Athena | Amazon EMR | Amazon S3Hybrid workMid-level Full TimeBengaluru, Karnataka, India R10h ago
-
AWS Data Engineer INR 3200K-4580KAWS IAM | AWS KMS | AWS Lambda | AWS Secrets | AWS Secrets ManagerSenior-level Full TimeBangalore, KA, IN R20h ago
-
AWS Data Engineer INR 3200K-4580KAWS IAM | AWS KMS | AWS Lambda | AWS Secrets | AWS Secrets ManagerSenior-level Full TimeBangalore, KA, IN R20h ago
-
Databricks Engineer INR 1000K-6000KAmazon Web Services | Apache Spark | CI/CD | Cloud platform | Data EngineeringDual project acceptable | EST time zone | Long-term contract | Night shift | Remote workSenior-level Full TimeBengaluru, Karnataka, India - Remote R20h ago
-
Senior Data Engineer INR 2000K-4200KApache Spark | Azure Databricks | Data Pipelines | Delta Lake | ELTSenior-level Full TimeBangalore, India R20h ago
-
Principal AI Engineer INR 3407K-5000KAWS | AWS Bedrock | Access Control | Asyncio | AutogenEmployee assistance programs | Hybrid work options | Onsite flexibility | Wellness programsSenior-level Full TimeHyderabad, India R20h ago
-
Senior Data Platform Agentic AI Engineer INR 3500K-5000KAWS Cloud | AWS Cloud Computing | AWS Key Management Service | Amazon Aurora | Amazon Elastic Kubernetes ServiceHybrid work environment | On-call rotationSenior-level Full TimeQ8 - Bangalore, India R20h ago
-
Principal AI Engineer INR 3242K-4800KAWS | AWS Bedrock | Access Control | Anthropic Claude | Async IOHybrid Work EligibleSenior-level Full TimeHyderabad, India R20h ago
-
Data Scientist / AI & ML Engineer INR 1860K-4200KAWS | Agile | Apache Flume | Apache Kafka | Apache SparkSenior-level Full Time(HIL) BANGALORE, India R20h ago
-
Engineer, Data Development (SSIS, SQL) INR 2000K-3900KAgile | Analysis Services | Automated testing | Data Management | Data WarehousingHybrid work | Mentoring | Work-life balanceMid-level Full TimeChennai, India R20h ago
-
Staff SW Engineer- Java backend with GenAI experience INR 3584K-5000KAPI Gateway | Amazon S3 | Azure OpenAI | CAP Theorem | CI/CDSenior-level Full TimeBengaluru, India R20h ago
-
Developer, Java,Spark and GCP INR 2771K-3584KAI | GCP | Hadoop | Hive | JavaHybrid work | Work-life flexibilitySenior-level Full TimeChennai, India R20h ago
-
Developer, Java, Spark and GCP INR 2771K-3584KApache Spark | Cloud platform | GCP | Google Cloud | Google Cloud PlatformHybrid workSenior-level Full TimeChennai, India R20h ago
-
Senior Specialist, Observability Data Engineer USD 58K-94KAWS | Agile | Alerts | Apache Airflow | Apache KafkaSenior-level Full TimeIND - Telangana - Hyderabad (Hitec … R20h ago
-
Databricks and Splunk Engineer - Senior Associate INR 3264K-4500KAmazon Web Services | Analytics | Azure | Cloud Computing | Cyber ThreatEmployee networks | Flexible work/life support | Hybrid work schedule | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India R22h ago
-
AI Integration Engineer – Digital Transformation (m/f/d) INR 2500K-3584KABAC | API Gateway | AWS Glue | AWS Lambda | AWS Secrets1 to 1 counselling | Discount vouchers | Hybrid work model | Language classes | Learning and developmentSenior-level Full TimeGurugram R1d ago
-
Data Engineer INR 3000K-4000KAWS | Amazon Aurora | Automation | Azure | Data ManagementBike to work | Career development program | Educational assistance | Employee assistance program | Employee discountSenior-level Full TimeBengaluru, KA, India R1d ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Autonomy | Fully remote | Remote work flexibilitySenior-level Contract Full TimeIndia R1d ago
-
Data Engineer & Analyst INR 2040K-3000KAI Automation | Azure SQL | DBT | Data Pipeline Monitoring | Data pipelineDocumentation support | On-call incident response | Remote workSenior-level Full TimeIndia R1d ago
-
Applications Development Module Lead INR 2040K-3465KAccess Management | CI/CD | Cloud Build | Cloud Composer | Cloud DataHealthcare benefits | Hybrid work | Paid time offSenior-level Full TimeNoida R1d ago