Lead Software Engineer (Spark-scala/java)
Tasks
- Automate build, release, deployment, and monitoring
- Build services and APIs for dataset access
- Design scalable systems for data processing and analytics
- Drive peer code reviews mentoring and knowledge sharing
- Implement automated testing
- Improve coding standards and code quality metrics
- Integrate machine learning models into production systems
- Lead technical design reviews and implementations
- Leverage AWS for storage and compute
- Own and evolve frameworks for availability scalability and security
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Flink | Apache Spark | CI/CD | Contract testing | Crucible | Docker | Gerrit | Integration Testing | JUnit | Java | Machine Learning | Python | REST | Scala
Education
Related jobs
-
Data Engineer INR 938K-1200KAzure Data | Azure Data Factory | Azure Databricks | Data Factory | ETLEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India2h ago
-
IN-Associate_AI/ML Developer_MS Engg_Advisory_Kolkata INR 1500K-2000KApp Service | Azure App | Azure App Service | Azure Blob | Azure Blob StorageFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportMid-level Full TimeKolkata DN 57, India10h ago
-
CI/CD | Couchbase | Design Patterns | Docker | GuiceSenior-level Full TimeGurugram 8 B, India10h ago
-
Sr. Azure Data Engineer INR 1500K-2000KAWS | Azure | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeINDIA - BENGALURU - HP, IN10h ago
-
IN-Associate 2_Azure Data Engineer_OC D&A_Advisory_Bhubaneswar INR 1500K-2000KAgile | Azure | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeBhubaneswar - Ihub, India10h ago
-
Mid-level Full TimeBangalore, KA, IN, 56214910h ago
-
Technical Support Engineer INR 850K-1100KAmazon Web Services | Apache Hadoop | Apache Spark | Bash | Cloud platformFlexible paid time offMid-level Full TimeHyderabad, India16h ago
-
Software Engineer Lead (Python + Snowflake) INR 2040K-3100KAirflow | CI/CD | DBT | Dagster | Data ModelingSenior-level Full TimeIndia (Noida)17h ago
-
Principal Consultant-Manager, GenAI Engineer (Cloud: GCP) INR 2520K-3380KAgent Development | Agent Development Kit | Agent systems | Artificial Intelligence | Automated testingContinuous learning opportunities | MentorshipSenior-level Full TimeIndia-Hyderabad21h ago
-
Senior-level Full TimeIN-AP-Hyderabad21h ago
-
Senior-level Full TimeIN-MH-Pune21h ago
-
Lead-Affluent BIU & Analytics-AFFLUENT-Program & MIS INR 1960K-2600KA/B | A/B Testing | B testing | Clustering | Data GovernanceSenior-level Full TimeMumbai, Maharashtra, India21h ago
-
Developer, Data Analytics INR 1200K-1968KBigQuery | Cloud Composer | Cloud Storage | Cloud platform | Data WarehousingHybrid workSenior-level Full TimeIndia-Telangana-Hyderabad21h ago
-
Senior Data Engineer INR 1300K-2000KBigQuery | Cloud Composer | Cloud Storage | Cloud platform | Data WarehousingHybrid workSenior-level Full TimeIndia-Telangana-Hyderabad21h ago
-
BigQuery | Clustering | Data Governance | Data Modeling | Data VisualizationCollaborative team environment | Flexible schedules | Mission-driven work | Professional growth opportunities | Remote work flexibilitySenior-level Full TimeIndia22h ago
-
ALM | ASPICE | Anomaly Detection | Automation | CybersecuritySenior-level Full TimeBengaluru, Karnataka, India22h ago
-
Software Engineer III Data Engineer-Python, AWS INR 2050K-3500KAWS | CI/CD | Databricks | ETL | PySparkSenior-level Full TimeBengaluru, Karnataka, India22h ago
-
Team Member-Analytics-SUPPORT SERVICES-HR - CoE INR 400K-700KANOVA | Data Modeling | Data Visualization | Excel | Hypothesis TestingSenior-level Full TimeMumbai, Maharashtra, India22h ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Dashboards | Data CleansingSenior-level Full TimeBengaluru, Karnataka, India22h ago
-
Data Scientist Lead - Branch Channel Analytics INR 2500K-3380KAWS | Apache Spark | Azure | Campaign attribution | ClassificationSenior-level Full TimeBengaluru, Karnataka, India22h ago
-
Software Engineer, Fleet Analytics, PhD, Early Career, 2026 INR 2500K-4110KData Storage | Distributed Computing | Distributed Systems | Information Retrieval | Integer ProgrammingSenior-level Full TimeBengaluru, Karnataka, India23h ago
-
Algorithms | Artificial Intelligence | Capacity Planning | Data center | Data center capacity planningSenior-level Full TimeBengaluru, Karnataka, India23h ago
-
Algorithms | Artificial Intelligence | BigQuery | Cloud Storage | Cloud platform24x7 support rotation | Non-standard hours | On-call workMid-level Full TimeBengaluru, Karnataka, India; Pune, Maharashtra, India23h ago
-
Senior Software Engineer, Silicon Infrastructure and Engineering INR 1500K-2300KAlgorithms | Business Intelligence | Dashboards | Data Structures | Data VisualizationSenior-level Full TimeBengaluru, Karnataka, India23h ago
-
Silicon Validation Lead, AI/ML, Google Cloud, TPU INR 3400K-6000KAI machine learning | BERT | Board schematics | Bring-up | C plus plusCareer development | Employee Community Building | Mentoring | Psychologically Safe EnvironmentSenior-level Full TimeBengaluru, Karnataka, India23h ago