Senior Software Engineer (Spark) - Cloud Data Platform
United States - San Mateo, CA
Guidewire Software
Elevate your P&C insurance with Guidewire's industry-leading software! Streamline workflows, enhance customer experience, and drive growth. Learn more today!Are you passionate about building internet-scale multi-tenant cloud-native data platforms?
Do you have prior experience in building data platforms/data lake and analytics SaaS services in the public cloud with expertise in modern Big Data stack (Apache Spark, Hadoop, Kafka, Flink, Hive etc.)
If so then come join our Cloud Data Platform team! This team owns, builds, and operates Guidewire’s cloud-native data platform and analytics SaaS offerings. The Guidewire Data Platform is an enterprise-grade, internet-scale, and cloud-native Big Data platform targeted to be best-in-class in enabling our customers with mission-critical insights and decision-making capabilities. The platform is designed to support all our analytics, data science, and data applications. Guidewire’s data platform already processes Billions of real-time data to provide a rich set of AI/ML SaaS solutions! You will work in a highly collaborative environment building next-generation platforms and services using the latest and greatest cutting-edge & bleeding-edge technologies. You will have fun building cloud-native, enterprise-grade, and internet-scale platforms and SaaS applications.
Required Skills:
- 8+ years' experience working in a similar Senior Software Engineer role within a data platform/data engineering team
- Extensive experience with Big Data and distributed systems.
- Experience with stream processing using Spark.
- Ability to design large-scale distributed systems.
- Prior experience in building data platforms using Big Data stack (Kafka, Hadoop, Spark, Flink, Hive ..) on the public cloud.
- Excellent programming skills in Java.
- Understanding of distributed systems concepts and principles (consistency and availability, liveness and safety, durability, reliability, fault-tolerance, consensus algorithms).
- Deep understanding of Algorithms, Data Structures, and Performance Optimization Techniques.
- Eager to learn new things and passionate about technology!.
- Comfortable working with Kubernetes, AWS, Docker, and Terraform.
What you would do:
- Hands-on coding and implementation of high-performance Spark applications, leveraging your deep understanding of distributed computing and data processing.
- Designing and optimizing Spark applications.
- Design cloud-native data platform and analytics SaaS services
- Own architecture and provide technical leadership to multiple teams
- Hands-on coding>60% of the time
- Design and build large-scale real-time stream processing systems
- Design and develop micro-services and analytics SaaS solutions
- Own scalability, availability, and data security
- Own, tackle & resolve code defects
- Mentor junior developers in standards and best practices!
What you would need to succeed:
- Extensive experience working on a public cloud-like AWS
- Prior experience and passion for building a large-scale multi-tenant cloud-native data platform
- Emphasize team wins over individual success
- Strong technical interpersonal skills
- Excellent software development skills in one or more of the following languages: Java/Scala
- Extensive experience with Big Data and distributed systems.
- Expertise in Spark or Flink, Kafka, and Hadoop ecosystem
- Ability to design large-scale distributed systems
- Have developed in more than one language and ready to pivot to any language/framework
- Understand microservices architecture patterns pattern like Service Discovery/API Gateway/Domain Driven Design etc
- Experience with containers technology
- Ability to work in an agile fast-paced environment
- BS or MS degree (Computer Science or Math)
- AWS (EMR, S3, Glue, Kinesis)
- Debezium
- ELK
- Experience in building SaaS/PaaS on AWS/GCP/Azure.
- AI/ML
Bonus
If we've got you excited and you’re ready for a career upgrade, then we're eager to hear from you! Get in touch to learn more about the Guidewire team you’ll work with.
Our employee culturehttps://careers.guidewire.com/culture
Who We Arehttps://careers.guidewire.com/about
#LI-HR1#insurtech#guidewire#python#javaprogramming#featured
About Guidewire
Guidewire is the platform P&C insurers trust to engage, innovate, and grow efficiently. We combine digital, core, analytics, and AI to deliver our platform as a cloud service. More than 540+ insurers in 40 countries, from new ventures to the largest and most complex in the world, run on Guidewire.
As a partner to our customers, we continually evolve to enable their success. We are proud of our unparalleled implementation track record with 1600+ successful projects, supported by the largest R&D team and partner ecosystem in the industry. Our Marketplace provides hundreds of applications that accelerate integration, localization, and innovation.
For more information, please visit www.guidewire.com and follow us on Twitter: @Guidewire_PandC.
Guidewire Software, Inc. is proud to be an equal opportunity and affirmative action employer. We are committed to an inclusive workplace, and believe that a diversity of perspectives, abilities, and cultures is a key to our success. Qualified applicants will receive consideration without regard to race, color, ancestry, religion, sex, national origin, citizenship, marital status, age, sexual orientation, gender identity, gender expression, veteran status, or disability. All offers are contingent upon passing a criminal history and other background checks where it's applicable to the position.
Disability Accommodations and Guidewire’s Appeals Process. Guidewire provides accommodations to the hiring process to create a fair opportunity for candidates with disabilities to contend for open positions. Accommodation requests should be directed to Accommodations@guidewire.com. If things do not go as hoped, we invite you to use our appeals process. Guidewire promises to independently review any denied accommodation and any decision not to offer you the position. The appeals process is the same in either case. Within five business days of receiving a notice of denial of an accommodation, or receiving a notice of your non-selection for a vacancy, e-mail Accommodations@guidewire.com to make an appeal. Guidewire will assign a new decision-maker to review the request and/or hiring decision, who will then notify you in writing of a decision within 10 business days.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile APIs Architecture AWS Azure Big Data Computer Science Distributed Systems Docker ELK Engineering Flink GCP Hadoop Java Kafka Kinesis Kubernetes Machine Learning Mathematics Microservices Python R R&D Scala Security Spark Terraform
Perks/benefits: Career development Insurance Salary bonus
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.