Bigdata engineer- Spark & Scala - API - Senior Manager
Hyderabad, India
State Street
State Street provides investment servicing, investment management, investment research and trading services to institutional investors worldwide.Roles and responsibilities :
Expected to spend 100% of the time on hands-on development, design and architecture
Experience in Finance and FCC is a plus
Work shift timings : 11 AM IST to 8 PM IST / 12 PM IST to 9 PM IST
Extensive working knowledge and expertise in Spark on Scala, AWS and Databricks
Should have worked on DataSync, DMS, DBFS Utils, Clusters, Notebooks and Workflows
Should have on performance tuning of workflows and jobs in Databricks
Should have worked as a Data Engineer
Should be able to work independently on their stories with minimum input and directions
Should be a proactive communicator and a team player
What you will be responsible for
As Cloud Developer you will
· Hands on design and development. Spend 80% of time on own tasks as part of Sprint deliverables.
8+ Years of IT experience with relevant qualifications
3+ years of industry experience in AWS/Databricks
Work experience on enterprise applications is a must.
Extensive experience on Data Analysis, ETL Development , Design, and performance tunings using Spark on Scala,
Should have working knowledge of python for wrapper scripts, orchestrations etc
Should have worked with RDBMS,Data Warehouses and Unix Shell Scripts
Financial domain knowledge is a plus
Excellent verbal and written communication
Agile experience
What we value
These skills will help you succeed in this role with MUST and NICE to have skills
Must have : Hadoop, Spark, Scala, Unix shell scripting, Cloud Migration,AWS, Databricks
SVN, GIT, JFrog,Jenkins,VeraCode, SQL, ETL,RDBMS
Nice to have : Airflow, Quantexa, JFrog,Jenkins,VeraCode
Education & Preferred Qualifications
Preferable to computer science degree
3+ years of experience in development in global teams
Good at communication and implementation
Additional requirements
· Experienced, fully competent in own area
· Shares own expertise with others; will co-ordinate activities of others/the team
· Completes own role independently or with minimal supervision/guidance
· Strong written & verbal communication skills. Experience writing, reviewing technology documents including user guides.
Why this role is important to us
Our technology function, Global Technology Services (GTS), is vital to State Street and is the key enabler for our business to deliver data and insights to our clients. We’re driving the company’s digital transformation and expanding business capabilities using industry best practices and advanced technologies such as cloud, artificial intelligence and robotics process automation.
We offer a collaborative environment where technology skills and innovation are valued in a global organization. We’re looking for top technical talent to join our team and deliver creative technology solutions that help us become an end-to-end, next-generation financial services company.
Join us if you want to grow your technical skills, solve real problems and make your mark on our industry.
About State Street
What we do. State Street is one of the largest custodian banks, asset managers and asset intelligence companies in the world. From technology to product innovation, we’re making our mark on the financial services industry. For more than two centuries, we’ve been helping our clients safeguard and steward the investments of millions of people. We provide investment servicing, data & analytics, investment research & trading and investment management to institutional clients.
Work, Live and Grow. We make all efforts to create a great work environment. Our benefits packages are competitive and comprehensive. Details vary by location, but you may expect generous medical care, insurance and savings plans, among other perks. You’ll have access to flexible Work Programs to help you match your needs. And our wealth of development programs and educational support will help you reach your full potential.
Inclusion, Diversity and Social Responsibility. We truly believe our employees’ diverse backgrounds, experiences and perspectives are a powerful contributor to creating an inclusive environment where everyone can thrive and reach their maximum potential while adding value to both our organization and our clients. We warmly welcome candidates of diverse origin, background, ability, age, sexual orientation, gender identity and personality. Another fundamental value at State Street is active engagement with our communities around the world, both as a partner and a leader. You will have tools to help balance your professional and personal life, paid volunteer days, matching gift programs and access to employee networks that help you stay connected to what matters to you.
State Street is an equal opportunity and affirmative action employer.
Discover more at StateStreet.com/careers
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Airflow APIs Architecture AWS AWS DataSync Computer Science Data analysis Databricks ETL Finance Git Hadoop Jenkins Python RDBMS Research Robotics Scala Shell scripting Spark SQL
Perks/benefits: Career development Flex hours Health care
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.