Data Engineer - Assistant Vice President
Bangalore, India
State Street
State Street provides investment servicing, investment management, investment research and trading services to institutional investors worldwide.As Data Engineer you will
- Collaborate across a variety of teams to enable our Data Platform needs and design, implement, and maintain a secure and scalable infrastructure platform spanning across AWS/Azure and our Data Center
- Own and ensure that internal and external SLAβs meet and exceed expectations, System centric KPIs are continuously monitored
- Work on our data lake, data warehouse, and stream processing systems to create a unified query engine, multi-model databases, analytics extracts and reports, as well as dashboard and visualizations
- Design and build systems for high availability, high throughput, data consistency, security, and end user privacy, defining our next generation of data analytics tooling
- You will mentor other engineers and promote software engineering best practices across the organization designing systems with monitoring, auditing, reliability, and security at their core
- Come up with solutions for scaling data systems for various business needs and collaborate in a dynamic and consultative environment
- Knowledge of at least one of the public cloud platforms AWS, Azure, or GCP is required.
- Knowledge of a programming language - Python, Scala, or SQL
- Knowledge of end-to-end data analytics workflow
- Hands-on professional experience in Databricks
- Excellent time management and prioritization skills
- Excellent written and verbal communication
- Bonus - Knowledge of Data Science and Machine Learning (e.g., build and deploy ML Models)
Core/Must Have Skills:
- Knowledge of at least one of the public cloud platforms AWS or Azure is required.
- Minimum 5+ years of Databricks experience using Azure Cloud
- 5+ years of hands on expertise in Hadoop and Scala
- Practical experience with Data Engineering and the accompanying DevOps & DataOps workflows
- Knowledge of a programming language - Python, Scala, or SQL
- Knowledge of end-to-end data analytics workflow
- Hands-on professional experience in Databricks
- Excellent time management and prioritization skills
- Excellent written and verbal communication
- Bonus - Knowledge of Data Science and Machine Learning (e.g., build and deploy ML Models)
- Strong end-to-end ownership and a good sense of urgency to enable proper self-prioritization
Good to Have Skills:
- Certification on Azure/AWS
- Certification on Hadoop, Scala and Databricks
- Familiarity with SDLC and Agile methodologies
* Salary range is an estimate based on our AI, ML, Data Science Salary Index π°
Job stats:
0
0
0
Categories:
Engineering Jobs
Leadership Jobs
Tags: Agile AWS Azure Data Analytics Databricks DataOps Data warehouse DevOps Engineering GCP Hadoop KPIs Machine Learning ML models Privacy Python Scala SDLC Security SQL
Region:
Asia/Pacific
Country:
India
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
Staff Machine Learning Engineer jobsData Scientist II jobsPrincipal Data Engineer jobsStaff Data Scientist jobsBI Developer jobsData Manager jobsJunior Data Analyst jobsResearch Scientist jobsData Science Manager jobsBusiness Data Analyst jobsLead Data Analyst jobsData Engineer III jobsSenior AI Engineer jobsData Specialist jobsData Science Intern jobsSr. Data Scientist jobsPrincipal Software Engineer jobsData Analyst Intern jobsAzure Data Engineer jobsSoftware Engineer II jobsData Analyst II jobsBI Analyst jobsSoftware Engineer, Machine Learning jobsJunior Data Engineer jobsSenior Data Scientist, Performance Marketing jobs
Snowflake jobsLinux jobsEconomics jobsOpen Source jobsBanking jobsHadoop jobsJavaScript jobsComputer Vision jobsRDBMS jobsPhysics jobsKafka jobsData Warehousing jobsMLOps jobsAirflow jobsNoSQL jobsKPIs jobsR&D jobsGoogle Cloud jobsScala jobsOracle jobsData warehouse jobsStreaming jobsClassification jobsPostgreSQL jobsGitHub jobs
Scikit-learn jobsSAS jobsCX jobsTerraform jobsScrum jobsPandas jobsPySpark jobsData Mining jobsDistributed Systems jobsRobotics jobsIndustrial jobsBigQuery jobsLooker jobsJira jobsUnstructured data jobsRedshift jobsJenkins jobsE-commerce jobsdbt jobsReact jobsMicroservices jobsPharma jobsData strategy jobsMySQL jobsNumPy jobs