Data Engineer - Assistant Vice President
Hyderabad, India
State Street
State Street provides investment servicing, investment management, investment research and trading services to institutional investors worldwide.As Data Engineer you will
- Collaborate across a variety of teams to enable our Data Platform needs and design, implement, and maintain a secure and scalable infrastructure platform spanning across AWS/Azure and our Data Center
- Own and ensure that internal and external SLA’s meet and exceed expectations, System centric KPIs are continuously monitored
- Work on our data lake, data warehouse, and stream processing systems to create a unified query engine, multi-model databases, analytics extracts and reports, as well as dashboard and visualizations
- Design and build systems for high availability, high throughput, data consistency, security, and end user privacy, defining our next generation of data analytics tooling
- You will mentor other engineers and promote software engineering best practices across the organization designing systems with monitoring, auditing, reliability, and security at their core
- Come up with solutions for scaling data systems for various business needs and collaborate in a dynamic and consultative environment
- Knowledge of at least one of the public cloud platforms AWS, Azure, or GCP is required.
- Knowledge of a programming language - Python, Scala, or SQL
- Knowledge of end-to-end data analytics workflow
- Hands-on professional experience in Databricks
- Excellent time management and prioritization skills
- Excellent written and verbal communication
- Bonus - Knowledge of Data Science and Machine Learning (e.g., build and deploy ML Models)
Core/Must Have Skills:
- Knowledge of at least one of the public cloud platforms AWS or Azure is required.
- Minimum 5+ years of Databricks experience using Azure Cloud
- 5+ years of hands on expertise in Hadoop and Scala
- Practical experience with Data Engineering and the accompanying DevOps & DataOps workflows
- Knowledge of a programming language - Python, Scala, or SQL
- Knowledge of end-to-end data analytics workflow
- Hands-on professional experience in Databricks
- Excellent time management and prioritization skills
- Excellent written and verbal communication
- Bonus - Knowledge of Data Science and Machine Learning (e.g., build and deploy ML Models)
- Strong end-to-end ownership and a good sense of urgency to enable proper self-prioritization
Good to Have Skills:
- Certification on Azure/AWS
- Certification on Hadoop, Scala and Databricks
- Familiarity with SDLC and Agile methodologies
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Job stats:
0
0
0
Categories:
Engineering Jobs
Leadership Jobs
Tags: Agile AWS Azure Data Analytics Databricks DataOps Data warehouse DevOps Engineering GCP Hadoop KPIs Machine Learning ML models Privacy Python Scala SDLC Security SQL
Region:
Asia/Pacific
Country:
India
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
Principal Data Scientist jobsPrincipal Data Engineer jobsData Scientist II jobsStaff Data Scientist jobsBI Developer jobsData Manager jobsJunior Data Analyst jobsResearch Scientist jobsData Science Manager jobsBusiness Data Analyst jobsLead Data Analyst jobsSenior AI Engineer jobsData Engineer III jobsData Science Intern jobsSr. Data Scientist jobsData Specialist jobsSoftware Engineer II jobsData Analyst Intern jobsSoftware Engineer, Machine Learning jobsJunior Data Engineer jobsData Analyst II jobsBI Analyst jobsSenior Data Scientist, Performance Marketing jobsSr Data Engineer jobsPrincipal Software Engineer jobs
Economics jobsSnowflake jobsLinux jobsHadoop jobsComputer Vision jobsOpen Source jobsJavaScript jobsMLOps jobsPhysics jobsBanking jobsRDBMS jobsKafka jobsAirflow jobsNoSQL jobsData Warehousing jobsScala jobsR&D jobsGoogle Cloud jobsKPIs jobsStreaming jobsData warehouse jobsClassification jobsGitHub jobsOracle jobsCX jobs
SAS jobsPostgreSQL jobsScikit-learn jobsData Mining jobsScrum jobsE-commerce jobsPandas jobsTerraform jobsDistributed Systems jobsPySpark jobsLooker jobsBigQuery jobsRobotics jobsJira jobsIndustrial jobsJenkins jobsUnstructured data jobsdbt jobsRedshift jobsReact jobsData strategy jobsMicroservices jobsMySQL jobsPharma jobsNumPy jobs