Data Platform and DevOps Engineering, Sr Staff Engineer
Bangalore, India
Synopsys Inc
General Information
Job Title Data Platform and DevOps Engineering, Sr Staff Engineer Job ID 5612 Country India City Bangalore Date Posted 03-Sep-2024 Job Category Engineering Job Subcategory Machine Learning Hire Type Employee Remote Eligible NoDescriptions & Requirements
Job Description and RequirementsData Platform and DevOps Engineering, Sr Staff Engineer
We are looking for a senior staff engineer and technical leader to join a dynamic team that is building the next generation of full stack data analytics platform software for Synopsys products.
The ideal candidate will have a strong technical background and expertise in architecture, software components, operations, CI/CD and reliability for data platforms, data analytics, machine learning and AI infrastructure, microservices, containers, distributed systems, and API design.
This candidate will also have technical leadership skills to guide junior team members on a regular basis.
Key Responsibilities
- Translate marketing and technical requirements into enterprise grade, scalable, distributed platform architecture.
- Drive, lead, spec, implement and maintain operations for complex data analytics software and infrastructure to meet the requirements. Troubleshoot and debug complex technical issues.
- This role may span multiple tiers such as data management, backend services, visualization, and presentation, CI/CD and DevOps infrastructure, APIs for the infrastructure and SRE functionalities.
- Collaborate with R&D teams across multiple business groups, and other cross-functional teams to align technical roadmaps and deployment strategy.
- Provide substantial and broad-based technical leadership and technical direction, identify and research opportunities for technical innovation, and drive the definition and delivery of market-leading solutions.
- Perform project leadership roles, drive programs and business initiatives.
- Determine methods and procedures on new assignments and projects. Offer new solutions and encourage and motivate others to support new directions. May advise senior management on specialized technical or business issues.
Required Skills
- BS/MS EE/CS/CE with a minimum of 8-10 years of experience developing large scale distributed systems architectures and data platforms and similar systems.
- Strong skills in software architecture, proficient in distributed systems and microservices architecture-based design and implementation.
- Solid understanding of Linux systems with hands-on experience in scripting languages (Python, Shell, Config files) for on-prem datacenter development and deployment.
- Strong skills in modern DevOps and CI/CD pipelines (e.g. Jenkins, GitOps, ArgoCD/FluxCD etc) for development and software lifecycle management; Understanding of Kubernetes and containerized ecosystems (e.g., Docker, Singularity) is highly desired
- Proficiency in Python programming language, familiarity with other languages such as NodeJs/Typescript, C/C++, Java, Rust and others are highly desired.
- Solid understanding of Data engineering tools such as Kafka, Spark, Dask, Hive, Airflow, SQL and NoSQL databases and in-memory databases such as Redis, Vector databases and ML Ops tools such as ML Flow, Kubeflow, KServe, and others.
- Familiarity with machine learning stack packages, ML model versioning and deployment, building ML Ops pipelines
- Strong understanding of on-prem datacenter data store technologies, data analytics platforms and other storage solutions
- Strong understanding of cloud infrastructure and services in one or more of the public clouds (AWS, Azure, GCP)
- Ability to work independently, and exceptional verbal/written communication, leadership, interpersonal, and teamwork skills are a must.
- Solid project management skills encompassing project planning, estimation, and execution. Technical leadership skills including mentoring and/or guiding junior team members is a plus. Ability to write well documented code and produce appropriate documentation.
Desired skills
A significant overlap with the following skills is highly desired:
- Knowledge of constructing SRE observability stack using tools such as OpenTelemetry, ELK and LGTM. Knowledge or Authentication and Authorization tools and libraries, and Data Governance practices is a plus.
- Knowledge of on-prem datacenter Networking is a plus.
- Designing and deploying distributed, big data and analytics and cloud native applications on native OS and/or Containerized environments including but not limited to Kubernetes for on-prem datacenters
- Experience in building APIs and SDKs
- Knowledge and experience of all above mentioned skills on Public cloud vendors is a plus, including certifications such as AWS Solutions Architect, Cloud Security Certification, OpenStack Certification
Our Silicon Design & Verification business is all about building high-performance silicon chips—faster. We’re the world’s leading provider of solutions for designing and verifying advanced silicon chips. And we design the next-generation processes and models needed to manufacture those chips. We enable our customers to optimize chips for power, cost, and performance—eliminating months off their project schedules.
At Synopsys, we’re at the heart of the innovations that change the way we work and play. Self-driving cars. Artificial Intelligence. The cloud. 5G. The Internet of Things. These breakthroughs are ushering in the Era of Smart Everything. And we’re powering it all with the world’s most advanced technologies for chip design and software security. If you share our passion for innovation, we want to meet you.
Inclusion and Diversity are important to us. Synopsys considers all applicants for employment without regard to race, color, religion, national origin, gender, sexual orientation, gender identity, age, military veteran status, or disability.
Inclusion and Diversity are important to us. Synopsys considers all applicants for employment without regard to race, color, religion, national origin, gender, sexual orientation, gender identity, age, military veteran status, or disability.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow APIs Architecture AWS Azure Big Data CI/CD Data Analytics Data governance Data management DevOps Distributed Systems Docker ELK Engineering GCP Java Jenkins Kafka KServe Kubeflow Kubernetes Linux Machine Learning Microservices ML infrastructure Node.js NoSQL OpenStack Pipelines Python R R&D Research Rust Security Spark SQL TypeScript
Perks/benefits: Career development
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.