Data Engineer III
Bangalore Office BLS2, India
Who are we?
Equinix is the world’s digital infrastructure company®, operating over 260 data centers across the globe. Digital leaders harness Equinix's trusted platform to bring together and interconnect foundational infrastructure at software speed. Equinix enables organizations to access all the right places, partners and possibilities to scale with agility, speed the launch of digital services, deliver world-class experiences and multiply their value, while supporting their sustainability goals.
Our culture is based on collaboration and the growth and development of our teams. We hire hardworking people who thrive on solving challenging problems and give them opportunities to hone new skills and try new approaches, as we grow our product portfolio with new software and network architecture solutions. We embrace diversity in thought and contribution and are committed to providing an equitable work environment that is foundational to our core values as a company and is vital to our success.
Job Summary
As a key member of the Data Team @ Equinix, you will be responsible for end-to-end development of Data Analytics use cases, Equinix Data Lake platform and tools. The role must be hands on and will be willingness to work as DevOps model.
The role is for a self-motivated individual with software engineering skills and expertise with Big Data and cloud technologies. The candidate will be extensively involved in hands-on activities including POCs, design, documentation, development, and test of new functionality. Candidate must be agile and flexible with changing priorities based on team’s needs.
Qualifications
Primary Skills:
2-5 Years of professional software development experience
Strong on leading edge GCP Data Engineering tools and practices – Dataflow, Dataproc, Dataprep, Cloud Functions, IAM, Composer, Kubernetes, pub/sub, Cloud Storage, stack driver and BigQuery.
Strong Experience in programming languages like SQL, Python and Version control tools like GITHUB.
Have implemented or working knowledge on CI/CD
Prior expertise with development of Data pipelines in Cloud Composer written in Python.
Good background on SQL and BigQuery jobs, tables, Procedures, scheduled queries and leading data warehousing practices
Understands evolution of databases for in-memory, NoSQL & indexing technologies along with experience on real-time & stream processing systems like Kafka, Storm, pub sub, Spark Streaming.
Experience in writing API’s.
Experience with Data quality and Metadata management solutions.
Good Understanding and articulation of pipeline scalability and potential performance issues.
Self-starter with an in-depth hands-on work experience with multiple large-scale implementations of Google Cloud Platform.
Demonstrated skills in communication, analysis, problem solving and short term and long-term planning.
Preferred:
GCP certification(s)
Experience in setup, configuration and going to production activities for cloud solutions – Jenkins, Docker Images, Ansible, Terraform, Packer, Cloud Build, Cloud Run.
Proven experience as a successful senior engineer and/or cloud engineer highly desirable
Understanding of Data, Networking, and DevOps scripting and tooling
Flair for data, schema, data model, PL/SQL, Star & snowflake schema, how to bring efficiency in data modelling for efficient querying data for analysis, understands criticality TDD and develops data validation techniques.
Experienced, persuasive, and effective presenter, both written and verbal.
Excellent interpersonal and organizational skills, ability to handle diverse situations, multiple initiatives, and rapidly changing priorities.
Must be a self-starter who requires minimal supervision.
Equinix is committed to ensuring that our employment process is open to all individuals, including those with a disability. If you are a qualified candidate and need assistance or an accommodation, please let us know by completing this form.
Equinix is an Equal Employment Opportunity and, in the U.S., an Affirmative Action employer. All qualified applicants will receive consideration for employment without regard to unlawful consideration of race, color, religion, creed, national or ethnic origin, ancestry, place of birth, citizenship, sex, pregnancy / childbirth or related medical conditions, sexual orientation, gender identity or expression, marital or domestic partnership status, age, veteran or military status, physical or mental disability, medical condition, genetic information, political / organizational affiliation, status as a victim or family member of a victim of crime or abuse, or any other status protected by applicable law.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Ansible APIs Architecture Big Data BigQuery CI/CD Data Analytics Dataflow Data pipelines Dataproc Data quality Data Warehousing DevOps Docker Engineering GCP GitHub Google Cloud Jenkins Kafka Kubernetes NoSQL Pipelines Python Snowflake Spark SQL Streaming TDD Terraform
Perks/benefits: Career development Flex hours
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.