Data Engineer- ELK
KIN51438 Hyderabad (KIN51438) Gachibowli
Kyndryl
At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day.Who We Are
At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward – always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our employees, our customers and our communities.
The Role
1. Maintain, support, and troubleshoot ELK/OpenSearch stack for logging, searching, troubleshooting, and incident response.
2. Performance monitoring and tuning of ELK/OpenSearch clusters.
3. Design, build, update, deploy, and support custom tools, scripts, and integrations for systemic automation.
4. Dashboard creation and maintenance.
5. Alerting creation and maintenance.
6. Index maintenance and index pattern maintenance.
7. Capacity planning os Elastic Search Clusters and fine-tuning techniques for bulk indexing and querying.
8. Ensure data modeling, bulk document indexing, and search API optimization.
9. Integrate ELK/OpenSearch with enterprise tools and APIs for authentication and authorization.
10. Develop and maintain plugins for custom capabilities.
11. Experience in using Elastic Search Cluster Monitoring Tools (Marvel)
12. Previous experience with automation and driving real-time monitoring solutions that provide visibility into cluster health and key performance indicators. Technical understanding of core logging and monitoring architecture.
13. Ability to work across teams to continuously analyze system performance in production, troubleshoot consumer and engineering reported issues, and proactively identify areas in need of optimization.
Are you ready to dive headfirst into the captivating world of data engineering at Kyndryl? As a Data Engineer, you'll be the visionary behind our data platforms, crafting them into powerful tools for decision-makers. Your role? Ensuring a treasure trove of pristine, harmonized data is at everyone's fingertips.
As a Data Engineer at Kyndryl, you'll be at the forefront of the data revolution, crafting and shaping data platforms that power our organization's success. This role is not just about code and databases; it's about transforming raw data into actionable insights that drive strategic decisions and innovation.
In this role, you'll be engineering the backbone of our data infrastructure, ensuring the availability of pristine, refined data sets. With a well-defined methodology, critical thinking, and a rich blend of domain expertise, consulting finesse, and software engineering prowess, you'll be the mastermind of data transformation.
Your journey begins by understanding project objectives and requirements from a business perspective, converting this knowledge into a data puzzle. You'll be delving into the depths of information to uncover quality issues and initial insights, setting the stage for data excellence. But it doesn't stop there. You'll be the architect of data pipelines, using your expertise to cleanse, normalize, and transform raw data into the final dataset—a true data alchemist.
Armed with a keen eye for detail, you'll scrutinize data solutions, ensuring they align with business and technical requirements. Your work isn't just a means to an end; it's the foundation upon which data-driven decisions are made – and your lifecycle management expertise will ensure our data remains fresh and impactful.
So, if you're a technical enthusiast with a passion for data, we invite you to join us in the exhilarating world of data engineering at Kyndryl. Let's transform data into a compelling story of innovation and growth.
Your Future at Kyndryl
Every position at Kyndryl offers a way forward to grow your career. We have opportunities that you won’t find anywhere else, including hands-on experience, learning opportunities, and the chance to certify in all four major platforms. Whether you want to broaden your knowledge base or narrow your scope and specialize in a specific sector, you can find your opportunity here.
Who You Are
You’re good at what you do and possess the required experience to prove it. However, equally as important – you have a growth mindset; keen to drive your own personal and professional development. You are customer-focused – someone who prioritizes customer success in their work. And finally, you’re open and borderless – naturally inclusive in how you work with others.
Required Skills and Experience
•5+ Years of experience in data mining, data storage and Extract-Transform-Load (ETL) processes
•Experience in data pipelines development and tooling, e.g., Glue, Databricks, Synapse, or Dataproc
•Experience with both relational and NoSQL databases, PostgreSQL, DB2, MongoDB
•Excellent problem-solving, analytical, and critical thinking skills
•Ability to manage multiple projects simultaneously, while maintaining a high level of attention to detail
•Communication Skills: Must be able to communicate with both technical and non-technical colleagues, to derive technical requirements from business needs and problems
1. ELK certification.
2. Experience with OpenSearch migration and integration.
3. Familiarity with big data analytics and monitoring tools.
4. Experience with automation and real-time monitoring solutions.
5. Bachelor's degree in Computer Science, Engineering, or related field.
Nice to Have:
1. Experience with cloud platforms (AWS, Azure, GCP).
2. Knowledge of containerization (Docker, Kubernetes).
3. Familiarity with agile development methodologies.
Preferred Skills and Experience
•Experience working as a Data Engineer and/or in cloud modernization
•Experience in Data Modelling, to create conceptual model of how data is connected and how it will be used in business processes
•Professional certification, e.g., Open Certified Technical Specialist with Data Engineering Specialization
•Cloud platform certification, e.g., AWS Certified Data Analytics – Specialty, Elastic Certified Engineer, Google Cloud Professional Data Engineer, or Microsoft Certified: Azure Data Engineer Associate
•Understanding of social coding and Integrated Development Environments, e.g., GitHub and Visual Studio
•Degree in a scientific discipline, such as Computer Science, Software Engineering, or Information Technology
Being You
Diversity is a whole lot more than what we look like or where we come from, it’s how we think and who we are. We welcome people of all cultures, backgrounds, and experiences. But we’re not doing it single-handily: Our Kyndryl Inclusion Networks are only one of many ways we create a workplace where all Kyndryls can find and provide support and advice. This dedication to welcoming everyone into our company means that Kyndryl gives you – and everyone next to you – the ability to bring your whole self to work, individually and collectively, and support the activation of our equitable culture. That’s the Kyndryl Way.
What You Can Expect
With state-of-the-art resources and Fortune 100 clients, every day is an opportunity to innovate, build new capabilities, new relationships, new processes, and new value. Kyndryl cares about your well-being and prides itself on offering benefits that give you choice, reflect the diversity of our employees and support you and your family through the moments that matter – wherever you are in your life journey. Our employee learning programs give you access to the best learning in the industry to receive certifications, including Microsoft, Google, Amazon, Skillsoft, and many more. Through our company-wide volunteering and giving platform, you can donate, start fundraisers, volunteer, and search over 2 million non-profit organizations. At Kyndryl, we invest heavily in you, we want you to succeed so that together, we will all succeed.
Get Referred!
If you know someone that works at Kyndryl, when asked ‘How Did You Hear About Us’ during the application process, select ‘Employee Referral’ and enter your contact's Kyndryl email address.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile APIs Architecture AWS Azure Big Data Computer Science Consulting Data Analytics Databricks Data Mining Data pipelines Dataproc DB2 Docker ELK Engineering ETL GCP GitHub Google Cloud Kubernetes MongoDB NoSQL OpenSearch Pipelines PostgreSQL
Perks/benefits: Career development Health care Startup environment
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.