Data Engineer

Overview

WHO WE ARE:

Beyondsoft Consulting is a leading mid-sized business IT and consulting company that combines modern technologies and proven methodologies to tailor solutions that move your business forward.Our global head office is based in Singapore, and our team is made up of a diversely talented team of experts who thrive on innovation and pushing the bounds of technology to solve our customers’ most pressing challenges.When it comes time to deliver, we set our sights on that sweet spot where brilliance, emerging technologies, best practices, and accountability converge. We have a global presence spanning four continents (North America, South America, Europe, and Asia). Our global network of talent and customer-centric engagement model enables us to provide top-quality services on an unprecedented scale.

WHAT WE’RE ABOUT:

We believe that collaboration, transparency, and accountability are the values that guide our business, our delivery, and our brand. Everyone has something to bring to the table, and we believe in working together with our peers and clients to leverage the best of one another in everything we do. When we proactively collaborate, business decisions become easier, innovation is greater, and outcomes are better.

Our ability to achieve our mission and live out our values depends upon a diverse, equitable, and inclusive culture. So, we strive to foster a workplace where people have the respect, support, and voice they deserve, where innovative ideas flourish, and where people can unleash their brilliance. For more information regarding DEI at Beyondsoft, please go to https://www.beyondsoft.com/diversity/.

POSITION SUMMARY:Our Redmond-based client is looking for an AI Data Engineer 2 for a remote -based position in United states.

Our client’s team is looking for a strong Data Engineer to help build systems that can provide insight into the health of PC Gaming experiences including performance, reliability, and health of various features at scale using data from the market. As a Data Engineer your role will be to build and maintain data pipelines, ETL processes, data storage systems, and dashboard visualizations to facilitate efficient data collection, processing, and analysis. The primary consumer of this will be the engineering teams so this will be a role embedded within the product team, getting deep area knowledge of PC Gaming experiences, how we ensure their health and performance, and ensuring we can have a smart alerting system when something goes wrong.

Responsibilities

• Respond to internal customer requests, bug fixes and ongoing performance optimizations to maintain data pipeline health and availability
• Support internal partners with data analysis.
• Communicate with internal partner teams to troubleshoot issues and build new data assets: share insights, learnings and recommendations, best practices.
• Build additional data pipelines as needed. Maintain data quality and integrity.
• Maintain and improve data pipeline health, monitoring and alerting systems to meet and
• Improve SLA for existing data pipelines
• Ensure tools, data pipelines and data adhere to the latest privacy and security compliance guidelines.
• Identify requirements for reports, scorecards, self-serve tools, etc. to help product teams monitor health and business performance of features with each release.
• Identify requirements for data stream telemetry, manage data classifications
• Processing data storage systems for engineering teams and evaluate improvements from internal partner teams to data pipeline availability and health monitoring
• Automate and streamline regular reports and BI processes including visualization tools like
• Improve existing health and alerting systems with real-time data signal processing.

Qualifications

• Must have 2-4 years of experience with processing big data and building system health reports for warm path / near-real time and cold / batch processed data.
• Must have a minimum of 3+ years’ experience with processing big data and building system health reports for near real-time and batch data.
• Must have minimum 4+ years’ experience with Azure Data Explorer (Kusto) and Azure Data Lake (Cosmos).
• Must have minimum 4+ years’ experience with Kusto Query Language and Cosmos scripts, as these are the primary programming languages to be used.
• Experience with Azure Data Explorer / Kusto and Azure Data Lake / Cosmos.
• Knowledge of Azure Data Factory and batch data transform pipelines.
• Experience with Kusto Query Language and U-SQL / Cosmos scripts to process big data facts and build out intermediate summary tables.
• Experience building PowerBI visualizations from health and usage data aggregated from customer telemetry data pipelines.
• Strong written and oral communication skills.
• Strong troubleshooting and problem-solving skills.
• Demonstrated history of success.
• Desire to be working with data and helping businesses make better data driven decisions.

WHAT WE HAVE TO OFFER:Because we know how important our people are to the success of our clients, it’s a priority to make sure we stay committed to our employees and making Beyondsoft a great place to work. We take pride in offering competitive compensation and benefits along with a company culture that embodies continuous learning, growth, and training with a dedicated focus on employee satisfaction and work/life balance.

• A competitive pay range of $60/hr- $61/hr (depending on experience).
• Position Location: 100% Remote - US
• 15 days per year of Paid Time Off (PTO).
• 8 paid holidays per year + 1 floating holiday.
• 401(k) retirement plan with company match.
• Eligible employees (and their families) are offered the following company-sponsored benefits: Medical, dental, and vision insurance, health savings account (HSA), short-term and long-term disability, employee assistance plan (EAP), and basic life and AD&D insurance.
• Eligible employees (and their families) are offered the following voluntary employee-funded benefits: Health care flexible spending account, dependent care flexible spending account, commuter benefits, voluntary accident & critical injury coverage, voluntary long-term care coverage, and voluntary life and AD&D insurance.

Beyondsoft provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type with regards to race, color, religion, age, sex, national origin, disability status, genetics, veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. This policy applies to all terms and conditions of employment, including recruiting, hiring, and the full employee lifecycle up through and including termination.