Member of Technical Staff – Data Engineer
New York, New York, United States
Full Time Senior-level / Expert USD 161K - 314K
Microsoft
Entdecken Sie Microsoft-Produkte und -Dienste für Ihr Zuhause oder Ihr Unternehmen. Microsoft 365, Copilot, Teams, Xbox, Windows, Azure, Surface und mehr kaufen
CLICK HERE TO APPLY
Microsoft AI (MS AI) is seeking an experienced Data Engineer to help architect, design and implement a highly scalable and optimized data platform for processing 50TB/day of data from AI systems. We’re looking for someone who possesses technical prowess, a methodical approach to problem-solving, proficiency in data platform and pipeline technologies, and a mastery of templating to architect solutions that stand the test of time and who will bring an abundance of positive energy, empathy, and kindness to the team every day, in addition to being highly effective. The right candidate enjoys building world-class data platforms that are scalable, maintainable and kept up to date with current tech stacks and design patterns.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
By applying to this U.S. New York, New York position, you are required to be local to the New York area and in office 3 days a week. Responsibilities:
Preferred Qualifications:
Data Engineering IC6 - The typical base pay range for this role across the U.S. is USD $161,600 - $286,200 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $209,600 - $314,400 per year. Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay Microsoft will accept applications and processes offers for these roles on an ongoing basis.
Microsoft will accept applications and processes offers for these roles on an ongoing basis.
#copilot #microsoftai
Job Description
Overview: As Microsoft continues to push the boundaries of AI, we are on the lookout for passionate individuals to work with us on the most interesting and challenging AI questions of our time. Our vision is bold and broad — to build systems that have true artificial intelligence across agents, applications, services, and infrastructure. It’s also inclusive: we aim to make AI accessible to all — consumers, businesses, developers — so that everyone can realize its benefits.Microsoft AI (MS AI) is seeking an experienced Data Engineer to help architect, design and implement a highly scalable and optimized data platform for processing 50TB/day of data from AI systems. We’re looking for someone who possesses technical prowess, a methodical approach to problem-solving, proficiency in data platform and pipeline technologies, and a mastery of templating to architect solutions that stand the test of time and who will bring an abundance of positive energy, empathy, and kindness to the team every day, in addition to being highly effective. The right candidate enjoys building world-class data platforms that are scalable, maintainable and kept up to date with current tech stacks and design patterns.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
By applying to this U.S. New York, New York position, you are required to be local to the New York area and in office 3 days a week. Responsibilities:
- Thought leader and owner of the architecture blueprint of data platform
- Superior coding skills in SPARK using Scala, Python and Java
- Work collaboratively with other Platform, infrastructure, application engineers as well as AI Researchers to build next generation data platform services and capabilities.
- Ship high-quality, well-tested, secure, and maintainable code.
- Find a path to get things done despite roadblocks to get your work into the hands of users quickly and iteratively.
- Enjoy working in a fast-paced, design-driven, product development cycle.
- Embody our Culture and Values.
- Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 8 years experience in software development, data modeling or data engineering work
- OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 6 year(s) experience in software development, or data engineering work
- OR equivalent experience.
- 5 years of hands experience in building from ground up large scale data processing platforms with more than 100 data pipelines. Use of Apache Hadoop eco system, Kafka Stream/Flink, columnar databases, vector databases, semantic search technologies, RDBMS databases, key value stores, etc.
- 5 years' experience building scalable services on top of public cloud infrastructure like Azure, AWS, or GCP.
- 2 years' experience building distributed systems at scale and extensive systems knowledge that spans bare-metal hosts to containers to networking.
Preferred Qualifications:
- 10 years technical engineering experience building data platforms that handle large volumes of data in both batch and real time. Coding in languages including, but not limited to, Python, C#, Java, Spark, SQL
- Ability to identify, analyze, and resolve complex technical issues, ensuring optimal performance, scalability, and user experience.
- Dedication to writing clean, maintainable, and well-documented code with a focus on application quality, performance, and security.
- Demonstrated interpersonal skills and ability to work closely with cross-functional teams, including product managers, designers, and other engineers.
- Ability to clearly communicate complex technical concepts to both technical and non-technical stakeholders.
- Passion for learning new technologies and staying up to date with industry trends, best practices, and emerging technologies in web development and AI.
- Ability to work in a fast-paced environment, manage multiple priorities, and adapt to changing requirements and deadlines.
- Proven ability to collaborate and contribute to a positive, inclusive work environment, fostering knowledge sharing and growth within the team.
Data Engineering IC6 - The typical base pay range for this role across the U.S. is USD $161,600 - $286,200 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $209,600 - $314,400 per year. Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay Microsoft will accept applications and processes offers for these roles on an ongoing basis.
Microsoft will accept applications and processes offers for these roles on an ongoing basis.
#copilot #microsoftai
Job stats:
1
1
0
Categories:
Engineering Jobs
Leadership Jobs
Tags: Architecture AWS Azure Computer Science Copilot Data pipelines Distributed Systems Engineering Flink GCP Hadoop Java Kafka Mathematics Pipelines Python RDBMS Scala Security Spark SQL
Perks/benefits: Career development
Region:
North America
Country:
United States
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
Business Intelligence Analyst jobsBI Developer jobsSr. Data Engineer jobsData Engineer II jobsPrincipal Data Engineer jobsStaff Data Scientist jobsStaff Machine Learning Engineer jobsData Science Manager jobsData Manager jobsPrincipal Software Engineer jobsData Science Intern jobsBusiness Data Analyst jobsJunior Data Analyst jobsData Analyst Intern jobsData Specialist jobsSoftware Engineer II jobsResearch Scientist jobsLead Data Analyst jobsSr. Data Scientist jobsDevOps Engineer jobsAI/ML Engineer jobsData Engineer III jobsStaff Software Engineer jobsSenior Backend Engineer jobsBI Analyst jobs
Git jobsAirflow jobsEconomics jobsLinux jobsOpen Source jobsKafka jobsComputer Vision jobsGoogle Cloud jobsJavaScript jobsMLOps jobsData Warehousing jobsNoSQL jobsTerraform jobsPhysics jobsKPIs jobsPostgreSQL jobsRDBMS jobsScikit-learn jobsHadoop jobsBanking jobsScala jobsGitHub jobsStreaming jobsData warehouse jobsPandas jobs
R&D jobsClassification jobsBigQuery jobsOracle jobsDistributed Systems jobsPySpark jobsCX jobsdbt jobsReact jobsScrum jobsLooker jobsRAG jobsMicroservices jobsRobotics jobsJira jobsRedshift jobsIndustrial jobsSAS jobsData Mining jobsNumPy jobsPrompt engineering jobsMySQL jobsGPT jobsELT jobsModel training jobs