Microsoft is a company where passionate innovators come to collaborate, envision what can be and take their careers further. This is a world of more possibilities, more innovation, more openness, and the sky is the limit thinking in a cloud-enabled world.

AI is the strategic bet for Microsoft. The Azure AI Platform is right at the front end. Our project involves cutting edge technologies and problems. Joining the projects you will gain knowledge and experience about generative AI, large language model, transformers, GPU optimization, AI applications, etc. The AI business is also growing rapidly, and our products will directly face the impact of the large number of customers, which is continuously growing.

The Model scaling and Model as a service team in AI Platform is hiring a Principal Software Engineer and is looking to push the boundaries of what is possible, again. You can help create the new model pool capacity management services. We are part of the control plane layer of the core platform serving Large Language models including AOAI to improve manageability, model agility, and GPU utilization. As a manager or IC in our team, you will have an opportunity to work on and extend Open Source Software (OSS) technologies as well as proprietary Microsoft services. You will help design & implement software components, participate in code reviews, design reviews, assist customers as needed to be able to leverage the service and keep the service running. You will support a team of talented engineers aiming to improve the abilities of what is possible with AI Platform today with industry leading performance, integration, security and reliability.

The Model scaling and Model as a service team focuses on:

• Building the world class model serving infrastructure for GenAI Models.

• Extending the LLM offering by building model as a service

We do not just value differences or different perspectives. We seek them out and invite them in so we can tap into the collective power of everyone in the company. As a result, our customers are better served.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities

• Collaborate with key stakeholders to comprehend and identify user requirements, scope solutions, estimate work, and schedule deliverables.

• Lead discussions on the architecture of products or solutions and apply engineering principles to establish robust and maintainable architecture and designs.

• Manage and drive feature execution with high quality and great agility.

• Lead by example by producing extensible and maintainable code, adhering to best engineering practices, raising the quality bar, and improving the team's response to customer incidents.

• Lead the team to respond, resolve, and integrate customer feedback with agility and dedication.

• Mentor and grow dev.

• Embody ourCulture (https://careers.microsoft.com/v2/global/en/culture) & Values (https://www.microsoft.com/en-us/about/corporate-values)

Qualifications

Required/Minimum Qualifications

• ​​Bachelor's Degree in Computer Science, or related technical discipline AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, Java, or Scala

• OR equivalent experience.​

Other Requirements

• Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check:

• This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Preferred/Additional Qualifications

• ​​Bachelor's Degree in Computer Science or related technical field AND 10+ years technical engineering experience with coding in languages including, but not limited to, C, C++, Java, or Scala

• OR Master's Degree in Computer Science or related technical field AND 10+ years technical engineering experience with coding in languages including, but not limited to, C, C++, Java, or Scala

• OR equivalent experience.

• Experience with distributed systems design and implementation.

• Proficiency in Agile development practices and Continuous Integration/Continuous Deployment (CI/CD).

• Experience working on large-scale projects or applications.

• Effective communication skills and ability to collaborate with diverse remote teams.

• Quick learner with a passion for solving complex and exciting problems.

• Familiarity with Azure is a plus.

Software Engineering IC5 - The typical base pay range for this role across the U.S. is USD $137,600 - $267,000 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $180,400 - $294,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay

Microsoft will accept applications for the role until November 4, 2024.

#AIPLATFORM

#SWE24

Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations (https://careers.microsoft.com/v2/global/en/accessibility.html) .