Software Engineer II at Microsoft Hyderabad | AI and RAG Role
About the job
Microsoft is hiring a Software Engineer II in Hyderabad, Telangana. The role sits in the Azure Data engineering organization. You will build AI-powered features with large language models (LLMs) and retrieval-augmented generation (RAG).
Candidates need a Bachelor’s degree in Computer Science or a related field and 5+ years of coding experience. The role is in-office 3 days a week.
Job Details
- Company: Microsoft
- Role: Software Engineer II
- Location: Hyderabad, Telangana, India
- Experience: 5+ years of technical engineering experience
- Salary: Not disclosed
- Employment type: Full-Time
- Work site: 3 days a week in-office
- Travel: Less than 25%
- Profession: Software Engineering
- Role type: Individual Contributor
- Job number: 200063987
- Date posted: Oct 29, 2026
What You’ll Do
- Design and deliver AI-powered features using large language models.
- Focus on effective context management, reliability, and measurable customer value.
- Build RAG solutions using technologies such as Azure Cosmos DB and semantic search.
- Provide relevant, grounded responses to users.
- Apply AI-assisted and agentic development practices and tools to improve productivity, quality, and delivery.
What You Need
- Bachelor’s degree in Computer Science or a related technical field.
- 5+ years of technical engineering experience coding in languages such as C, C++, C#, Java, JavaScript, or Python, or equivalent experience.
- Ability to meet Microsoft, customer, or government security screening requirements.
Preferred Skills
- Experience working on semantic search systems.
- The listing also accepts a Master’s degree in Computer Science or a related field with 5+ years of technical engineering experience.
Mandatory Security Screening
The role requires the Microsoft Cloud background check on hire or transfer. The check repeats every two years.
About the Team
Microsoft’s Azure Data engineering team builds data products such as Microsoft Fabric, Azure SQL DB, Azure Cosmos DB, Azure Data Factory, and Power BI. Its stated mission is to build the data platform for the age of AI.
The Fabric Platform team builds the shared foundation for all Fabric workloads. The Microsoft IQ team uses a shared semantic layer to support analytics, natural language experiences, and AI scenarios.
How to Apply
- Check that you meet the degree and experience requirements.
- Use Apply on Original Source ↗ at the top of this job page to open the original listing and follow its application instructions.
- Upload your resume on the Microsoft careers page.
Microsoft accepts applications on an ongoing basis until the position is filled. The listing says it stays open for a minimum of 5 days.
Before You Apply
- Note that the title is Software Engineer II, but the listing asks for 5+ years of experience.
- Show hands-on work with LLMs, RAG, or semantic search in your resume.
- Be ready for the background check, which repeats every two years.
Skills
Prepare for this exact job
Pick a tool, copy the prompt and paste it into ChatGPT, Gemini or Claude. The AI will ask for your resume when the tool needs it, so you get answers for this exact job, not generic advice.
Preparing your job-specific prompt...
Job Details
About Microsoft
Microsoft is a global technology company. Its Azure Data engineering team builds data products including Microsoft Fabric, Azure SQL DB, Azure Cosmos DB, Azure Synapse Analytics, and Power BI.
Browse similar jobs in Hyderabad
JobsInHyd is a job discovery platform and is not the employer or recruiter for this position. Job details are sourced from the original application source and may change. Please verify the latest information before applying.
JobsInHyd does not guarantee hiring outcomes.Microsoft is hiring a Software Engineer II in Hyderabad, Telangana. The role sits in the Azure Data engineering organization. You will build AI-powered features with large language models (LLMs) and retrieval-augmented generation (RAG).
Candidates need a Bachelor’s degree in Computer Science or a related field and 5+ years of coding experience. The role is in-office 3 days a week.
Job Details
- Company: Microsoft
- Role: Software Engineer II
- Location: Hyderabad, Telangana, India
- Experience: 5+ years of technical engineering experience
- Salary: Not disclosed
- Employment type: Full-Time
- Work site: 3 days a week in-office
- Travel: Less than 25%
- Profession: Software Engineering
- Role type: Individual Contributor
- Job number: 200063987
- Date posted: Oct 29, 2026
What You’ll Do
- Design and deliver AI-powered features using large language models.
- Focus on effective context management, reliability, and measurable customer value.
- Build RAG solutions using technologies such as Azure Cosmos DB and semantic search.
- Provide relevant, grounded responses to users.
- Apply AI-assisted and agentic development practices and tools to improve productivity, quality, and delivery.
What You Need
- Bachelor’s degree in Computer Science or a related technical field.
- 5+ years of technical engineering experience coding in languages such as C, C++, C#, Java, JavaScript, or Python, or equivalent experience.
- Ability to meet Microsoft, customer, or government security screening requirements.
Preferred Skills
- Experience working on semantic search systems.
- The listing also accepts a Master’s degree in Computer Science or a related field with 5+ years of technical engineering experience.
Mandatory Security Screening
The role requires the Microsoft Cloud background check on hire or transfer. The check repeats every two years.
About the Team
Microsoft’s Azure Data engineering team builds data products such as Microsoft Fabric, Azure SQL DB, Azure Cosmos DB, Azure Data Factory, and Power BI. Its stated mission is to build the data platform for the age of AI.
The Fabric Platform team builds the shared foundation for all Fabric workloads. The Microsoft IQ team uses a shared semantic layer to support analytics, natural language experiences, and AI scenarios.
How to Apply
- Check that you meet the degree and experience requirements.
- Use Apply on Original Source ↗ at the top of this job page to open the original listing and follow its application instructions.
- Upload your resume on the Microsoft careers page.
Microsoft accepts applications on an ongoing basis until the position is filled. The listing says it stays open for a minimum of 5 days.
Before You Apply
- Note that the title is Software Engineer II, but the listing asks for 5+ years of experience.
- Show hands-on work with LLMs, RAG, or semantic search in your resume.
- Be ready for the background check, which repeats every two years.