Showing results for 2024 - ISE Developer Blog

Oct 11, 2024
2

Multimodal RAG with Vision: From Experimentation to Implementation

Pratima Sayyaparaju Maitreyi Nair Oscar Fimbres
Pratima,
Maitreyi,
Oscar

This blog post delves into the experimentation journey of fine-tuning a multimodal RAG pipeline to best answer user queries that require both textual and image context. We ran our experiments by systematically testing various approaches, adjusting one configuration setting at a time and using clearly defined evaluation metrics to validate the performance of each component of the RAG pipeline in isolation, as well as the end-to-end inference flow.

CSEISE
Sep 27, 2024
1

PromptFlow Serve – Benchmark Result Analysis

Dasith Wijesiriwardena
Dasith Wijesiriwardena

In this post we discuss how to test the throughput of PromptFlow pf-serve module and key learnings doing so. We explore the impact on throughput and performance the different WSGI and ASGI hosting methods have and the importance of engineering your Python nodes with the async await pattern for I/O.

CSEISE
Sep 9, 2024
7

Earning Agentic (and LangChain) Complexity

Michael Lanzetta Juan Burckhardt
Michael,
Juan

This post examines the challenges of adopting complex technologies like LangChain and agentic solutions in production environments, emphasizing the importance of understanding the necessity of such complexity. It provides insights on how to evaluate these technologies carefully, manage dependencies, and adhere to best practices for secure and stable AI applications.

CSEISE
Aug 16, 2024
7

Semantic Router using Azure AI Search

Christopher Buckley
Christopher Buckley

Potential semantic routing solution using Azure AI Search for scalable query handling.

CSEMachine LearningCognitive Services
Aug 2, 2024
8

Converting multiple sources to FHIR using Liquid

Arpit Gaur
Arpit Gaur

A brief summary of how Microsoft ISE teams creation a solution to integrate patients data from multiple fragmented sources into a standard FHIR data model

CSEISEFrameworks
Jul 26, 2024
1

LLM Prompt Injection Considerations With Tool Use

Dasith Wijesiriwardena
Dasith Wijesiriwardena

This post discusses a pattern to prevent a class of prompt injection attacks in LLM-based solutions. It emphasizes the importance of building strong foundational patterns to mitigate risks and avoid potential pitfalls. By implementing this pattern, teams can enhance the security of their tool-based solutions.

CSEISE
Jul 12, 2024
3

Document Summarization Solution Patterns using Azure Open AI & Langchain

Komal Grover
Komal Grover

This post lists the various solution patterns that can be applied for document summarization. Document summarization comes with its challenges related to token limitation and chunk sizes. This blog post discusses about the solutions to tackle those challenges.

CSEISE