Tackling Retrieval Issues with Agentic Pipelines
A key focus during this phase of development has been tackling retrieval and processing challenges when working with large datasets in LLM pipelines . As the Virtual Situation Room ingests more information from diverse sources, we needed a way to process and analyze large volumes of data without exceeding model context limits. Ensuring that relevant information could still be retrieved, structured, and synthesized by the agent pipeline became a central technical challenge. To address this, we explored different approaches for handling large datasets in LLM workflows, including retrieval-based architectures and tools such as Azure AI Search . After evaluating several options, we collaborated to design and implement the full report generation pipeline , moving from architecture design through to a functional implementation. The solution we developed relies on a chunking-based approach , where large datasets are broken into smaller segments that can be processed sequentially and lat...