Subdomain 1.1: Describe core generative AI (gen AI) concepts and use cases.
1.A legal firm wants to use a foundation model to analyze and summarize 200-page legal contracts in a single request. Which foundation model characteristic is most critical to evaluate to ensure the model can process the entire document at once?
- A.Modality
- B.Context window
- C.Image generation performance
- D.Reinforcement learning capability
Show answer & explanation
Correct answer: B — Context window
- A. Modality refers to the types of data a model can handle, such as text, images, or audio. While the task requires a model with text modality, it does not determine how much text the model can process in a single request.
- B. The context window represents the maximum amount of input text (measured in tokens) that a model can process at one time. For 200-page documents, a large context window is the critical factor that allows the entire document to be ingested and analyzed without truncation or the need for multi-step processing.
- C. Image generation performance relates to the model's ability to create visual content. This is irrelevant to the requirement of processing and summarizing long-form text legal documents.
- D. Reinforcement learning capabilities, such as Reinforcement Learning from Human Feedback (RLHF), are used to align a model's outputs with human preferences and improve safety or style. However, these techniques do not expand the model's physical input capacity or context window size.