The ‘brownie recipe problem’: why LLMs must have fine-grained context to deliver real-time results

Large Language Models (LLMs) struggle with context, particularly in real-time ordering systems. Instacart's CTO, Anirban Kundu, refers to this as the "brownie recipe problem." LLMs must understand user preferences and available products to provide assistive experiences.