Like other PaaS offerings built from third party offerings on the CSPs, the current wave of LLMs comes with its own set of logging and observability challenges. We’ll explore some, as well as share some learnings from how to tackle this for both observability and detection and response purposes.