Technical Questions on LLM/GenAI Architecture and Data Flow
Hello PA Team,
I'm looking for a deeper technical understanding of how the GenAI/LLM integration works, specifically regarding data flow and security. I've seen the general documentation, but I have a few more detailed architectural questions.
Could you please provide clarification on the following points:
What data is sent? When a GenAI feature is used, what exactly is included in the payload sent to the external LLM provider? For example, does it send metadata like table/column names, the query structure, or aggregated/sample data from the visual?
Where is it sent? What are the specific endpoints (domains/IPs) that the Pyramid server communicates with for these features? This is important for firewall configurations.
How is it sent? What protocol and port are used for this communication (e.g., HTTPS on port 443)?
Is there any logging? Can I audit or log the prompts sent to the LLM and the responses received back from it? Having a full trail of the entire "conversation" would be very helpful for monitoring and troubleshooting.
A more technical description of this process would be extremely valuable for understanding the security and data governance aspects of using this feature in an enterprise environment.
Thanks!