Description
Brands have expressed interest in using their own LLM models within the LivePerson environment to power GenAI experiences. Reasons include security, SLA, compliance, or because they have trained/ refined their own models that are tuned to their brand.
Customer Value: BYO LLM brings three primary sources of customer value to the table
- Performance: Brands can select the LLMs that work best for their intended use cases. Different providers and model versions have different strengths (Throughput, accuracy, etc…) so brands can mix and match to achieve optimal results. Brands can choose to utilize finetuned models trained on their own data if appropriate.
- Compliance: Brands can manage specific compliance concerns by operating models withing their own trusted environments.
- Cost: Brands can manage and optimize their LLM costs by leveraging existing provider contracts, or choosing models that maximize efficiency
Benefits
- Gives you greater control over data security and compliance, ensuring their data is handled according to their standards and regulatory requirements
- You can incorporate LLMs that have been specifically fine-tuned to align with your brand's unique data, ensuring a more tailored and effective use of Generative AI in our platform
- Establish your own SLAs to guarantee a more reliable and consistent performance. This customization ensures that the service you receive is precisely aligned with your specific operational needs
Related Links
Please work with your account team to get started.
Click here for release notes.
Status
Live