On September 3, 2024, Salesforce announced that Anthropic’s latest large language models — Claude 3.5 Sonnet, Claude 3 Opus, and Claude 3 Haiku — are now available on the Salesforce Einstein platform through Amazon Bedrock. The integration is exposed via Salesforce’s Bring Your Own Large Language Model (BYO LLM) capability, which lets customers connect external LLMs to their CRM applications.
What this enables
The Claude models are intended to enhance efficiency, insight, and personalization across Salesforce use cases such as sales, customer service, marketing, commerce, and IT. Example use cases called out by Salesforce include:
- Sales and marketing: generating tailored pitches, analyzing call transcripts, creating personalized content, and evaluating campaign performance.
- Customer service: summarizing cases and producing personalized responses.
- Healthcare and financial services: summarizing records, generating educational materials, analyzing reports, and creating investment recommendations.
- Legal and technology: analyzing contracts and user feedback, generating product descriptions.
- Media and entertainment: generating content ideas and personalized recommendations.
Integration details and admin workflow
Key integration points:
- Customers can connect Claude models through existing AWS Bedrock environments.
- Users may choose between Claude 3.5 Sonnet, Claude 3 Opus, and Claude 3 Haiku when building custom prompt templates in Salesforce.
- Interactions are routed through Salesforce’s secure AI infrastructure and subject to the Einstein Trust Layer’s responsible-AI safeguards, including dynamic grounding and toxicity detection.
Typical setup steps provided by Salesforce:
- Open Einstein Studio in Salesforce Data Cloud.
- Select the Foundation Models tab and click "Add Foundation Model."
- Choose to connect via Amazon Bedrock and provide required credentials (e.g., API keys, region information).
- Configure and test the model in the Model Playground.
- Create custom prompt templates using the Prompt Builder.
These tools are intended to make it easier for admins and developers to create, customize, and extend AI-powered Salesforce applications without advanced coding.
Security and customization
Salesforce emphasizes enterprise-grade security and accuracy for Claude, noting the models’ design intent to reduce hallucinations and better mimic near-human voice and tone. The partnership gives customers flexibility to integrate different Claude variants to balance intelligence, latency, and cost according to their needs. As Kaushal Kurapati, Senior Vice President of Product for AI at Salesforce, put it: "Through our partnership with Anthropic, customers gain the flexibility to integrate their own LLMs, introducing Claude models with diverse levels of intelligence, speed, and cost-effectiveness. This empowers users to tailor their CRM applications to their unique requirements."
Background and next steps
Salesforce had already added Anthropic Claude 3 models hosted on Amazon Bedrock to its AI platform in Summer ’24; this announcement clarifies availability of the latest Claude 3.5 Sonnet, Claude 3 Opus, and Claude 3 Haiku models via the BYO LLM path. For more information and implementation help, Salesforce recommends contacting a Salesforce representative and reviewing Amazon and Salesforce developer resources on building generative-AI powered Salesforce applications with Amazon Bedrock.
