Setup LLM model for Amazon AWS
We take data security very seriously. Your code will sit on your premises and go to a model that you control, sitting in your cloud.
Step 1: Get Access to Mixtral 8x7B on AWS Bedrock
AWS Bedrock is a fully managed service providing foundational Model Access. It is in scope for SOC2, HIPAA and ISO and is in compliance with GDPR. For more details on data security, click here.
Visit here. Click
Model Access. SelectMixtral 8x7B Instructand hit “Save Changes”You should see the below after a few seconds.
Note: Mixtral 8x7B is a completely open source model that is publicly available. This means none of your data is used to train Mixtral 8x7b.
Step 2: Give us access to Mixtral 8x7b on AWS Bedrock
You will have to create an IAM user so that p0 can access AWS Bedrock on your behalf.
Click here. Create an user name (
bedrock). Click Next.Click
Attach Policies Directly. Search for Bedrock. SelectAmazonBedrockFullAccessClick
NextClick
Create UserChange your IAM user in the link here and paste in your browser:
Create
Access Key—>Local Code—>Next—>Create access key. Keep yourAccess KeyandSecret Accesshandy for the product.
