Yeah I do. You can get data locality in GovCloud, a U.S. data centre, or even EU regions.
It’s governed by your master AWS agreement (which will make your compliance officer happy), and billing is also conveniently handled by AWS.
Of course the Chinese models on it are rotten old and not cheap. But if you want to configure an app to use inference that is entirely controlled, it’s the next best thing to running local.
- Your inputs are within the security boundary of your AWS account or AWS accounts
Can OpenRouter say the same? - NO
- Your inputs are not shared with models creators
Can OpenRouter say the same? - NO
- Your inputs are not used to train the next model
Can OpenRouter say the same? - NO
- Within certain limits and certain models:
"50.10.1. Subject to the limitations in this Section 50.10, AWS will defend you and your employees, officers, and directors against any third-party claim alleging that the Generative AI Output generated by an Indemnified Generative AI Service infringes or misappropriates that third party’s intellectual property rights, and will pay the amount of any adverse final judgment or settlement."
Can OpenRouter say the same? - NO
Comments
Yeah I do. You can get data locality in GovCloud, a U.S. data centre, or even EU regions.
It’s governed by your master AWS agreement (which will make your compliance officer happy), and billing is also conveniently handled by AWS.
Of course the Chinese models on it are rotten old and not cheap. But if you want to configure an app to use inference that is entirely controlled, it’s the next best thing to running local.
Most important...
- Your inputs are within the security boundary of your AWS account or AWS accounts
- Your inputs are not shared with models creators - Your inputs are not used to train the next model - Within certain limits and certain models:For those that hadn't read yet (on https://aws.amazon.com/service-terms/):
"Certain models" means "only AWS's own trained models" (Nova etc), so not e.g. Bedrock Claude or GPT.
"Certain limits" means they don't defent if the input to the model is the IP.