Please enable JavaScript.
Coggle requires JavaScript to display documents.
AWS Bedrock - Coggle Diagram
AWS Bedrock
use cases?
-
-
-
Text Summary articles, blogs, etc
-
-
parameters
Temperature
closer to zero --> high probability word
away from zero --> less probability word
more factual to more creative
Top P
Top P defines a cutoff based on the sum of probabilities of the potential choices. If you set Top P below 1.0, the model considers the most probable options and ignores the less probable ones.
-
Stop sequences
A stop sequence is a sequence of characters. If the model encounters a stop sequence, it stops generating further tokens.
-
cost?
on demand
For text generation models, you are charged for every input token processed and every output token generated.
For embeddings models, you are charged for every input token processed.
For image generation models, you are charged for every image generated.
Provisioned Throughput
you purchase model units for a specific base or custom model. A model unit provides a certain throughput, which is measured by the maximum number of input or output tokens processed per minute.
primarily designed for large, consistent inference workloads that need guaranteed throughput.
-
charged by the hour, you have the flexibility to choose between 1-month or 6-month commitment terms.
what?
Amazon Bedrock is a fully managed service that offers leading foundation models (FMs) and a set of tools to quickly build and scale generative AI applications ensuring privacy and security.
-