[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"cheat-sheet---en":3,"domain-info---en":3,"topic-info----en":3,"lesson-aws-certified-ai-practitioner-foundation-model-applications-fm-application-design-inference-parameters-en":4,"next-aws-certified-ai-practitioner-foundation-model-applications-fm-application-design-inference-parameters-en":19,"prev-aws-certified-ai-practitioner-foundation-model-applications-fm-application-design-inference-parameters-en":30},null,{"locked":5,"reason":6,"meta":7,"item":3},true,"paywall",{"title":8,"description":9,"isFree":10,"estimatedMinutes":11,"difficulty":12,"learningObjectives":13},"Inference Parameters","Same prompt, same model, different answers: the inference parameters that control how a model chooses each token, when to reach for each one, and the settings that quietly break a feature.",false,18,"intermediate",[14,15,16,17,18],"Explain how a model chooses each token from a probability distribution","Describe what temperature, top-k, and top-p each do to that distribution","Distinguish reshaping the distribution from truncating it","Choose settings for a factual task versus a creative task","Identify what response length, penalties, and stop sequences control",{"locked":5,"reason":6,"meta":20,"item":3},{"title":21,"description":22,"isFree":10,"estimatedMinutes":23,"difficulty":12,"learningObjectives":24},"Retrieval Augmented Generation (RAG)","Give a model access to your private, current data without retraining it: how RAG retrieves relevant passages at query time, how Amazon Bedrock Knowledge Bases automates it, and where the boundary with fine-tuning sits.",20,[25,26,27,28,29],"Explain the problem RAG solves that a base model cannot","Describe the two phases of RAG: ingestion and retrieval at query time","Explain what Amazon Bedrock Knowledge Bases automates","Distinguish RAG from fine-tuning and from pasting everything into a long context window","Identify business applications where RAG is the right fit",{"locked":10,"reason":3,"meta":31,"item":39},{"title":32,"description":33,"isFree":5,"estimatedMinutes":11,"difficulty":12,"learningObjectives":34},"Choosing a Foundation Model","The exam names eight criteria for choosing a pre-trained foundation model. This lesson walks each one, what it means for your design, and the exam cue that points at it.",[35,36,37,38],"List the eight selection criteria the exam names for choosing a pre-trained foundation model","Explain the design consequence of each criterion, especially modality, input and output length, and customization support","Distinguish model size from model complexity and explain why bigger is not a safe default","Match a scenario to the single criterion that decides it",{"id":40,"title":32,"body":41,"description":33,"difficulty":12,"estimatedMinutes":11,"extension":285,"infographics":286,"isFree":5,"learningObjectives":287,"meta":288,"navigation":5,"path":289,"quiz":290,"seo":340,"stem":341,"__hash__":342},"courses/courses/aws-certified-ai-practitioner/en/domains/03-foundation-model-applications/01-fm-application-design/01-choosing-a-foundation-model.md",{"type":42,"value":43,"toc":272},"minimark",[44,48,51,54,59,62,65,68,72,75,87,90,93,97,100,103,107,110,113,116,120,123,126,130,133,139,145,149,243,247,269],[45,46,47],"p",{},"The previous domain already taught you how to choose a model: eliminate on hard constraints, evaluate the survivors on your own task, then optimize the ones that pass for cost and latency. That method is the order of operations. This lesson is the checklist it operates on.",[45,49,50],{},"The exam guide, in Task Statement 3.1, names a specific set of criteria for choosing a pre-trained foundation model: \"cost, modality, latency, multilingual, model size, model complexity, customization, and input/output length.\" Each one is a different kind of question, and each carries a design consequence you feel later if you skip it. A question on this topic usually hides one of these criteria in the scenario wording and makes the tempting answer the model that would win if that sentence were not there. So the useful skill is recognizing which criterion a scenario is really testing.",[45,52,53],{},"We will walk them in the order they tend to bite, not the order the guide lists them.",[55,56,58],"h2",{"id":57},"modality-what-goes-in-what-comes-out","Modality: what goes in, what comes out",[45,60,61],{},"Modality is the kind of data a model accepts and produces. A text model reads and writes text. A multimodal model can accept images, audio, or video alongside text. An embedding model returns vectors instead of prose. An image generation model produces pictures from a description.",[45,63,64],{},"These are not interchangeable, and no other criterion can rescue a modality mismatch. A text-only model cannot read a scanned invoice, transcribe a call, or describe a photo, and fine-tuning does not add an input type. This is why modality is the first thing to check: it eliminates candidates outright, before quality is even on the table.",[45,66,67],{},"It is also the criterion the exam disguises most often. A scenario mentions scanned documents, product photos, or audio recordings, then offers a text-only model as the option with the best benchmark scores. The scores are a distraction. Read the scenario for what the input actually is before you read the model's capabilities.",[55,69,71],{"id":70},"input-and-output-length-two-limits-not-one","Input and output length: two limits, not one",[45,73,74],{},"Every model publishes two length limits, and confusing them is a reliable way to ship a broken feature.",[45,76,77,78,82,83,86],{},"The ",[79,80,81],"strong",{},"context window"," is the maximum number of tokens the model can take in on a single request. Everything counts against it: your instructions, any retrieved documents, the conversation so far, and the user's question. The ",[79,84,85],{},"maximum output length"," is a separate cap on how many tokens the model can generate in one response, and it is usually far smaller than the context window.",[45,88,89],{},"The gap between them is larger than most people expect. A model can publish a 200,000-token context window with a maximum output of only a few thousand tokens. That combination reads a very long document comfortably but cannot write a very long one. A team that reads \"200,000 tokens\" and plans to generate a full report in one call gets a response that stops in the middle, and nothing in the error explains why.",[45,91,92],{},"So the design question splits in two. How much does a single request need to take in, which sets the context window floor, and how long does the answer need to be, which sets the output-length floor. A summarization feature is heavy on input and light on output. A long-form drafting feature is the reverse. Match the model to whichever direction your workload leans.",[55,94,96],{"id":95},"multilingual-support","Multilingual support",[45,98,99],{},"A model trained mostly on English will still produce Spanish or Arabic when asked, but often with weaker grammar, thinner vocabulary, and more mistakes than it makes in English. General capability does not transfer evenly across languages, which is why the guide lists multilingual support as its own criterion rather than folding it into accuracy.",[45,101,102],{},"The consequence is practical. If your users write in Portuguese and read answers in Portuguese, a model that leads English benchmarks but stumbles in Portuguese is the wrong choice, and you only see the problem by testing in the language your users actually use. When a scenario names a non-English audience or a multi-language requirement, this criterion moves to the front.",[55,104,106],{"id":105},"model-size-and-model-complexity","Model size and model complexity",[45,108,109],{},"The guide lists model size and model complexity as two criteria, and they point at the same tradeoff from two angles. Size refers to the number of parameters. Complexity refers to how much capability that buys and what it costs to run.",[45,111,112],{},"The instinct almost everyone brings is that a bigger model is a safer choice. It is not, and the exam rewards knowing why. A larger model costs more per token, generates more slowly because it does more work per token, and often shows no measurable improvement on a narrow, well-specified task. A classifier sorting support tickets into eight categories does not need frontier reasoning. Paying for capability the task never exercises is waste that recurs on every single request, forever.",[45,114,115],{},"The pattern that holds up in practice is to start with a smaller model and move up only when your evaluation shows a real gap. Teams that start at the top rarely move back down, because nobody volunteers to make the assistant slightly worse to save money, so the overpayment becomes permanent. When a scenario gives you a tight latency budget or a simple, bounded task and offers a large model as an option, the smaller model that still passes is usually the intended answer.",[55,117,119],{"id":118},"customization-support","Customization support",[45,121,122],{},"If your plan depends on adapting the model, whether by fine-tuning it on your examples or grounding it in your data, you have to confirm the model supports that path before you commit to it. Not every model can be fine-tuned, and the ones that can differ in which methods they accept and what data format they expect.",[45,124,125],{},"This is a selection criterion precisely because discovering the limit late is expensive. A team that picks a model on quality alone, builds around it, and then learns it cannot be fine-tuned in the way their use case needs has to start the selection over. The customization tradeoffs themselves are a later lesson in this topic. Here the point is narrower: if customization is part of the plan, it is part of the selection.",[55,127,129],{"id":128},"latency-and-cost","Latency and cost",[45,131,132],{},"These are the two criteria you optimize once a model has cleared everything above, and the earlier lessons covered them in depth, so we keep it short.",[45,134,135,138],{},[79,136,137],{},"Latency"," is how quickly the model responds. Larger models are slower, and generation is sequential, so a long answer from a large model can take several seconds. A live chat experience has a latency budget; a nightly batch job usually does not. Verify a model meets the budget before you build a real-time feature on it, rather than hoping to close the gap afterward.",[45,140,141,144],{},[79,142,143],{},"Cost"," is driven mostly by model choice, more than by any prompt optimization. The same workload can differ by orders of magnitude between two models in the same family. Among the models that pass every other gate, the cheapest fast one that still meets your quality bar is the right pick.",[55,146,148],{"id":147},"the-criteria-at-a-glance","The criteria at a glance",[150,151,152,168],"table",{},[153,154,155],"thead",{},[156,157,158,162,165],"tr",{},[159,160,161],"th",{},"Criterion",[159,163,164],{},"The question it asks",[159,166,167],{},"How it behaves",[169,170,171,183,194,204,215,225,234],"tbody",{},[156,172,173,177,180],{},[174,175,176],"td",{},"Modality",[174,178,179],{},"Does it accept and produce the right data types?",[174,181,182],{},"Eliminates",[156,184,185,188,191],{},[174,186,187],{},"Input and output length",[174,189,190],{},"Can it take in the request and generate a long enough answer?",[174,192,193],{},"Eliminates or ranks",[156,195,196,199,202],{},[174,197,198],{},"Multilingual",[174,200,201],{},"Does it work well in the languages my users use?",[174,203,193],{},[156,205,206,209,212],{},[174,207,208],{},"Model size and complexity",[174,210,211],{},"Is its capability matched to the task, not overshot?",[174,213,214],{},"Optimizes",[156,216,217,220,223],{},[174,218,219],{},"Customization",[174,221,222],{},"Does it support the adaptation my plan needs?",[174,224,182],{},[156,226,227,229,232],{},[174,228,137],{},[174,230,231],{},"Is it fast enough for the experience?",[174,233,214],{},[156,235,236,238,241],{},[174,237,143],{},[174,239,240],{},"Is it the cheapest option that still qualifies?",[174,242,214],{},[55,244,246],{"id":245},"exam-tips","Exam tips",[248,249,250,254,257,260,263,266],"ul",{},[251,252,253],"li",{},"Memorize the named list: cost, modality, latency, multilingual, model size, model complexity, customization, input and output length. Then, for any scenario, find which one is doing the deciding.",[251,255,256],{},"Modality is the most common hidden filter. Non-text input in the scenario plus a text-only model in the options means that option is wrong, whatever its scores.",[251,258,259],{},"Input length and output length are separate limits. A large context window does not promise a long response. Watch for a scenario that needs long generation and a model with a small output cap.",[251,261,262],{},"Multilingual support surfaces when the audience is named as non-English. General benchmark scores do not settle it.",[251,264,265],{},"Model complexity is a trade, not a target. Tight latency or a narrow task points at the smaller model that still passes.",[251,267,268],{},"Customization support is checked before selection, not after. If the plan says fine-tune, confirm the model can be fine-tuned.",[45,270,271],{},"The rule to carry into a question: read for the constraint first, then match it to one of the eight criteria. Most model-choice scenarios turn on a single sentence. The next lesson moves from choosing the model to controlling how it responds, using the inference parameters you set on every request.",{"title":273,"searchDepth":274,"depth":274,"links":275},"",3,[276,278,279,280,281,282,283,284],{"id":57,"depth":277,"text":58},2,{"id":70,"depth":277,"text":71},{"id":95,"depth":277,"text":96},{"id":105,"depth":277,"text":106},{"id":118,"depth":277,"text":119},{"id":128,"depth":277,"text":129},{"id":147,"depth":277,"text":148},{"id":245,"depth":277,"text":246},"md",[],[35,36,37,38],{},"/courses/aws-certified-ai-practitioner/en/domains/03-foundation-model-applications/01-fm-application-design/01-choosing-a-foundation-model",{"passingScore":291,"questions":292},70,[293,302,310,318,326,333],{"question":294,"type":295,"options":296,"correctAnswer":298,"explanation":301},"An application must accept audio recordings of customer calls and return a written summary. A candidate model leads every text benchmark but accepts text input only. Which selection criterion decides this?","single",[297,298,299,300],"Cost, because audio processing is expensive","Modality, because the model cannot accept the required input type","Latency, because audio is slow to process","Model complexity, because summarization needs a large model","Modality is a hard filter: a text-only model cannot accept audio no matter how well it scores on text tasks, and no amount of prompting or tuning adds an input type. The other criteria only matter among models that already accept the right modality.",{"question":303,"type":295,"options":304,"correctAnswer":306,"explanation":309},"A model publishes a 200,000-token context window and a 4,000-token maximum output. A team needs it to generate a 20,000-word report in one call. What is the problem?",[305,306,307,308],"The context window is too small to hold the report","The maximum output length caps the response far below what the report needs","The model does not support the report's language","Nothing, since 200,000 tokens is more than enough","Context window and maximum output length are separate limits, and the output cap is usually far smaller. A 4,000-token ceiling truncates a 20,000-word report regardless of how large the input capacity is. Treating a big context window as a promise of big responses is a common planning error.",{"question":311,"type":312,"options":313,"correctAnswers":316,"explanation":317},"Which of the following are selection criteria the exam guide names for choosing a pre-trained foundation model? (Choose 3.)","multiple",[176,314,137,187,315],"The model provider's stock price","The number of GPUs in the training cluster",[176,137,187],"Task 3.1 names cost, modality, latency, multilingual support, model size, model complexity, customization, and input and output length. The provider's stock price and the training hardware are not selection criteria a practitioner weighs when picking a model to build on.",{"question":319,"type":295,"options":320,"correctAnswer":322,"explanation":325},"A team is choosing between a small model and a large flagship model. Both pass their accuracy tests on a narrow, well-defined classification task. Which is the better choice and why?",[321,322,323,324],"The flagship model, because more capability is always safer","The small model, because both meet the quality bar and it costs less and responds faster","Neither, because classification needs a specialized model","Both, alternating between them per request","Once both models clear the quality bar for the task, model complexity becomes a cost and latency question, and paying for capability the task never uses is waste that recurs on every request. The flagship tempts because bigger feels safer, but a narrow classification task does not exercise frontier reasoning.",{"question":327,"type":295,"options":328,"correctAnswer":329,"explanation":332},"An organization plans to adapt a model to its internal writing style using its own labeled examples. Which selection criterion should it check before committing to a model?",[96,329,330,331],"Whether the model supports the customization method they intend to use","The model's release date","The color of the provider's logo","Not every model can be fine-tuned, and the ones that can differ in which methods and data formats they accept. If the plan depends on customization, confirming the model supports it belongs in the selection decision, not after the model is chosen.",{"question":334,"type":295,"options":335,"correctAnswer":96,"explanation":339},"A customer-facing chat feature must serve users in Portuguese, Spanish, and Arabic. Which criterion moves to the front of the decision?",[336,96,337,338],"Model size","Stop sequences","Provisioned Throughput","A model trained mostly on English can technically produce other languages but often does so with weaker fluency and accuracy, so multilingual support becomes a filter when the audience is not English-speaking. It is named as its own criterion precisely because general capability does not guarantee quality in every language.",{"title":32,"description":33},"courses/aws-certified-ai-practitioner/en/domains/03-foundation-model-applications/01-fm-application-design/01-choosing-a-foundation-model","E68zDGNycXgFYfGSF74kfSpvb0OiQcWXJU8Y8nI-I3Y"]