RAG and Knowledge Bases on Amazon Bedrock: Chunking, Embeddings, Retrieval and Evaluation
Build a working mental model of retrieval-augmented generation on AWS for the AIF-C01 exam, the ingestion and retrieval pipelines, managed vs customer-managed knowledge bases, the four chunking strategies, embedding dimensions, the eight vector stores, metadata filters, the four retrieval APIs, RAG evaluation, the Kendra transition and the RAG vs fine-tuning vs prompt-only verdict, with AWS-verified numbers and ten exam-style questions.
Retrieval-augmented generation is the highest-frequency topic in Domain 3 of the AIF-C01 exam, and it is also the topic where most candidates memorise slogans instead of mechanisms. AWS's exam guide names RAG three times: "Define RAG and its business applications (e.g., Amazon Bedrock Knowledge Bases)", "services that store embeddings (OpenSearch, Aurora, Neptune, RDS for PostgreSQL)" and "RAG grounding". A slogan such as "RAG reduces hallucination" will not carry you, because the exam asks what happens when the default chunk size is wrong, when top-k is too large, when a filter operator is unsupported, or when a metric drops below threshold. This lesson teaches the mechanisms, and every number in it is pinned to a first-party AWS page as of October 2026.
====================================================================
AMAZON BEDROCK KNOWLEDGE BASES AT A GLANCE (Digest: Oct 2026)
====================================================================
WHAT RAG IS ..... data-source information improves relevancy
and accuracy; your data is searched at query
time and injected into the prompt
TWO KB TYPES .... MANAGED (BMKB): AWS runs ingestion, indexing,
storage, retrieval and reranking
CUSTOMER-MANAGED: you own the vector store
and every configuration
INGEST .......... fetch -> parse -> chunk -> embed -> vector
store, each chunk mapped to its source doc
RUNTIME ......... embed query -> similarity search -> augment
prompt -> generate with citations
DEFAULT CHUNKING FIXED_SIZE, 300 tokens, 20% overlap,
sentence boundaries honored
STRATEGIES ...... FIXED_SIZE | NONE | HIERARCHICAL | SEMANTIC
TOP-K ........... numberOfResults: min 1, max 100, default 5
EMBEDDINGS ...... Titan V2 1024 (also 512 / 256), Titan G1 1536,
Cohere Embed v3 1024, multimodal 1024
STORES (8) ...... OPENSEARCH_SERVERLESS, OPENSEARCH_MANAGED_
CLUSTER, RDS, NEPTUNE_ANALYTICS,
REDIS_ENTERPRISE_CLOUD, PINECONE,
MONGO_DB_ATLAS, S3_VECTORS
APIs ............ Retrieve | RetrieveAndGenerate |
GenerateQuery | AgenticRetrieveStream
EVALUATION ...... applicationType "RagEvaluation", LLM-as-a-judge,
JSON Lines, max 1,000 prompts per job,
metrics scored 0-1
KENDRA .......... maintenance mode since 2026-06-30; closed to
new customers after 2026-07-30
====================================================================How to read this lesson. Knowledge Bases features ship faster than exam guides are rewritten, so three reading rules apply. (1) AWS's own published default beats any blog's example, a sample that uses numberOfResults: 10 does not change the documented default of 5. (2) Capability differences between managed and customer-managed knowledge bases are exam gold, several features exist on one and not on the other. (3) Anything AWS does not confirm first-party is shown as unverified, never as recall material.
By the end of this lesson you will be able to:
- explain the two halves of a knowledge base, ingestion and runtime retrieval, and name what breaks at each stage;
- choose between a managed and a customer-managed knowledge base, and name the seven managed connectors;
- pick the right chunking strategy and defend the parameter values AWS recommends;
- size an embedding model by dimension, input limit and cost;
- select one of the eight vector stores for a given constraint;
- write a metadata filter that a managed knowledge base will actually accept;
- choose among Retrieve, RetrieveAndGenerate, GenerateQuery and AgenticRetrieveStream, and fix a prompt that exceeds the character limit;
- diagnose a failing RAG system by reading context relevance, coverage and faithfulness in the right order;
- defend the comparative verdict: RAG vs fine-tuning vs prompt-only, and Bedrock Knowledge Bases vs Amazon Kendra.
1. What RAG is, and what the exam guide really asks
1.1 The definition AWS uses
AWS defines retrieval-augmented generation as using data-source information to improve the relevancy and accuracy of a foundation model's response. The decisive clause is the second half: the knowledge base searches your data at query time and augments the prompt with the passages it finds. Nothing is written into the model. Weights do not move, no training job runs, and the same foundation model that answered carelessly without your documents now answers with them.
That sentence already eliminates three distractors on every RAG question:
- RAG does not change the model, so it cannot be confused with fine-tuning or continued pre-training;
- RAG does not need labeled data, so it cannot be the answer to "the team has no data scientists";
- RAG can be refreshed in minutes, so "the data changes weekly" points at RAG rather than at a training loop.
1.2 The three questions the exam guide maps to this lesson
Exam-guide line | What it is really testing | Where it lands here |
|---|---|---|
Define RAG and its business applications (e.g., Bedrock Knowledge Bases) | Definition, freshness, citations, low effort | Sections 1, 2 and 11 |
Services that store embeddings (OpenSearch, Aurora, Neptune, RDS for PostgreSQL) | The StorageConfiguration.type enum | Section 6 |
Cost tradeoffs: pre-training, fine-tuning, in-context learning, RAG, model distillation | RAG vs fine-tuning vs prompt-only | Section 11 |
RAG grounding | Faithfulness and citation metrics | Section 9 |
The AIF-C01 exam is 65 questions in 90 minutes, and Domain 3 (Domain 3 covers Foundation Models, Deployment and Operations in part) is weighted at 28%. RAG appears inside that weight as both a definition item and a troubleshooting item; which is why this lesson spends as many lines on evaluation as on architecture.
1.3 What RAG is weak at
AWS is explicit about RAG's structural weakness: it is poor at summarizing an entire document, because retrieval returns chunks, not whole files. If the business need is "read all 400 pages and give me the three themes", RAG is the wrong tool and the exam expects you to know that. Keep that limitation next to the benefit: RAG buys freshness and citations, and pays with partial context.
π Did you know? AWS's official decision order for RAG on AWS starts with Amazon Q Business, then Bedrock Knowledge Bases, then Kendra plus a generator, then a custom retriever: in that order, from Prescriptive Guidance's Choosing a RAG option. Most candidates skip straight to Bedrock and forget that a ready-made end-user assistant sits one step above it in AWS's own list. On the exam, "fully managed answer for business users" can legitimately point at Amazon Q Business rather than at a knowledge base you assemble yourself.
2. The RAG pipeline: ingestion and runtime
A knowledge base is two pipelines that never run at the same time. Ingestion runs when data changes; retrieval runs on every query. Confusing the two is the root cause of most bad diagnoses: a hallucination is almost never an ingestion problem, and a missing document is never a generation problem.
2.1 Ingestion: fetch, parse, chunk, embed, store
AWS documents the ingestion sequence as: fetch the document β parse it β chunk it β embed each chunk β write the vectors into a vector store, with every chunk mapped back to its source document. Amazon Bedrock keeps the vector database in sync for you, including deletions and re-ingestion, which is the practical meaning of "fully managed" here.
2.2 Runtime: embed, search, augment, generate
At query time the flow reverses: the query is embedded with the same embedding model β a similarity search returns the nearest chunks β the chunks are injected into the prompt β the foundation model generates an answer that carries citations back to the source documents.
2.3 What breaks at each stage
Stage | Failure you introduce | What the user sees | Which metric moves |
|---|---|---|---|
Fetch | Wrong prefix, file over 50 MB, permission denied | Document simply absent from answers | Context Coverage drops |
Parse | Tables and PDF columns flattened into noise | Fluent answers about nothing | Context Relevance drops |
Chunk | Question and answer split across two chunks | "There is not enough context" | Context Relevance drops |
Embed | Chunk longer than the model input limit | Silent truncation, half a chunk indexed | Context Coverage drops |
Search | top-k too small, filter too strict | Correct doc never retrieved | Context Coverage drops |
Generate | Prompt template lost its instructions | Contradiction with the retrieved text | Faithfulness drops |
Worked example 1: default ingestion sizing. If you omit the chunking configuration, Bedrock uses fixed-size chunking at 300 tokens with 20% overlap. The overlap is 60 tokens, so each chunk advances by a stride of 240 tokens. A 4,800-token employee handbook therefore yields roughly 4,800 Γ· 240 = 20 chunks, each retrievable on its own. AWS's own rule of thumb for estimating documents: 1 KB of text β 1,000 characters β 200 to 250 words.
Put the runtime order in the correct sequence:
How to answer
Ordering exercise with 4 items. Move them into the correct order, then check your answer.
Order the runtime steps of a Bedrock knowledge base query, from user input to answer:
Do not diagnose a generation problem at ingestion. If the retrieved passages are correct and the answer still contradicts them, the fix is the model or the prompt, not the chunk size. If the retrieved passages are wrong or missing, the fix is parsing, chunking, the embedding model or top-k, not the model. AWS's evaluation guidance states the rule directly: optimize retrieval before generation.
3. Two kinds of knowledge base: managed and customer-managed
3.1 Managed (BMKB) versus customer-managed
Dimension | Managed knowledge base | Customer-managed knowledge base |
|---|---|---|
Who runs ingestion, indexing, storage | AWS | You (and Bedrock, on your configuration) |
Who owns the vector store | AWS | You |
Embedding + reranking | Managed, reranking on by default | You configure both |
Search modes | Hybrid only, always | HYBRID or SEMANTIC via overrideSearchType (OpenSearch Serverless only) |
Semantic chunking | Not supported | Supported |
Connectors | 7 (S3, SharePoint, Confluence, Google Drive, OneDrive, Web Crawler, Custom) | Your data source configuration |
startsWith / stringContains filters | Not supported | Depends on the store |
3.2 The seven managed connectors
# | Connector | Typical content |
|---|---|---|
1 | Amazon S3 | Exports, data lakes, static document sets |
2 | SharePoint | Enterprise intranets |
3 | Confluence | Engineering and support wikis |
4 | Google Drive | Docs, Sheets, Slides of a team |
5 | OneDrive | Personal and team files |
6 | Web Crawler | Public product and help sites |
7 | Custom | Your own connector through the documented integration |
Note the asymmetry that exam questions exploit: a customer-managed knowledge base that uses Confluence, SharePoint or Salesforce as a source requires OpenSearch Serverless as its store, while a managed knowledge base offers you four console quick-create stores.
3.3 Quotas worth memorising
Limit | Value |
|---|---|
Source file size | 50 MB |
Metadata sidecar file | 10 KB |
Managed knowledge bases per account per Region | 10,000 |
Data sources per knowledge base | 200 |
Concurrent ingestion jobs | 50 |
Raw storage (managed) | 10 TB |
Query input characters | 10,000 |
Retrieve requests per minute | 600 (burst 25 per second) |
π Did you know? The 50 MB source-file cap and the 10 KB metadata cap are different limits that people merge into one "10 MB file limit" urban legend. The data source connector also exposes
maxFileSizeInMegaByteswith a documented default of 500, plusinclusionPrefixes,exclusionPrefixes, regexinclusionPatterns/exclusionPatterns,metadataFilesPrefixandaclEnabled, so most "why is this file missing" tickets are a filter problem, not a size problem.
4. Chunking: the four strategies and their parameters
Chunking is where RAG quality is won or lost, because a retrieval system can only return what ingestion actually created. AWS's API accepts exactly four values for chunkingStrategy: FIXED_SIZE, NONE, HIERARCHICAL, SEMANTIC: nothing else is valid.
4.1 The default you get when you configure nothing
Omitting the chunking configuration gives fixed-size chunking: 300 tokens with 20% overlap, honoring sentence boundaries. Sentence-boundary honoring matters more than it sounds: it is the difference between a chunk that ends mid-clause and a chunk that ends at a period, and AWS's own published case shows context relevance moving from 67% to 93% purely because FAQ questions and answers stopped being split apart.
4.2 Strategy comparison
Strategy | API value | Parameters | AWS recommended | Best for | Notes |
|---|---|---|---|---|---|
Default / fixed | FIXED_SIZE (or omitted) | maxTokens, overlapPercentage | 300 tokens, 20% overlap | Most documents | Honors sentence boundaries |
None | NONE | : | 1 file = 1 chunk | Pre-split data, 1 SKU per file | You pre-process upstream |
Hierarchical | HIERARCHICAL | parent, child, overlap tokens | Parent 1,500, child 300, overlap β60 | Manuals, legal, nested tables | Searches children, returns parents |
Semantic | SEMANTIC | maxTokens, bufferSize, breakpointPercentileThreshold | 300, buffer 1, threshold 95 | Unclear boundaries | Not available on managed KBs |
Custom | Lambda transformer | Your code | : | Domain-specific splitting | vectorIngestionConfiguration |
4.3 Hierarchical chunking
Hierarchical chunking creates a parent chunk (recommended 1,500 tokens, not embedded) and child chunks (recommended 300 tokens, embedded), with an overlap recommended at 20% of the child size β 60 tokens. Retrieval searches the children but returns the parents, so the model receives section-level context instead of a fragment.
Worked example 2, hierarchical sizing. With parent 1,500, child 300 and overlap 60, AWS's own sample requesting numberOfResults = 5 came back with 3 chunks, because several children mapped to the same parent. numberOfResults is therefore a cap, not a promise, a fact the exam can test in either direction: "fewer results than requested" is normal, and "more results than requested" is not.
4.4 Semantic chunking
Semantic chunking embeds adjacent sentences, compares their similarity, and cuts where similarity drops. The parameter ranges are contractual:
Parameter | Range | AWS recommended | Meaning |
|---|---|---|---|
maxTokens | 1 to 8,192 (blog notes 20 to 8,192 depending on embedder) | 300 | Hard ceiling for a chunk |
bufferSize | 0 to 1 | 1 | How many sentences on each side are compared |
breakpointPercentileThreshold | 50 to 99 | 95 | Cut only at the least-similar N% of boundaries |
Worked example 3, the AWS API worked example. With a threshold of 90 over 101 sentences, Bedrock compares 100 pairs and splits at the 10 least-similar boundaries (10%), producing 11 chunks, which are re-split if any exceeds maxTokens. With bufferSize = 1, sentence 10 is embedded from the context of sentences 9 + 10 + 11. Cohere Embed v3 caps input at 512 tokens, so chunks built for it cannot exceed that even if maxTokens is higher.
Semantic chunking is unavailable on managed knowledge bases, and it is never the default. Any answer claiming "semantic chunking with threshold 95 is what you get by default" is wrong twice. Equally, HIERARCHICAL must be configured explicitly: the default is fixed-size, not hierarchical.
Match each strategy to the situation it solves:
How to answer
Matching exercise with 5 pairs. Match each item on the left with its answer on the right.
Match each chunking strategy to the situation it is designed for:
Drag answers from here:
5. Embedding models: dimensions, limits and cost
5.1 The models a knowledge base accepts
Provider | Model | Model ID | Dimensions | Types | Input limit |
|---|---|---|---|---|---|
Amazon | Titan Embeddings G1: Text | amazon.titan-embed-text-v1 | 1536 | float | 8,192 tokens |
Amazon | Titan Text Embeddings V2 | amazon.titan-embed-text-v2:0 | 1024 default, 512, 256 | float, binary | 8,192 tokens / 50,000 chars |
Cohere | Embed English v3 | cohere.embed-english-v3 | 1024 | float, binary | 512 tokens β 2,048 chars |
Cohere | Embed Multilingual v3 | cohere.embed-multilingual-v3 | 1024 | float, binary | 512 tokens |
Amazon | Titan Multimodal G1 | : | 1024 | float | multimodal |
Cohere | Embed v3 (multimodal) | : | 1024 | float, binary | multimodal |
Amazon | Nova Multimodal Embeddings | : | 1024 | float | multimodal |
5.2 The dimension trade-off
Dimensions | Accuracy vs 1024 | Storage vs 1024 | Use |
|---|---|---|---|
1024 (default) | baseline | 1Γ | Maximum accuracy |
512 | β99% | β50% | Balanced |
256 | 97% | β75% | Cost and scale |
Worked example 4, the dimension budget. A team on Amazon Titan Text Embeddings V2 that needs roughly 75% less vector storage while keeping about 97% retrieval accuracy must set the output dimension to 256. At 512 it keeps β99% accuracy at half the storage. Adding embeddingTypes: ["binary"] cuts storage further. Embedding spend is measured in tokens: Titan V2 is priced at $0.02 per 1 million tokens, against $0.10 for V1, an 80% reduction on the same workload.
π Did you know? Titan Text V2 accepts 8,192 tokens or 50,000 characters and covers 100+ languages, while Cohere Embed v3 accepts only 512 tokens (about 2,048 characters). That single fact explains two exam traps at once: choosing Cohere means your effective chunk ceiling drops to 512, and a chunk that "fits the default 300 tokens" can still overflow an embedder if you raised
maxTokensfor a different model. Dimension and input limit are independent knobs: 1024 dimensions says nothing about how much text you may send.
6. Vector stores: eight options, four console quick-creates
Store | API type | Console quick-create | Notes and limits |
|---|---|---|---|
OpenSearch Serverless | OPENSEARCH_SERVERLESS | Yes | Needs a faiss engine index for metadata files; the only store allowing overrideSearchType: HYBRID; required for Confluence/SharePoint/Salesforce sources |
OpenSearch Service (managed cluster) | OPENSEARCH_MANAGED_CLUSTER | : | Hybrid plus full-text search |
Aurora PostgreSQL + pgvector | RDS | Yes (Serverless) | SQL plus vectors, ACID; pgvector supports up to 2,000 dimensions, IVFFlat and HNSW |
Neptune Analytics | NEPTUNE_ANALYTICS | Yes | GraphRAG: vectors plus graph traversal with openCypher |
Redis Enterprise Cloud | REDIS_ENTERPRISE_CLOUD | : | In-memory, ultra-low latency |
Pinecone | PINECONE | : | Managed vector database |
MongoDB Atlas | MONGO_DB_ATLAS | : | Mongo-compatible APIs |
Amazon S3 Vectors | S3_VECTORS | Yes | Cheapest: up to 90% lower storage cost, 2 billion vectors per index; no startsWith or stringContains |
Exam shorthand:
- OpenSearch Serverless = default and hybrid
- Aurora pgvector = SQL plus vector
- Neptune = GraphRAG
- Redis = lowest latency
- S3 Vectors = cheapest
- Kendra = enterprise search, not a knowledge-base store.
π Did you know? Amazon S3 Vectors is the newest entry and the one most likely to be framed as a cost question: AWS's Prescriptive Guidance puts it at up to 90% cheaper storage than traditional vector databases with 2 billion vectors per index, at roughly 100 ms-plus query latency. The catch for exam purposes is functional, not financial: S3 Vector indexes do not support the
startsWithorstringContainsfilter operators, so the cheapest store is also the one that removes the most convenient substring filters.
Amazon EMR Serverless is not a knowledge base vector store. It appears in some Prescriptive Guidance material about big-data processing, but it is absent from the StorageConfiguration.type enum: OPENSEARCH_SERVERLESS, OPENSEARCH_MANAGED_CLUSTER, RDS, NEPTUNE_ANALYTICS, REDIS_ENTERPRISE_CLOUD, PINECONE, MONGO_DB_ATLAS, S3_VECTORS. Any option offering EMR Serverless as the vector store for a knowledge base is wrong by construction. Similarly, Amazon Kendra is a search service, not a storage type; it can feed a knowledge base, but it cannot be one's store.
7. Metadata: sidecar files and retrieval filters
7.1 The sidecar pattern
Next to articles.pdf you place articles.pdf.metadata.json in the same S3 folder, capped at 10 KB, containing string, number or boolean values. Setting includeForEmbedding: true on a field concatenates its key and value into the text that gets embedded, which is how a value such as genre: cooking becomes part of the searchable representation rather than only a post-filter. A CSV data source can instead declare a contentFields column.
Worked example 5: the AWS filter example. Given articles.pdf plus a sidecar declaring genre, year and author, the following filter retrieves entertainment articles published after 2018, or any cooking or sports article whose author's name starts with "C":
{
"orAll": [
{
"andAll": [
{ "equals": { "key": "genre", "value": "entertainment" } },
{ "greaterThan": { "key": "year", "value": 2018 } }
]
},
{
"andAll": [
{ "in": { "key": "genre", "value": ["cooking", "sports"] } },
{ "startsWith": { "key": "author", "value": "C" } }
]
}
]
}7.2 The operator set
RetrievalFilter is a union: primitives composed with andAll / orAll, each of which requires at least 2 items.
Category | Operators |
|---|---|
Equality | equals, notEquals |
Ordering | greaterThan, greaterThanOrEquals, lessThan, lessThanOrEquals |
Membership | in, notIn, listContains |
String | startsWith, stringContains |
Composition | andAll, orAll (minimum 2 items each) |
Built-in key | x-amz-bedrock-kb-source-uri: filter by S3 prefix with no sidecar file at all |
Worked example 6: the operator that fails. If the same filter above runs against a managed knowledge base, it fails on startsWith. AWS documents that startsWith and stringContains are unsupported on managed knowledge bases and on S3 Vector indexes. The fix is to restructure the branch to equals or in: for example, an explicit author list, or to run the substring logic in the application after retrieval. Note that listContains is not a substitute: it tests membership in a list field, not a substring of a string field.
Three filter traps that cost marks. (1) startsWith and stringContains are not supported on managed knowledge bases or S3 Vector indexes. (2) andAll / orAll need two or more children: a single child is invalid. (3) Metadata files are capped at 10 KB; oversized sidecars are silently a data-source problem, not a retrieval problem. Always distinguish "the operator is invalid" from "the operator is valid but unsupported here".
8. Retrieval: four APIs, top-k and the token budget
8.1 Which API to call
API | What it does | Use when |
|---|---|---|
Retrieve | Returns ranked passages only | You own the prompt and the generation step |
RetrieveAndGenerate | Retrieve β InvokeModel β citations in one call | You want an answer with sources, minimum code |
GenerateQuery | Reformulates the user question | You orchestrate the loop yourself |
AgenticRetrieveStream | The FM decomposes into sub-queries, iterates and deduplicates | Multi-hop questions over large corpora |
Under the hood, RetrieveAndGenerate runs GenerateQuery β Retrieve β InvokeModel. With query decomposition enabled, numberOfRerankedResults may reach 5Γ numberOfResults: the only place where a reranked count legitimately exceeds the requested top-k.
8.2 top-k and the token budget
numberOfResults is an integer with minimum 1, maximum 100 and default 5. It directly sizes the $search_results$ placeholder in the generation prompt.
Worked example 7: top-k versus the prompt window. With the default 300-token chunk:
numberOfResults | Approximate tokens in $search_results$ | Verdict |
|---|---|---|
5 (default) | β1,500 | Safe for most models |
10 | β3,000 | AWS's sample for "not enough context" answers |
100 (API maximum) | β30,000 | Almost certainly over the prompt limit |
Raising top-k raises recall and lowers hallucination, but it grows the prompt linearly. When a RetrieveAndGenerate call fails because the augmented prompt exceeds the model's character limit, AWS documents exactly three remediations: lower numberOfResults, re-create the data source with smaller chunks, or shorten the prompt template or the user query. Increasing numberOfResults makes the error worse, which is why it appears as a distractor.
8.3 Prompt template contract
Generation prompts must include $search_results$. Orchestration prompts must include $conversation_history$ and $output_format_instructions$. The AWS sample template wraps context as <context>$search_results$</context> alongside $query$, and dropping $output_format_instructions$ removes citations from the output, which silently breaks the "grounded answers with sources" requirement.
8.4 Search mode
overrideSearchType accepts HYBRID or SEMANTIC, and applies only to OpenSearch Serverless with a filterable text field. Managed knowledge bases are always hybrid; there is no setting to turn that off, so "configure the managed knowledge base for semantic-only search" is a distractor.
π Did you know? Two counters run in the same request and are easy to confuse:
numberOfResults(requested top-k, 1 to 100, default 5) andnumberOfRerankedResults(what reranking actually returns after filtering and deduplication). On managed knowledge bases reranking is on by default, and with query decomposition the reranked count can reach 5Γ the requested top-k. The exam can therefore legitimately show a request for 10 passages with more than 10 reranked candidates; while never showing more than 100 requested results.
9. Evaluating a RAG application
9.1 The job shape
RAG evaluation is a Bedrock evaluation with applicationType: "RagEvaluation", scored by an LLM-as-a-judge. Two job types exist, retrieve only and retrieve and generate, and metrics are scored 0 to 1 and averaged over the prompts. The dataset is JSON Lines with a maximum of 1,000 prompts per job; ground truth lives in referenceContexts (for retrieval) and referenceResponses (for generation).
9.2 The metric families
Stage | Metric | What it measures |
|---|---|---|
Retrieve only | Context Relevance | Precision of the retrieved chunks |
Retrieve only | Context Coverage | Recall against ground-truth referenceContexts |
Retrieve + generate | Correctness / Completeness / Helpfulness / Logical Coherence | Accurate, complete, useful, contradiction-free answers |
Retrieve + generate | Faithfulness | Hallucination resistance against the retrieved chunks |
Retrieve + generate | Citation Precision / Coverage | Citations are accurate / complete |
Retrieve + generate | Harmfulness, Stereotyping, Refusal | Responsible-AI metrics |
9.3 The diagnosis rule
Symptom | Metric to read first | Fix |
|---|---|---|
Answers ignore available documents | Context Coverage | Lower the filter strictness, raise top-k, re-chunk smaller |
Retrieved chunks are irrelevant | Context Relevance | Fix parsing, chunk size or the embedding model |
Answer contradicts the passages | Faithfulness | Change the model or the prompt |
Citations missing or wrong | Citation Precision | Restore $output_format_instructions$ in the template |
Worked example 8: the 67% to 93% fix. AWS published a case in which context relevance sat at 67% because FAQ questions were split from their answers mid-sentence. Re-chunking so each question and answer stayed together: sentence-aligned, with no prompt change at all: moved context relevance to 93% on the same 15 queries and eliminated the hallucinations. The lesson is not the number; it is that the fix landed in ingestion, even though the symptom appeared in generation.
Read the metrics in order. Low context relevance is an indexing problem, parsing, chunk size or embedding model. Low faithfulness is a generation problem, model or prompt. Teams that reach for a bigger model while the retriever is returning the wrong passages burn a full evaluation cycle to confirm what a retrieval metric already said. AWS's guidance is unambiguous: optimize retrieval before generation.
10. Choosing a RAG option on AWS, and the Kendra transition
10.1 AWS's documented order
Prescriptive Guidance lists the RAG options in a deliberate order: (1) Amazon Q Business β (2) Amazon Bedrock Knowledge Bases β (3) Amazon Kendra plus a generator β (4) a custom retriever built on OpenSearch, Aurora pgvector, MemoryDB, Neptune Analytics, Pinecone, MongoDB Atlas or Weaviate.
10.2 Kendra versus Bedrock Knowledge Bases
Dimension | Amazon Kendra | Bedrock (Managed) Knowledge Base |
|---|---|---|
Status | Maintenance since 2026-06-30; no new customers after 2026-07-30 | AWS's stated migration target |
Connectors | Roughly 30+ enterprise connectors | 7: S3, SharePoint, Confluence, Google Drive, OneDrive, Web Crawler, Custom |
Generation | Ranked passages; you bring your own LLM | Native RetrieveAndGenerate plus AgenticRetrieveStream |
Search modes | Keyword / semantic / hybrid | Hybrid only |
Enterprise search | Facets, suggestions, synonyms, spell check, incremental learning | Absent: workarounds required |
Retrieval maximum | 100 passages Γ β€200 tokens | 100 results ( numberOfResults) |
Reuse | A Kendra GenAI index can feed a Bedrock knowledge base | : |
Worked example 9: the migration-shaped question. An enterprise wants "fully managed RAG with native generation, citations and agentic retrieval, as the recommended replacement for our Kendra application". The answer is Amazon Bedrock Managed Knowledge Base: Kendra is in maintenance mode and closed to new customers after 2026-07-30, and AWS names the managed knowledge base as the replacement. OpenSearch alone gives no generation and no citations; Amazon Q Developer is a coding assistant; continued pre-training adds no retrieval at all.
π Did you know? Kendra is not merely deprecated, it is repurposable: a Kendra GenAI index can still be connected as a data source for a Bedrock knowledge base, so an organisation with years of Kendra tuning can keep its index and move only the generation layer. That is the migration path AWS actually documents, and it is why "delete Kendra and re-index everything" is a distractor. Note also that the connector counts come from different places: the 7 managed connectors are confirmed on
docs.aws.amazon.com, while the "30+" Kendra figure circulates via AWS migration material rather than a page reproduced here, treat the exact number as approximate.
10.3 2025 to 2026 Updates
Everything in this subsection was read on docs.aws.amazon.com, an AWS What's New post, an AWS Machine Learning Blog post or the AIF-C01 exam guide itself: nothing comes from a third-party tracker, and dates AWS does not publish are marked as unpublished instead of being filled in. Two groups of change matter for this lesson: what shipped inside Bedrock Knowledge Bases and its vector stores, and what AWS did to Kendra, to Amazon Q Business and to the exam around them.
Where AWS publishes no date, the row says so: there is no published launch date for the Bedrock Managed Knowledge Base and no published closure date for Amazon Q Business, and neither has been invented here.
Knowledge base / vector store change | Date (AWS-published) | What the exam wants you to know |
|---|---|---|
Reranking, custom connectors, direct ingestion, RAG evaluation and inference profiles in RetrieveAndGenerate | Bedrock User Guide feature history, 2025 | Reranking is on by default on managed knowledge bases; evaluation is applicationType: "RagEvaluation" scored by an LLM-as-a-judge; an inference profile lets one RetrieveAndGenerate call pick the Region |
Amazon S3 Vectors becomes a knowledge base store | re:Invent 2025 (30 Nov, 4 Dec 2025) | The eighth and newest StorageConfiguration.type value, cheapest at up to 90% less, 2 billion vectors per index, and the store that rejects startsWith / stringContains |
Bedrock Managed Knowledge Base (BMKB): Smart Parsing plus the Agentic Retrieval API | Documented as the Kendra replacement; AWS has not published a launch date | AWS runs ingestion, indexing, storage, retrieval and reranking; AgenticRetrieveStream is the streaming agentic retrieval API that sits behind the managed tier |
Amazon Kendra enters maintenance, then closes to new customers | Maintenance 30 Jun 2026, closed to new customers 30 Jul 2026 | AWS redirects new search applications to the Bedrock Managed Knowledge Base; existing Kendra customers keep running under AWS's maintenance vocabulary |
Amazon Q Business no longer open to new customers | Availability page reads "no longer open to new customers": AWS publishes no date | Step 1 of AWS's own RAG decision order now carries a caveat; the documented successor is Amazon Quick (bring your own identity), and Guardrails and User Store do not transfer |
Amazon MemoryDB removed from the AIF-C01 in-scope list | Exam guide v1.1, 30 Apr 2026 | Prescriptive Guidance still names MemoryDB in the custom-retriever chain of section 10.1, but the service is no longer in scope for this exam |
Exam-guide change (v1.1, published 30 Apr 2026) | Detail for a RAG candidate |
|---|---|
New objective 5.1.5 | Hallucination detection and grounding: RAG grounding, output validation, confidence scoring: the reason Section 9's metrics are examinable at all |
New objective 2.1.5 | Context engineering: how retrieved context is assembled into the prompt ( $search_results$, template contracts, top-k sizing) |
New objective 2.1.6 | Agentic AI: multi-agent patterns, MCP, memory management, tool usage, orchestration: the shape AgenticRetrieveStream puts on a retrieval call |
Changed example 3.4.2 | LLM-as-a-judge: the scoring mechanism behind Bedrock RAG evaluation |
Added / removed from the in-scope list | Amazon Aurora added (the pgvector RDS store); Amazon MemoryDB removed |
Unchanged | 65 questions (50 scored + 15 unscored), 90 minutes, pass 700/1000, domains weighted 20 / 24 / 28 / 14 / 14 |
AWS states that exam-guide updates reach the live exam about one month after publication, so v1.1's new objectives have been fair game since roughly late May 2026. The practical reading order is unchanged: the features in the first table are what you configure, the objectives in the second table are what AWS now asks about them.
Worked example 11, what the 2026 changes mean for an existing Kendra customer. An enterprise has run a Kendra GenAI index for years, with synonym and ranking tuning it does not want to lose, and now wants generative answers with citations. AWS's documented path is not to re-index everything: a Kendra GenAI index can still be connected as a data source for a Bedrock knowledge base, so the tuning survives and only the generation layer moves, while the Kendra index itself keeps serving its existing users under maintenance (mode entered 30 Jun 2026, closed to new customers after 30 Jul 2026). For a new application the answer is the Bedrock Managed Knowledge Base, and the third option in AWS's decision order, Amazon Q Business, now has to be checked against its own "no longer open to new customers" status before anyone offers it as the step-one answer.
2025 to 2026 change | Which section of this lesson it updates |
|---|---|
Reranking on by default, custom connectors, direct ingestion | Sections 2 and 3 |
RAG evaluation scored by an LLM-as-a-judge | Section 9 |
Inference profiles usable inside RetrieveAndGenerate | Section 8 |
Amazon S3 Vectors as the eighth store type | Section 6 |
Bedrock Managed Knowledge Base + Agentic Retrieval API | Sections 3 and 10 |
Kendra maintenance and closure dates | Section 10 |
Exam guide v1.1 objectives 5.1.5, 2.1.5, 2.1.6, 3.4.2 | Sections 9, 8 and 1 |
π Did you know? The Kendra availability page never uses the word "deprecated"; it redirects new search applications to the Amazon Bedrock Managed Knowledge Base, whose Smart Parsing and Agentic Retrieval API AWS documents as the replacement, while Kendra itself keeps serving existing customers under AWS's own maintenance definition (no new customers, no new features, still supported). That is why "Kendra was shut down" and "existing Kendra customers must migrate immediately" are both distractors, and why the correct answer pairs continuity for existing customers with a documented replacement for new ones.
11. Comparative verdict: RAG vs fine-tuning vs prompt-only, and Bedrock KB vs Kendra
11.1 RAG vs fine-tuning
Dimension | RAG | Fine-tuning |
|---|---|---|
What changes | Nothing in the model; knowledge injected at query time | Model weights |
Freshness | Latest docs in minutes | Hours to days per run |
Source citations | Yes | No |
Hallucination | Reduced: grounded in retrieved context | Increased for Q&A workloads |
Skills and data | No data scientist; raw documents | May need a data scientist (LoRA/PEFT); labeled pairs |
Availability | Any Bedrock model | Not available for all models |
Weakness | Poor at summarizing whole documents | Stale fast, costly, ungrounded |
AWS says best for | Document Q&A: start here | Style, tone, format; summarization and other tasks |
Combination | : | Hybrid (RAFT): fine-tune the generator and keep RAG |
Worked example 10, what hybrid actually bought. In AWS's published Amazon Nova case study, RAG alone and fine-tuning alone each improved LLM-judge quality by about +30%; combining them reached +83%. Latency behaved differently per lever: fine-tuning cut latency by roughly 50% while RAG cut it by about 30%. Token spend moved in opposite directions, fine-tuning reduced total tokens by more than 60%, while RAG more than doubled them because context is passed on every call. Same problem, four different levers, four different bills.
11.2 Bedrock Knowledge Bases vs Kendra
Pick Bedrock Knowledge Bases when the ask is fully managed RAG, internal documents, citations, minimal operations, and pick Kendra-style enterprise search only when the ask is facets, synonyms, spell check, ranked passages without a generator. In 2026 the second answer is a legacy one: Kendra is in maintenance mode and closed to new customers.
Comparative Verdict: RAG vs fine-tuning vs prompt-only, and Bedrock Knowledge Bases vs Amazon Kendra
- RAG is the default answer for document question answering: the data changes often, the business needs source citations, hallucination must go down, and no data scientist is available. AWS says to start here. Refreshes land in minutes; the weakness is summarizing whole documents, because retrieval returns chunks.
- Fine-tuning is the answer when the requirement is style, tone, format or a narrow repeating task: not for fresh knowledge. It changes weights, takes hours to days, needs labeled data, produces no citations and is not available for every model. Choosing it for "our policy PDFs change weekly" is wrong on all four counts.
- Prompt-only (in-context learning) is the answer when everything the model needs fits in the prompt and does not change. It is the cheapest and fastest path and requires no extra service, and it fails the moment the corpus outgrows the context window or must be kept current.
- Hybrid (RAFT) is the AWS-sanctioned combination: keep the RAG architecture and fine-tune the generator. AWS cites UC Berkeley's RAFT work for this, and its own Nova case study measured +30% from each lever and +83% combined.
- Bedrock Knowledge Bases is the answer for fully managed RAG over internal documents with citations and minimal ops: 7 managed connectors, always hybrid search, reranking on by default, native
RetrieveAndGenerateandAgenticRetrieveStream. - Amazon Kendra is the answer only for enterprise search features, facets, synonyms, spell check, ranked passages, and even then it is in maintenance mode since 2026-06-30 and closed to new customers after 2026-07-30, with AWS naming the Bedrock managed knowledge base as the replacement.
- Exam heuristic: "fully managed RAG, internal docs, citations, minimal ops" β Bedrock Knowledge Bases. "Style, tone, format" β fine-tuning. "Facets and synonyms, no generator" β Kendra.
Question in the stem | Correct answer |
|---|---|
Weekly-changing docs + citations + least effort | RAG / Bedrock Knowledge Bases |
Change the assistant's tone and format | Fine-tuning |
Everything fits in one prompt, static | Prompt-only |
Grounding and behavior change | Hybrid (RAFT) |
Fully managed RAG recommended as the Kendra replacement | Bedrock Managed Knowledge Base |
Facets, synonyms, spell check, ranked passages | Kendra (legacy) |
12. Exam traps, limits and what not to memorise
The traps that cost marks on this exact material:
- Default chunking is fixed-size at 300 tokens with 20% overlap: never semantic, never hierarchical, and
NONEonly if you ask for it explicitly. numberOfResults: default 5, min 1, max 100. "10" appears in AWS blog samples and is not the default; "100" is the maximum, not the default.- Semantic chunking is unsupported on managed knowledge bases; managed knowledge bases are always hybrid, and reranking is on by default.
startsWithandstringContainsare unsupported on managed knowledge bases and on S3 Vector indexes.- The store enum has exactly eight values:
OPENSEARCH_SERVERLESS,OPENSEARCH_MANAGED_CLUSTER,RDS,NEPTUNE_ANALYTICS,REDIS_ENTERPRISE_CLOUD,PINECONE,MONGO_DB_ATLAS,S3_VECTORS. EMR Serverless and Kendra are not among them. - Titan Text G1 is 1536 dimensions; Titan Text V2 is 1024 (also 512 and 256); Cohere v3 is 1024 with a 512-token input cap.
- Fixing "prompt exceeds the character limit" means lowering top-k, re-chunking smaller, or shortening the template/query: never raising
numberOfResults. - Low context relevance β indexing. Low faithfulness β generation. Optimize retrieval first.
- Generation prompts must contain
$search_results$; orchestration prompts must contain$conversation_history$and$output_format_instructions$: dropping the last one removes citations. - Kendra is in maintenance mode (2026-06-30) and closed to new customers after 2026-07-30. Answering "Amazon Kendra" for a new build is wrong.
Items AWS does not confirm first-party: do not turn them into recall material:
- Kendra connector counts ("30+" or "32+"): the 7 managed Bedrock connectors are confirmed on
docs.aws.amazon.com; the Kendra figure comes from AWS migration text relayed through third parties. - Kendra and managed-knowledge-base pricing: third-party trackers report figures such as ~$230/month for a Kendra GenAI tier or ~$5.00/GB/month for managed knowledge bases; these were not read on AWS pricing pages.
- S3 Vectors per-field limits: the documented cap is the 10 KB metadata file; any per-field count limit is unconfirmed.
- Latency figures ("RAG adds 200 to 500 ms"): third-party blog examples, not AWS SLAs.
- Titan V2 pricing confusion: one builder-centre page quotes "$0.02 per 1,000 tokens" while the AWS ML Blog says $0.02 per 1 million tokens; use the AWS blog figure.
- Exam composition claims ("3 to 6 RAG questions per sitting"): from exam-prep sites, not AWS.
Amazon EMR Serverlessas a vector store: appears in one Prescriptive Guidance guide but not in theStorageConfigurationenum; never answer with it.
Real-World Case Studies
The tables above tell you what the APIs accept; AWS's published customer stories tell you which lever actually moved a metric. Every figure below is quoted from the AWS case study or AWS Machine Learning Blog post named in its Source line. All of them are customer- or AWS-claimed and unaudited, and where a source says "up to", read it as a ceiling rather than a plan.
Each entry names the mechanism, the services AWS itself lists, the numbers AWS published and where to read them. The five were chosen because together they cover every half of this lesson:
- Nippon India: retrieval engineering plus Guardrails against hallucination (Section 9);
- Adobe: chunking and embedding choice as the accuracy lever (Sections 4 and 5);
- Alnylam: RAG with citations inside a regulated workflow (Sections 1 and 11);
- Bynder: multimodal embeddings behind the same embed β search β augment shape (Section 5);
- Sun Finance: vector-store selection and the stage boundaries around it (Section 6).
Case 1, Nippon India: retrieval engineering, not a bigger model
Nippon India Mutual Fund's internal assistant was built on naive RAG, and it degraded as document volume grew, producing exactly the hallucinations Section 9 teaches you to measure. The fix set was entirely on the retrieval side: FM-as-parser, query reformulation, multi-query RAG, reranker models, GraphRAG and metadata filtering on Amazon Bedrock Knowledge Bases, plus Amazon Bedrock Guardrails and citations. Reported outcomes: accuracy +>95%, hallucination β90 to 95%, and report generation falling from 2 days to about 10 minutes. Exam angle: not one lever in that list touches the generator, and AWS published the post to note that these are generally available product features, not code the customer wrote, a hallucination complaint was answered by fixing retrieval first. Source: AWS Machine Learning Blog, 29 Jul 2025, aws.amazon.com/blogs/machine-learning/how-nippon-india-mutual-fund-improved-the-accuracy-of-ai-assistant-responses-using-advanced-rag-methods-on-amazon-bedrock.
Case 2, Adobe: four chunking configurations, and the simplest one won
Adobe's developer-documentation search was losing accuracy for thousands of developers. The team benchmarked four chunking configurations on Amazon Bedrock Knowledge Bases: 400 tokens with 20% overlap, 1,000 tokens, hierarchical and semantic: embedded with Amazon Titan Text Embeddings V2, stored in Amazon OpenSearch Service and read back through the Retrieve API. Reported outcome: +20% retrieval accuracy against Adobe's own test set, with the 400-token / 20%-overlap configuration both the simplest and the most accurate. Exam angle, in two parts: chunking choice moved the metric while the model stayed the same, and 400 tokens is a customer benchmark, not a change of AWS's documented 300-token default: a published sample never overrides a published default. Source: AWS Machine Learning Blog, 11 Jun 2025, aws.amazon.com/blogs/machine-learning/adobe-enhances-developer-productivity-using-amazon-bedrock-knowledge-bases.
Case 3, Alnylam: citations as the compliance feature
Alnylam Pharmaceuticals' complaint triage took 3 to 4 days, and finding one internal answer took 15+ minutes. Using Amazon Bedrock, Amazon S3 and a RAG-style assistant, the team delivered an intake-and-triage prototype in 3 months under GxP constraints, plus AskALNY, a Slack assistant serving 2,000 employees and 1,000 contractors that returns answers with source links. Reported outcomes: triage 3 to 4 days β hours, information search 15 minutes β 30 seconds, with 250+ use cases following the first two. Exam angle: in a regulated workflow the citation is the audit trail, which is precisely why Section 11 files source references under the RAG column and "no citations" under fine-tuning. Source: aws.amazon.com/solutions/case-studies/alnylam-case-study.
Case 4, Bynder: the embedding model carries the modality
Bynder runs 175 million assets across 18 petabytes for 4,000 companies, and keyword search cannot express "find me something like this image". Images and queries are vectorized with Amazon Titan Multimodal Embeddings in Amazon Bedrock for visual and contextual similarity search. Reported outcome: search time β75%, with roughly +50% more usable results per search. Exam angle: the retrieval pattern is the same pipeline as text RAG, embed, search, augment, but the embedding model is the component that decides which modality can be searched at all, which is the row of Section 5's table an exam stem is really asking about. Source: aws.amazon.com/solutions/case-studies/bynder-bedrock-case-study.
Case 5, Sun Finance: the store choice, and why the first prototype failed
Sun Finance (fintech lending across 9 countries) had 60% of microloan applications needing manual review, each taking 10 minutes to 20 hours. Its first attempt: sending ID photos straight to Claude Sonnet 4 for JSON extraction: scored 61.8% overall and only 43% on ID numbers and was rejected. The published pipeline separates the stages: Amazon Textract for OCR, Amazon Rekognition as fallback and face check, the foundation model only for structuring, validation rules, and Titan Multimodal Embeddings written into Amazon S3 Vectors for fraud-similarity lookup, evaluated on 585 images. Reported outcome: accuracy 79.73% β 90.80%, cost per document β91%, processing 20 hours β under 5 seconds. Exam angle for this lesson: S3 Vectors appears in the StorageConfiguration.type enum as the cheapest store, and this case shows it doing real similarity work; while the rejected first attempt shows that a retrieval or extraction pipeline is only as good as the stage boundaries drawn inside it. Source: AWS Machine Learning Blog, 30 Apr 2026, aws.amazon.com/blogs/machine-learning/sun-finance-automates-id-extraction-and-fraud-detection-with-generative-ai-on-aws.
Case | Where it lands in this lesson | AWS services named by AWS | Headline numbers | Source |
|---|---|---|---|---|
Nippon India (financial services, 2025) | Section 9: optimize retrieval before generation | Bedrock Knowledge Bases, Bedrock Guardrails, reranker models, GraphRAG | Accuracy +>95%, hallucination β90 to 95%, reports 2 days β ~10 minutes | AWS ML Blog, 29 Jul 2025 |
Adobe (software, 2025) | Section 4: chunking decides RAG quality | Bedrock Knowledge Bases, OpenSearch Service, Titan Text Embeddings V2, Retrieve | +20% retrieval accuracy; 400 tokens / 20% overlap won the bake-off | AWS ML Blog, 11 Jun 2025 |
Alnylam (biotech, 2025) | Section 11: citations are the RAG advantage | Bedrock, Amazon S3, RAG assistant | Triage 3 to 4 days β hours, search 15 min β 30 s, 3,000 users | AWS case study |
Bynder (digital assets, 2025) | Section 5: embeddings carry the modality | Bedrock, Titan Multimodal Embeddings | Search time β75%, results ~+50%, 175M assets / 18 PB | AWS case study |
Sun Finance (fintech, 2026) | Section 6: the cheapest vector store in production | Bedrock (Claude Sonnet 4), Textract, Rekognition, Titan Multimodal Embeddings, S3 Vectors | Accuracy 79.73% β 90.80%, cost β91%, 20 h β <5 s, n = 585 | AWS ML Blog, 30 Apr 2026 |
Three patterns repeat across these five stories, and each one is a section of this lesson in disguise:
- Retrieval moved the metric, not the generator: Nippon India and Adobe both improved answers by re-engineering chunks, reranking and filters while the model stayed put (Sections 4 and 9).
- The citation is the deliverable: Alnylam's source links and Nippon's citations are what made regulated answers auditable, which is the entire RAG column of Section 11.
- The store and the embedding model are picked by constraint: modality for Bynder, cost and similarity workload for Sun Finance, hybrid search and metadata filters for the rest (Sections 5, 6 and 7).
How to read customer numbers on this exam.
- They are claimed, not audited. Every percentage above is customer- or AWS-claimed; only a couple of AWS-published AI case studies disclose a sample basis at all (Sun Finance's OCR pipeline at n = 585 images, Adobe on its own test set).
- "Up to" is a ceiling. An option that restates a ceiling as a guaranteed outcome is wrong even when the underlying number is real.
- A benchmark does not change a default. Adobe's 400-token winner does not move AWS's documented 300-token, 20%-overlap default, exactly as an AWS sample using
numberOfResults: 10does not move the default of 5. - The only published project-outcome rate is 65%: the share of AWS Generative AI Innovation Center projects that reached production in 2025, from more than 1,000 implementations. Any option claiming AWS reports that all of its generative AI projects reach production is inventing a figure.
π Did you know? Nippon India's fix list, FM-as-parser, query reformulation, multi-query RAG, reranker models, GraphRAG and metadata filtering, reads like a roadmap of capabilities AWS ships inside Bedrock Knowledge Bases rather than code the customer had to write, and AWS published the case largely to make that point. Two surprises in it: the team added Bedrock Guardrails alongside the retrieval changes rather than instead of them, and the reported 2 days β ~10 minutes gain came from better retrieval while the generator stayed where it was.
Practice Questions
How to answer
Multiple-choice question with 5 options. Select one option, then choose Check Answer.
Policy documents in Amazon S3 change weekly. The assistant must reflect the latest documents, include source citations, and use the LEAST development effort. Which approach should the team choose?
How to answer
Multiple-choice question with 5 options. Select one option, then choose Check Answer.
A data source is created in Amazon Bedrock Knowledge Bases with no chunking configuration specified. What does the service use?
How to answer
Multiple-choice question with 5 options. Select one option, then choose Check Answer.
A team must split long, nested technical manuals so that retrieval returns comprehensive section-level context rather than fragments. Which chunking strategy BEST fits?
How to answer
Multiple-choice question with 5 options. Select one option, then choose Check Answer.
Which statement about semantic chunking in Amazon Bedrock Knowledge Bases is TRUE?
How to answer
Multiple-choice question with 5 options. Select one option, then choose Check Answer.
A Retrieve request omits numberOfResults. How many source chunks are requested by default?
How to answer
Multiple-choice question with 5 options. Select one option, then choose Check Answer.
A team uses Amazon Titan Text Embeddings V2 and wants roughly 75% less vector storage while keeping about 97% retrieval accuracy. Which output dimension should it configure?
How to answer
Multiple-choice question with 5 options. Select one option, then choose Check Answer.
RAG answers are fluent but sometimes contradict the retrieved passages. Which Amazon Bedrock RAG evaluation metric should the team examine FIRST?
How to answer
Multiple-choice question with 5 options. Select one option, then choose Check Answer.
An enterprise wants fully managed RAG with native generation, citations and agentic retrieval as the recommended replacement for its Kendra application. Which service should it choose?
How to answer
Multiple-choice question with 5 options. Select one option, then choose Check Answer.
A RetrieveAndGenerate call fails because the augmented prompt exceeds the model's character limit. Which action is NOT a documented remediation?
How to answer
Multiple-choice question with 5 options. Select one option, then choose Check Answer.
A managed knowledge base must filter results by an author metadata field. Which retrieval filter operator is supported?
How to answer
Multiple-choice question with 5 options. Select one option, then choose Check Answer.
A financial-services assistant built on naive RAG began hallucinating as the document corpus grew. AWS published a customer case in which which set of changes cut hallucination by 90-95% while raising accuracy by more than 95%?
How to answer
Multiple-choice question with 5 options. Select one option, then choose Check Answer.
A developer-portal team benchmarks chunking on Amazon Bedrock Knowledge Bases with Titan Text Embeddings V2 and finds the simplest configuration is also the most accurate, improving retrieval accuracy by 20% on its own test set. Which configuration won, and what does it mean for the documented default?
How to answer
Matching exercise with 5 pairs. Match each item on the left with its answer on the right.
Match each RAG symptom to the first place AWS says to fix it:
Drag answers from here:
Last-minute checks for this lesson:
- Default chunking = fixed-size, 300 tokens, 20% overlap: sentence-aligned; semantic is never default and is unavailable on managed knowledge bases.
numberOfResults= 5 (min 1, max 100); managed knowledge bases are always hybrid with reranking on by default.- Eight store types only: OpenSearch Serverless (hybrid + required for Confluence/SharePoint/Salesforce), Aurora pgvector (SQL + vector), Neptune Analytics (GraphRAG), Redis (latency), S3 Vectors (cheapest, no substring filters).
startsWithandstringContainsfail on managed knowledge bases and S3 Vector indexes.- Titan V2 = 1024 / 512 / 256 dimensions (99% and 97% accuracy trade-offs), Titan G1 = 1536, Cohere v3 = 1024 with a 512-token input cap.
- Diagnose in order: context relevance β indexing; faithfulness β generation.
- Kendra: maintenance since 2026-06-30, no new customers after 2026-07-30; Bedrock Knowledge Bases is the stated replacement.
Key Takeaways:
- RAG searches your data at query time and augments the prompt; it changes neither weights nor training data, so it refreshes in minutes, returns citations, needs no data scientist, and is weak at summarizing whole documents. Start here for document Q&A.
- Two pipelines, two failure domains. Ingestion is fetch β parse β chunk β embed β vector store; runtime is embed query β similarity search β augment β generate. Optimize retrieval before generation: low context relevance is an indexing bug, low faithfulness is a generation bug.
- Chunking default is fixed-size at 300 tokens with 20% overlap; the only valid strategies are
FIXED_SIZE,NONE,HIERARCHICALandSEMANTIC. Hierarchical uses parent 1,500 / child 300 / overlap β60 and returns parents (so counts can fall belownumberOfResults); semantic uses 300 / buffer 1 / threshold 95 and is not available on managed knowledge bases. numberOfResultsdefaults to 5, ranges 1 to 100, and directly sizes$search_results$: 5 β 1,500 tokens, 100 β 30,000. Fix an oversized prompt by lowering top-k, re-chunking smaller or shortening the template, never by raising it.- Embeddings: Titan Text V2 = 1024 (512 / 256) dimensions at $0.02 per 1M tokens, Titan G1 = 1536, Cohere Embed v3 = 1024 with a 512-token input cap; 256 dims keeps 97% accuracy for 75% less storage.
- Eight vector stores, four console quick-creates (OpenSearch Serverless, Aurora Serverless, Neptune Analytics, S3 Vectors); EMR Serverless and Kendra are not store types, and S3 Vectors is cheapest but lacks
startsWith/stringContains. - Managed knowledge bases are always hybrid with reranking on by default, expose 7 connectors, and reject
startsWith/stringContains; generation prompts must keep$search_results$and orchestration prompts must keep$output_format_instructions$or citations disappear. - Comparative verdict: fresh docs + citations + least effort β RAG; style, tone, format β fine-tuning; fits in the prompt β prompt-only; both β hybrid (RAFT) (Nova case: +30% each, +83% combined). For managed RAG replacing Kendra β Bedrock Managed Knowledge Base (Kendra in maintenance since 2026-06-30, no new customers after 2026-07-30).