Amazon Bedrock and Nova Explained: Amazon's Generative AI Stack for Beginners and Developers

The short answer
Amazon Bedrock is AWS's managed service for using generative AI models through one API, without running your own GPUs. It hosts models from many providers, including Anthropic, Meta, Mistral and Amazon's own Nova family. Nova is Amazon's in-house set of foundation models; at re:Invent in December 2025 AWS launched Nova 2, with Nova 2 Lite generally available in Bedrock and Nova 2 Pro in preview.
What is Amazon Bedrock, in plain English?
Think of Bedrock as an "AI model marketplace plus toolkit" inside your AWS account:
- Pick a model from a catalogue (text, image, speech, embeddings).
- Send it a prompt through an API and pay per use, typically per input and output token.
- Add your own data safely, with tools for search over your documents, safety filters and agents.
- Keep data in AWS: AWS states that prompts and responses are not used to train the underlying models and are not shared with model providers.
For a business, this means you can add a chatbot, document summariser or AI agent to an app without managing infrastructure, and switch models later with little code change.
What is Amazon Nova?
Amazon Nova is Amazon's family of foundation models, first launched in December 2024 and refreshed as Nova 2 in December 2025. According to AWS's announcement and coverage of re:Invent 2025:
| Model | What it's for | Status (as announced Dec 2025) |
|---|---|---|
| Nova 2 Lite | Fast, cost-effective reasoning for everyday tasks | Available in Bedrock |
| Nova 2 Pro | AWS's most capable Nova model for complex, multistep tasks | Preview |
| Nova 2 Sonic | Real-time speech-to-speech voice conversations | Announced |
| Nova 2 Omni | Multimodal reasoning that can generate text and images | Preview |
Reported Nova 2 capabilities include adjustable reasoning levels, built-in code interpreter and web grounding, support for remote MCP (Model Context Protocol) tools, and a one-million-token context window. AWS also introduced Nova Forge, a programme for organisations to build their own customised Nova variants; it is aimed at large enterprises, not hobbyists.
The first-generation Nova models (Micro, Lite, Pro, Premier, plus Canvas for images and Reel for video) remain in the Bedrock catalogue in many regions.
What are the main parts of the Bedrock stack?
| Component | What it does | Who it's for |
|---|---|---|
| Model catalogue | Access to Nova, Claude, Llama, Mistral and other models | Everyone |
| Playgrounds | Try models in the AWS console without code | Beginners, product teams |
| Converse API | One consistent API for chat across models, including tool use | Developers |
| Knowledge Bases | Retrieval-augmented generation (RAG) over your documents | Developers building Q&A over company data |
| Guardrails | Filters for harmful content, denied topics, PII redaction | Anyone shipping to users |
| Agents and AgentCore | Build and run AI agents that call tools and APIs | Developers building automation |
| Model customisation | Fine-tune or distil certain models on your data | Advanced teams |
| Batch inference | Lower-cost bulk processing of prompts | High-volume workloads |
AgentCore is AWS's platform for deploying and operating AI agents at scale (runtime, memory, identity, gateways to tools, observability). AWS has highlighted it heavily since 2025, but features change quickly, so check the AgentCore documentation for what is generally available in your region.
How do I start using Bedrock? (beginner steps)
- Sign in to the AWS console and open Amazon Bedrock. Pick a region where the model you want is offered (US East (N. Virginia) and US West (Oregon) usually get models first; Asia Pacific (Mumbai) also offers Bedrock).
- Check model access. AWS has simplified access so many serverless models are available by default, but some third-party models still require you to accept the provider's terms first.
- Open the Chat / Text playground, choose a model such as Nova Lite, and type a prompt.
- Set a budget in AWS Budgets before experimenting heavily.
- Move to code with the AWS CLI or an SDK (Python boto3, JavaScript, Java and others) once you know which model fits.
Editor's tip: Start with the smallest, cheapest model that does the job. For classification, extraction or short summaries, a "Lite" or "Micro" class model is often enough, and costs a fraction of a frontier model.
For the technically curious: calling Nova through the Converse API
The Converse API gives the same request shape across models, so swapping models usually means changing only the model ID. First list the Amazon models available to you, then call one:
# List Amazon-provided models in your region
aws bedrock list-foundation-models --by-provider amazon \
--query "modelSummaries[].modelId" --region us-east-1
# Send a prompt (replace MODEL_ID with an ID or inference profile from your console)
aws bedrock-runtime converse \
--model-id MODEL_ID \
--messages '[{"role":"user","content":[{"text":"Explain Amazon Bedrock in two sentences."}]}]' \
--inference-config '{"maxTokens":300,"temperature":0.3}' \
--region us-east-1
The same in Python with boto3:
import boto3
client = boto3.client("bedrock-runtime", region_name="us-east-1")
response = client.converse(
modelId="MODEL_ID", # e.g. a Nova Lite inference profile from your console
messages=[{"role": "user", "content": [{"text": "Write a 3-line product description for a steel water bottle."}]}],
inferenceConfig={"maxTokens": 300, "temperature": 0.5},
)
print(response["output"]["message"]["content"][0]["text"])
print(response["usage"]) # inputTokens / outputTokens, useful for cost tracking
Things developers commonly trip over:
- Inference profiles: many newer models must be called through a cross-region inference profile ID (often prefixed with a geography such as
us.orglobal.) rather than the bare model ID. The console's model catalogue shows the right identifier. - IAM permissions: your role needs
bedrock:InvokeModel(and related actions for streaming or Converse) on the model or profile ARN. - Streaming: use
converse-stream/converse_streamfor chat UIs so users see tokens as they arrive. - Tool use: the Converse API supports passing tool definitions; the model returns a tool call, your code executes it, and you send the result back.
How RAG works with Knowledge Bases
- You point a Knowledge Base at a data source such as an S3 bucket of PDFs.
- Bedrock splits documents into chunks, converts them to embeddings with an embedding model, and stores them in a vector store.
- At query time, the user's question is embedded, the closest chunks are retrieved, and they are passed to the model with the question.
- The answer comes back with citations to the source chunks.
This is usually the fastest route to a "chat with our documents" assistant, and keeps answers grounded in your own data.
How much does Bedrock cost?
Bedrock pricing varies by model and region, so there is no single number. The main pricing modes are:
| Mode | How you pay | Good for |
|---|---|---|
| On-demand | Per 1,000 (or 1 million) input and output tokens; per image for image models | Most apps, prototypes |
| Batch | Discounted per-token pricing for asynchronous jobs | Large offline workloads |
| Provisioned Throughput | Hourly commitment for guaranteed capacity | Steady, high-volume production |
| Extras | Knowledge Base storage, Guardrails, agent runtime charges | Depends on features used |
Amazon positions Nova models as low-cost options compared with many third-party frontier models. Check the Bedrock pricing page for the exact per-token rates in your region before you build cost estimates. New AWS accounts can use Free Tier credits for Bedrock.
Bedrock vs calling an AI provider directly
| Amazon Bedrock | Direct provider API | |
|---|---|---|
| Model choice | Many providers through one API | One provider |
| Billing | On your AWS bill | Separate account and bill |
| Data and network | Stays in your AWS environment; private connectivity options | Provider's terms and network |
| Enterprise controls | IAM, CloudTrail, VPC endpoints, Guardrails | Varies |
| Newest features | May arrive later than on the provider's own API | Usually first |
For teams already on AWS, Bedrock is usually the easier path for security reviews and procurement. For hobby projects that need one specific model's newest feature on day one, the provider's own API may be quicker.
What can you build with Bedrock and Nova?
Some practical, common use cases, with the Bedrock features they rely on:
| Use case | Typical building blocks |
|---|---|
| Customer support assistant | Knowledge Bases over help articles, Guardrails, a Lite-class model |
| Document summaries for legal or finance teams | Long-context model, batch inference for volume |
| Product description generator for e-commerce | Small text model, prompt templates, human review |
| Voice assistant for a call centre | Nova Sonic speech-to-speech model |
| Internal agent that files tickets or queries databases | Converse API tool use, AgentCore, IAM-scoped tools |
| Image generation for marketing drafts | Nova Canvas or another image model, content filters |
Responsible AI basics before you ship
- Use Guardrails to block harmful content and redact personal data such as phone numbers or Aadhaar-like identifiers in prompts and outputs.
- Ground answers in your own documents with Knowledge Bases and show citations, to reduce made-up answers.
- Keep a human in the loop for anything customer-facing that carries legal, medical or financial weight.
- Log and monitor with CloudTrail and CloudWatch so you can audit who called which model and when.
- Evaluate before switching models: Bedrock offers model evaluation tools to compare outputs on your own test set.
FAQ
Is Amazon Nova free to use?
No, Nova models are billed per use in Bedrock. New AWS accounts can apply Free Tier credits to Bedrock usage, and trying Bedrock is one of the onboarding activities that earns extra credit.
What is the difference between Bedrock and Nova?
Bedrock is the platform (API, tools, security). Nova is a family of models made by Amazon that you can run on Bedrock alongside models from other companies.
Which Nova 2 models are available?
AWS announced Nova 2 Lite as available in Bedrock and Nova 2 Pro in preview in December 2025, along with Nova 2 Sonic for voice and Nova 2 Omni for multimodal tasks. Check the Bedrock console for current availability in your region.
Is Amazon Bedrock available in India?
Bedrock is offered in the Asia Pacific (Mumbai) region, but individual models vary by region. Some models are available to Indian users through cross-region inference.
Does AWS train models on my Bedrock data?
AWS states that Bedrock does not use your prompts and outputs to train the base models and does not share them with third-party model providers.
What is Bedrock AgentCore?
AgentCore is AWS's set of services for deploying and running AI agents securely at scale, covering runtime, memory, identity, tool gateways and observability.
Do I need machine learning experience to use Bedrock?
No. You can use the playground with no code, and the API calls look like any other web API. ML experience helps for fine-tuning and evaluation.
Sources
- https://aws.amazon.com/about-aws/whats-new/2025/12/nova-2-foundation-models-amazon-bedrock
- https://aws.amazon.com/bedrock/
- https://aws.amazon.com/bedrock/pricing/
- https://aws.amazon.com/ai/generative-ai/nova/
- https://charonhub.deeplearning.ai/nova-2-family-boosts-cost-effective-performance-adds-new-agentic-features/
- https://itdaily.com/news/cloud/aws-announces-new-ai-innovations/
- https://caylent.com/blog/aws-reinvent-2025-every-ai-announcement-including-amazon-nova-2-and-kiro
Featured image: Amazon. Source