Amazon Bedrock and Nova Explained: Amazon's Generative AI Stack for Beginners and Developers

Lov Singh18 October 20269 min read0 viewsAlexa & AI
Amazon Bedrock and Nova Explained: Amazon's Generative AI Stack for Beginners and Developers

The short answer

Amazon Bedrock is AWS's managed service for using generative AI models through one API, without running your own GPUs. It hosts models from many providers, including Anthropic, Meta, Mistral and Amazon's own Nova family. Nova is Amazon's in-house set of foundation models; at re:Invent in December 2025 AWS launched Nova 2, with Nova 2 Lite generally available in Bedrock and Nova 2 Pro in preview.

What is Amazon Bedrock, in plain English?

Think of Bedrock as an "AI model marketplace plus toolkit" inside your AWS account:

  • Pick a model from a catalogue (text, image, speech, embeddings).
  • Send it a prompt through an API and pay per use, typically per input and output token.
  • Add your own data safely, with tools for search over your documents, safety filters and agents.
  • Keep data in AWS: AWS states that prompts and responses are not used to train the underlying models and are not shared with model providers.

For a business, this means you can add a chatbot, document summariser or AI agent to an app without managing infrastructure, and switch models later with little code change.

What is Amazon Nova?

Amazon Nova is Amazon's family of foundation models, first launched in December 2024 and refreshed as Nova 2 in December 2025. According to AWS's announcement and coverage of re:Invent 2025:

Model What it's for Status (as announced Dec 2025)
Nova 2 Lite Fast, cost-effective reasoning for everyday tasks Available in Bedrock
Nova 2 Pro AWS's most capable Nova model for complex, multistep tasks Preview
Nova 2 Sonic Real-time speech-to-speech voice conversations Announced
Nova 2 Omni Multimodal reasoning that can generate text and images Preview

Reported Nova 2 capabilities include adjustable reasoning levels, built-in code interpreter and web grounding, support for remote MCP (Model Context Protocol) tools, and a one-million-token context window. AWS also introduced Nova Forge, a programme for organisations to build their own customised Nova variants; it is aimed at large enterprises, not hobbyists.

The first-generation Nova models (Micro, Lite, Pro, Premier, plus Canvas for images and Reel for video) remain in the Bedrock catalogue in many regions.

What are the main parts of the Bedrock stack?

Component What it does Who it's for
Model catalogue Access to Nova, Claude, Llama, Mistral and other models Everyone
Playgrounds Try models in the AWS console without code Beginners, product teams
Converse API One consistent API for chat across models, including tool use Developers
Knowledge Bases Retrieval-augmented generation (RAG) over your documents Developers building Q&A over company data
Guardrails Filters for harmful content, denied topics, PII redaction Anyone shipping to users
Agents and AgentCore Build and run AI agents that call tools and APIs Developers building automation
Model customisation Fine-tune or distil certain models on your data Advanced teams
Batch inference Lower-cost bulk processing of prompts High-volume workloads

AgentCore is AWS's platform for deploying and operating AI agents at scale (runtime, memory, identity, gateways to tools, observability). AWS has highlighted it heavily since 2025, but features change quickly, so check the AgentCore documentation for what is generally available in your region.

How do I start using Bedrock? (beginner steps)

  1. Sign in to the AWS console and open Amazon Bedrock. Pick a region where the model you want is offered (US East (N. Virginia) and US West (Oregon) usually get models first; Asia Pacific (Mumbai) also offers Bedrock).
  2. Check model access. AWS has simplified access so many serverless models are available by default, but some third-party models still require you to accept the provider's terms first.
  3. Open the Chat / Text playground, choose a model such as Nova Lite, and type a prompt.
  4. Set a budget in AWS Budgets before experimenting heavily.
  5. Move to code with the AWS CLI or an SDK (Python boto3, JavaScript, Java and others) once you know which model fits.

Editor's tip: Start with the smallest, cheapest model that does the job. For classification, extraction or short summaries, a "Lite" or "Micro" class model is often enough, and costs a fraction of a frontier model.

For the technically curious: calling Nova through the Converse API

The Converse API gives the same request shape across models, so swapping models usually means changing only the model ID. First list the Amazon models available to you, then call one:

# List Amazon-provided models in your region
aws bedrock list-foundation-models --by-provider amazon \
  --query "modelSummaries[].modelId" --region us-east-1

# Send a prompt (replace MODEL_ID with an ID or inference profile from your console)
aws bedrock-runtime converse \
  --model-id MODEL_ID \
  --messages '[{"role":"user","content":[{"text":"Explain Amazon Bedrock in two sentences."}]}]' \
  --inference-config '{"maxTokens":300,"temperature":0.3}' \
  --region us-east-1

The same in Python with boto3:

import boto3

client = boto3.client("bedrock-runtime", region_name="us-east-1")

response = client.converse(
    modelId="MODEL_ID",  # e.g. a Nova Lite inference profile from your console
    messages=[{"role": "user", "content": [{"text": "Write a 3-line product description for a steel water bottle."}]}],
    inferenceConfig={"maxTokens": 300, "temperature": 0.5},
)

print(response["output"]["message"]["content"][0]["text"])
print(response["usage"])  # inputTokens / outputTokens, useful for cost tracking

Things developers commonly trip over:

  • Inference profiles: many newer models must be called through a cross-region inference profile ID (often prefixed with a geography such as us. or global.) rather than the bare model ID. The console's model catalogue shows the right identifier.
  • IAM permissions: your role needs bedrock:InvokeModel (and related actions for streaming or Converse) on the model or profile ARN.
  • Streaming: use converse-stream / converse_stream for chat UIs so users see tokens as they arrive.
  • Tool use: the Converse API supports passing tool definitions; the model returns a tool call, your code executes it, and you send the result back.

How RAG works with Knowledge Bases

  1. You point a Knowledge Base at a data source such as an S3 bucket of PDFs.
  2. Bedrock splits documents into chunks, converts them to embeddings with an embedding model, and stores them in a vector store.
  3. At query time, the user's question is embedded, the closest chunks are retrieved, and they are passed to the model with the question.
  4. The answer comes back with citations to the source chunks.

This is usually the fastest route to a "chat with our documents" assistant, and keeps answers grounded in your own data.

How much does Bedrock cost?

Bedrock pricing varies by model and region, so there is no single number. The main pricing modes are:

Mode How you pay Good for
On-demand Per 1,000 (or 1 million) input and output tokens; per image for image models Most apps, prototypes
Batch Discounted per-token pricing for asynchronous jobs Large offline workloads
Provisioned Throughput Hourly commitment for guaranteed capacity Steady, high-volume production
Extras Knowledge Base storage, Guardrails, agent runtime charges Depends on features used

Amazon positions Nova models as low-cost options compared with many third-party frontier models. Check the Bedrock pricing page for the exact per-token rates in your region before you build cost estimates. New AWS accounts can use Free Tier credits for Bedrock.

Bedrock vs calling an AI provider directly

Amazon Bedrock Direct provider API
Model choice Many providers through one API One provider
Billing On your AWS bill Separate account and bill
Data and network Stays in your AWS environment; private connectivity options Provider's terms and network
Enterprise controls IAM, CloudTrail, VPC endpoints, Guardrails Varies
Newest features May arrive later than on the provider's own API Usually first

For teams already on AWS, Bedrock is usually the easier path for security reviews and procurement. For hobby projects that need one specific model's newest feature on day one, the provider's own API may be quicker.

What can you build with Bedrock and Nova?

Some practical, common use cases, with the Bedrock features they rely on:

Use case Typical building blocks
Customer support assistant Knowledge Bases over help articles, Guardrails, a Lite-class model
Document summaries for legal or finance teams Long-context model, batch inference for volume
Product description generator for e-commerce Small text model, prompt templates, human review
Voice assistant for a call centre Nova Sonic speech-to-speech model
Internal agent that files tickets or queries databases Converse API tool use, AgentCore, IAM-scoped tools
Image generation for marketing drafts Nova Canvas or another image model, content filters

Responsible AI basics before you ship

  • Use Guardrails to block harmful content and redact personal data such as phone numbers or Aadhaar-like identifiers in prompts and outputs.
  • Ground answers in your own documents with Knowledge Bases and show citations, to reduce made-up answers.
  • Keep a human in the loop for anything customer-facing that carries legal, medical or financial weight.
  • Log and monitor with CloudTrail and CloudWatch so you can audit who called which model and when.
  • Evaluate before switching models: Bedrock offers model evaluation tools to compare outputs on your own test set.

FAQ

Is Amazon Nova free to use?

No, Nova models are billed per use in Bedrock. New AWS accounts can apply Free Tier credits to Bedrock usage, and trying Bedrock is one of the onboarding activities that earns extra credit.

What is the difference between Bedrock and Nova?

Bedrock is the platform (API, tools, security). Nova is a family of models made by Amazon that you can run on Bedrock alongside models from other companies.

Which Nova 2 models are available?

AWS announced Nova 2 Lite as available in Bedrock and Nova 2 Pro in preview in December 2025, along with Nova 2 Sonic for voice and Nova 2 Omni for multimodal tasks. Check the Bedrock console for current availability in your region.

Is Amazon Bedrock available in India?

Bedrock is offered in the Asia Pacific (Mumbai) region, but individual models vary by region. Some models are available to Indian users through cross-region inference.

Does AWS train models on my Bedrock data?

AWS states that Bedrock does not use your prompts and outputs to train the base models and does not share them with third-party model providers.

What is Bedrock AgentCore?

AgentCore is AWS's set of services for deploying and running AI agents securely at scale, covering runtime, memory, identity, tool gateways and observability.

Do I need machine learning experience to use Bedrock?

No. You can use the playground with no code, and the API calls look like any other web API. ML experience helps for fine-tuning and evaluation.

Sources

Featured image: Amazon. Source

Share:

Comments

Leave a comment