quickstarts/conversation/python/sdk

Dapr Conversation API (Python SDK)

In this quickstart, you'll send an input to a mock Large Language Model (LLM) using Dapr's Conversation API. This API is responsible for providing one consistent API entry point to talk to underlying LLM providers.

Visit this link for more information about Dapr and the Conversation API.

This quickstart includes one app:

• app.py, responsible for sending an input to the underlying LLM and retrieving an output.

Run the app with the template file

This section shows how to run the application using the multi-app run template files with dapr run -f ..

This example uses the default LLM Component provided by Dapr which simply echoes the input provided, for testing purposes. Here are other supported Conversation components.

1. Install dependencies:

cd ./conversation
pip3 install -r requirements.txt
cd ..

2. Open a new terminal window and run the multi app run template:

dapr run -f .

The terminal console output should look similar to this, where:

• The app sends an input What is dapr? to the echo Component mock LLM.
• The mock LLM echoes What is dapr?.

== APP - conversation == Input sent: What is dapr?
== APP - conversation == Output response: What is dapr?

3. Stop and clean up application processes.

dapr stop -f .

Run the app with the Dapr CLI

1. Install dependencies:

Open a terminal and run:

cd ./conversation
pip3 install -r requirements.txt

2. Run the application:

dapr run --app-id conversation --resources-path ../../../components -- python3 app.py

You should see the output:

== APP == Input sent: What is dapr?
== APP == Output response: What is dapr?