components-contrib/state
Alessandro (Ale) Segala 457d6c40b4
Ensure rethinkdb complies with state.TransactionalStore (#1930)
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2022-08-05 14:09:44 -07:00
..
aerospike Adding Pinger interface and Removing mandatory nature of Ping fuction (#1784) 2022-06-14 08:27:54 -07:00
alicloud/tablestore Adding Pinger interface and Removing mandatory nature of Ping fuction (#1784) 2022-06-14 08:27:54 -07:00
aws/dynamodb Moved authentication to be an internal pkg (#1855) 2022-07-06 11:05:34 -07:00
azure Add contexts to input bindings (#1831) 2022-07-12 12:19:27 -07:00
cassandra Adding Pinger interface and Removing mandatory nature of Ping fuction (#1784) 2022-06-14 08:27:54 -07:00
cockroachdb adding query api to the feature list (#1775) 2022-06-07 08:38:02 -07:00
couchbase Adding Pinger interface and Removing mandatory nature of Ping fuction (#1784) 2022-06-14 08:27:54 -07:00
gcp/firestore Adding Pinger interface and Removing mandatory nature of Ping fuction (#1784) 2022-06-14 08:27:54 -07:00
hashicorp/consul Adding Pinger interface and Removing mandatory nature of Ping fuction (#1784) 2022-06-14 08:27:54 -07:00
hazelcast Adding Pinger interface and Removing mandatory nature of Ping fuction (#1784) 2022-06-14 08:27:54 -07:00
in-memory Adding Pinger interface and Removing mandatory nature of Ping fuction (#1784) 2022-06-14 08:27:54 -07:00
jetstream Adding Pinger interface and Removing mandatory nature of Ping fuction (#1784) 2022-06-14 08:27:54 -07:00
memcached Adding Pinger interface and Removing mandatory nature of Ping fuction (#1784) 2022-06-14 08:27:54 -07:00
mongodb adding query api to the feature list (#1775) 2022-06-07 08:38:02 -07:00
mysql Adding Pinger interface and Removing mandatory nature of Ping fuction (#1784) 2022-06-14 08:27:54 -07:00
oci/objectstorage optimize: move logger from api to struct (#1818) 2022-06-28 19:30:13 -07:00
oracledatabase Introducing Oracle Database backed state store component (#1454) 2022-02-08 12:00:34 -08:00
postgresql Adding Pinger interface and Removing mandatory nature of Ping fuction (#1784) 2022-06-14 08:27:54 -07:00
query state store query API: remove preceding '.' in key names (#1500) 2022-02-11 15:00:43 -08:00
redis Adding Pinger interface and Removing mandatory nature of Ping fuction (#1784) 2022-06-14 08:27:54 -07:00
rethinkdb Ensure rethinkdb complies with state.TransactionalStore (#1930) 2022-08-05 14:09:44 -07:00
sqlserver Adding Pinger interface and Removing mandatory nature of Ping fuction (#1784) 2022-06-14 08:27:54 -07:00
utils update license to Apache v2.0 (#1406) 2022-01-04 19:53:31 -08:00
zookeeper Adding Pinger interface and Removing mandatory nature of Ping fuction (#1784) 2022-06-14 08:27:54 -07:00
Readme.md Updated development docs (#1835) 2022-06-30 22:23:41 -07:00
errors.go Change BulkDelete error handling in transaction 2022-02-21 15:40:58 +05:30
errors_test.go update license to Apache v2.0 (#1406) 2022-01-04 19:53:31 -08:00
feature.go adding query api to the feature list (#1775) 2022-06-07 08:38:02 -07:00
metadata.go update license to Apache v2.0 (#1406) 2022-01-04 19:53:31 -08:00
request_options.go update license to Apache v2.0 (#1406) 2022-01-04 19:53:31 -08:00
request_options_test.go update license to Apache v2.0 (#1406) 2022-01-04 19:53:31 -08:00
requests.go Added ContentType to pubsub/binding/state request-response (#1376) 2022-01-28 10:17:04 -08:00
responses.go Added ContentType to pubsub/binding/state request-response (#1376) 2022-01-28 10:17:04 -08:00
store.go Adding Pinger interface and Removing mandatory nature of Ping fuction (#1784) 2022-06-14 08:27:54 -07:00
store_test.go Adding Pinger interface and Removing mandatory nature of Ping fuction (#1784) 2022-06-14 08:27:54 -07:00
transactional_store.go update license to Apache v2.0 (#1406) 2022-01-04 19:53:31 -08:00

Readme.md

State Stores

State Stores provide a common way to interact with different data store implementations, and allow users to opt-in to advanced capabilities using defined metadata.

Implementing a new State Store

A compliant state store needs to implement one or more interfaces: Store and TransactionalStore, defined in the store.go file.

See the documentation site for examples.

Implementing State Query API

State Store has an optional API for querying the state.

Please refer to the documentation site for API description and definition.

// Querier is an interface to execute queries.
type Querier interface {
        Query(req *QueryRequest) (*QueryResponse, error)
}

Below are the definitions of structures (including nested) for QueryRequest and QueryResponse.

// QueryResponse is the request object for querying the state.
type QueryRequest struct {
        Query    query.Query       `json:"query"`
        Metadata map[string]string `json:"metadata,omitempty"`
}

type Query struct {
        Filters map[string]interface{} `json:"filter"`
        Sort    []Sorting              `json:"sort"`
        Page    Pagination             `json:"page"`

        // derived from Filters
        Filter Filter
}

type Sorting struct {
        Key   string `json:"key"`
        Order string `json:"order,omitempty"`
}

type Pagination struct {
        Limit int    `json:"limit"`
        Token string `json:"token,omitempty"`
}

// QueryResponse is the response object on querying state.
type QueryResponse struct {
        Results  []QueryItem       `json:"results"`
        Token    string            `json:"token,omitempty"`
        Metadata map[string]string `json:"metadata,omitempty"`
}

// QueryItem is an object representing a single entry in query results.
type QueryItem struct {
        Key   string  `json:"key"`
        Data  []byte  `json:"data"`
        ETag  *string `json:"etag,omitempty"`
        Error string  `json:"error,omitempty"`
}

Upon receiving the query request, Dapr validates it and transforms into object Query, which, in turn, is passed on to the state store component.

The Query object has a member Filter that implements parsing interface per component as described below.

type Filter interface {
	Parse(interface{}) error
}

type FilterEQ struct {
	Key string
	Val interface{}
}

type FilterIN struct {
	Key  string
	Vals []interface{}
}

type FilterAND struct {
	Filters []Filter
}

type FilterOR struct {
	Filters []Filter
}

To simplify the process of query translation, we leveraged visitor design pattern. A state store component developer would need to implement the visit method, and the runtime will use it to construct the native query statement.

type Visitor interface {
	// returns "equal" expression
	VisitEQ(*FilterEQ) (string, error)
	// returns "in" expression
	VisitIN(*FilterIN) (string, error)
	// returns "and" expression
	VisitAND(*FilterAND) (string, error)
	// returns "or" expression
	VisitOR(*FilterOR) (string, error)
	// receives concatenated filters and finalizes the native query
	Finalize(string, *MidQuery) error
}

The Dapr runtime implements QueryBuilder object that takes in Visitor interface and constructs the native query.

type QueryBuilder struct {
	visitor Visitor
}

func (h *QueryBuilder) BuildQuery(mq *MidQuery) error {...}

The last part is to implement Querier interface in the component:

type Querier interface {
	Query(req *QueryRequest) (*QueryResponse, error)
}

A sample implementation might look like that:

func (m *MyComponent) Query(req *state.QueryRequest) (*state.QueryResponse, error) {
	ctx, cancel := context.WithTimeout(context.Background(), timeout)
	defer cancel()

	query := &Query{} // Query implements Visitor interface
	qbuilder := state.NewQueryBuilder(query)
	if err := qbuilder.BuildQuery(&req.Query); err != nil {
		return &state.QueryResponse{}, err
	}
	data, token, err := query.execute(ctx)
	if err != nil {
		return &state.QueryResponse{}, err
	}
	return &state.QueryResponse{
		Results:  data,
		Token:    token,
	}, nil
}

Some of the examples of State Query API implementation are MongoDB and CosmosDB state store components.