The Go language implementation of gRPC. HTTP/2 based RPC
Go to file
erm-g b82468a346
crl provider: Static and FileWatcher provider implementations (#6670)
* rename certificateListExt to CRL

* CRLProvider file

* Add CRLProvider to RevocationConfig

* Beginning refactor of CRL handling

* Shell of StaticCRLProvider

* basic static crl provider test

* use loadCRL helper

* refactor of CRL loading

* Table tests

* Table tests

* Add tests with Static CRL provider

* New certs to be used for CRL tests. Added test for passing and failing connections based on CRL check outcomes

* Main functionality of File Watcher (Directory) CRL provider

* Refactor async go routine, validate() func, add unit tests

* Custom error callback, related unit tests

* Error callback test improvement

* Comments for StaticCRLProvider

* Comments for public API

* go mod tidy

* Comments for tests

* Fix vet errors

* Change Static provider behavior to match C Core, address other PR comments

* Data race fix

* Test helper fn change

* Address PR comments

* Address PR comments (part 2)

* Migration from context to channel for controlling crl reloading goroutine

* Align in-memory CRL updates during directory scan to C++ behavior

* Improve comments for ScanCRLDirectory

* Base test case for Scan CRL Directory file manipulations

* full set of cases for CRL directory content manipulation

* Add comment for table test structure

* Fix for go.mod and go.sum

* Empty directoru workaround

* Delete deprecated crl functionality

* Restoring deprecated crl files

* Fit to grpctest.Tester pattern

* Update readme for crl provider tests

* Address PR comments

* Revert "Restoring deprecated crl files"

This reverts commit 56437603a4.

* Revert "Resolve conflicts with upstream - deletion of deprecated crl"

This reverts commit e0130640c46efd9a43649bf409c6e762ae66e225, reversing
changes made to 21f430135c.

Revert deletion

* Update link for gRFC proposal

* Address PR comments

* Address PR comments part 1

* Address PR comments part 2

* Address PR comments part 3

* Fix for go.mod and go.sum

* Fix comment typo

* Fix for gRFC tag

* Add more details to CRL api  godoc comments.

* Address PR comments

* Address PR comments

* Delete crl_deprecated.go and crl_deprecated_test.go

* Delete testdate/crl/provider/filewatcher directory and .gitignore under it

* Race test fix

* Address PR comments

* Address PR comments

* Refactor directory reloader test from checking size of crl map to querying individual entries approach

* Add extra case for RefreshDuration config test

* Update cpmment for table test structure

* Unexport scan scanCRLDirectory, drop related mutex, update the comments

* Update API comments, clear tmp dir after the tests

---------

Co-authored-by: Gregory Cooke <gregorycooke@google.com>
2023-10-30 20:41:22 -04:00
.github github: add code coverage with codecov.io (#6676) 2023-10-04 13:19:05 -07:00
Documentation *: remove references to old versions of go (#6545) 2023-08-11 14:14:47 -07:00
admin admin/test: split channelz imports (#6058) 2023-02-27 16:57:44 -08:00
attributes attributes: avoid the use of %#v formatting verb (#6664) 2023-09-26 09:58:45 -07:00
authz Replace the gRFC pull request with the permanent link. (#6674) 2023-10-03 09:53:18 -07:00
backoff client: add WithConnectParams to configure connection backoff and timeout (#2960) 2019-10-03 16:47:13 -07:00
balancer balancer/rls: Fix RLS failure mode by treating response with no targets as an error (#6735) 2023-10-18 17:26:06 -04:00
benchmark experimental: add package and move recv buffer pool APIs into it (#6692) 2023-10-12 18:29:29 -07:00
binarylog client: fix ClientStream.Header() behavior (#6557) 2023-08-18 08:05:48 -07:00
channelz idle: move idleness manager to separate package and ~13s of tests into it (#6566) 2023-08-23 12:50:42 -07:00
cmd/protoc-gen-go-grpc *: update `interface{}` to `any` and `go.mod` version to `go 1.19` (#6544) 2023-08-14 09:04:46 -07:00
codes codes: update docstring to indicate expected usage (#6701) 2023-10-10 13:06:23 -07:00
connectivity xds: de-experimentalize xDS apis required for psm security (#4753) 2021-09-15 14:05:59 -07:00
credentials Revert "alts: Reduce ALTS counter overflow length from 5 to 4. (#6699)" (#6746) 2023-10-24 15:13:54 -07:00
encoding encoding: move codec tests out of top-level test package (#6728) 2023-10-13 13:54:26 -07:00
examples deps: update dependencies for all modules (#6698) 2023-10-06 12:02:06 -07:00
experimental experimental: add package and move recv buffer pool APIs into it (#6692) 2023-10-12 18:29:29 -07:00
gcp/observability deps: update dependencies for all modules (#6698) 2023-10-06 12:02:06 -07:00
grpclog *: update `interface{}` to `any` and `go.mod` version to `go 1.19` (#6544) 2023-08-14 09:04:46 -07:00
health health/grpc_health_v1: update pb.go (#6616) 2023-09-11 10:06:12 -07:00
internal grpc: Add a pointer of server to ctx passed into stats handler (#6750) 2023-10-26 16:30:26 -04:00
interop deps: update dependencies for all modules (#6698) 2023-10-06 12:02:06 -07:00
keepalive keepalive: apply minimum ping time of 10s to client and 1s to server (#2642) 2019-02-21 13:09:37 -08:00
metadata metadata: Use strings.EqualFold for ValueFromIncomingContext (#6743) 2023-10-30 09:51:19 -07:00
orca internal/backoff: add a helper to run a function with backoff (#6661) 2023-09-26 11:10:18 -07:00
peer grpc: Move some stats handler calls to gRPC layer, and add local address to peer.Peer (#6716) 2023-10-25 18:01:05 -04:00
profiling multiple: update dependencies after 1.57 branch cut (#6452) 2023-07-18 14:09:46 -07:00
reflection *: update `interface{}` to `any` and `go.mod` version to `go 1.19` (#6544) 2023-08-14 09:04:46 -07:00
resolver resolver: Add an endpoint map type (#6679) 2023-10-16 16:18:10 -04:00
security crl provider: Static and FileWatcher provider implementations (#6670) 2023-10-30 20:41:22 -04:00
serviceconfig testing: update Go to 1.19 (#5717) 2022-10-17 15:04:34 -07:00
stats grpc: Add a pointer of server to ctx passed into stats handler (#6750) 2023-10-26 16:30:26 -04:00
status Reapply "status: fix/improve status handling (#6662)" (#6673) (#6688) 2023-10-05 08:20:01 -07:00
stress multiple: update dependencies after 1.57 branch cut (#6452) 2023-07-18 14:09:46 -07:00
tap transport: Pass Header metadata to tap handle. (#6652) 2023-10-05 14:08:13 -04:00
test envconfig: remove env vars for on-by-default features (#6749) 2023-10-26 13:08:20 -07:00
testdata authz: End2End test for AuditLogger (#6304) 2023-06-01 19:32:33 -04:00
xds envconfig: remove env vars for on-by-default features (#6749) 2023-10-26 13:08:20 -07:00
AUTHORS add AUTHORS and LICENSE 2017-06-08 14:37:28 +02:00
CODE-OF-CONDUCT.md Update governance, contributing, code of conduct docs (#3033) 2019-09-23 11:24:27 -07:00
CONTRIBUTING.md CONTRIBUTING.md: remove duplicated bullet point (#6139) 2023-03-21 19:28:53 -04:00
GOVERNANCE.md Update governance, contributing, code of conduct docs (#3033) 2019-09-23 11:24:27 -07:00
LICENSE Make Apache 2.0 LICENSE file a verbatim copy (#1329) 2017-06-21 10:20:47 -07:00
MAINTAINERS.md Update MAINTAINERS.md (#4628) 2021-07-28 14:46:46 -07:00
Makefile multiple: remove appengine specific build constraints and code (#4685) 2021-08-24 12:30:13 -07:00
NOTICE.txt Create NOTICE.txt (#4739) 2021-09-14 07:15:02 -07:00
README.md readme: fix badges (#6687) 2023-10-04 14:55:14 -07:00
SECURITY.md github: improve security policy documentation (#4130) 2020-12-22 13:01:38 -08:00
backoff.go testing: update Go to 1.19 (#5717) 2022-10-17 15:04:34 -07:00
balancer_conn_wrappers.go *: update `interface{}` to `any` and `go.mod` version to `go 1.19` (#6544) 2023-08-14 09:04:46 -07:00
balancer_conn_wrappers_test.go client: add a test for NewSubConn / StateListener / cc.Close racing (#6678) 2023-10-04 15:39:16 -07:00
call.go idle: decrement active call count for streaming RPCs only when the call completes (#6610) 2023-09-11 08:39:06 -07:00
clientconn.go internal/testutils: add a new test type that implements resolver.ClientConn (#6668) 2023-10-12 10:09:38 -07:00
clientconn_authority_test.go grpc: remove remaining usages of grpc.WithInsecure() (#5246) 2022-03-17 10:17:03 -07:00
clientconn_parsed_target_test.go resolver: delete Target.Scheme and Target.Authority (#6363) 2023-07-05 10:47:46 -07:00
clientconn_test.go resolver/manual: support restarts, required for channel idleness (#6638) 2023-09-15 10:47:11 -07:00
codec.go *: update `interface{}` to `any` and `go.mod` version to `go 1.19` (#6544) 2023-08-14 09:04:46 -07:00
codec_test.go grpctest: add new package to manage tests and support per-test setup/teardown (#2523) 2019-01-07 14:24:56 -08:00
codegen.sh FIX: use /usr/bin/env bash in shebang 2016-12-17 20:45:30 +01:00
default_dial_option_server_option_test.go client: Add dial option to disable global dial options (#6016) 2023-02-13 21:13:32 -05:00
dialoptions.go experimental: add package and move recv buffer pool APIs into it (#6692) 2023-10-12 18:29:29 -07:00
doc.go all: refactor .pb.go generation (#3451) 2020-04-24 08:54:03 -07:00
go.mod deps: update dependencies for all modules (#6698) 2023-10-06 12:02:06 -07:00
go.sum deps: update dependencies for all modules (#6698) 2023-10-06 12:02:06 -07:00
grpc_test.go Modified tests to use tlogger. (#3343) 2020-02-06 13:03:20 -08:00
interceptor.go *: update `interface{}` to `any` and `go.mod` version to `go 1.19` (#6544) 2023-08-14 09:04:46 -07:00
picker_wrapper.go stats: Add RPC event for blocking for a picker update (#6422) 2023-07-18 13:50:03 -04:00
picker_wrapper_test.go stats: Add RPC event for blocking for a picker update (#6422) 2023-07-18 13:50:03 -04:00
pickfirst.go envconfig: remove env vars for on-by-default features (#6749) 2023-10-26 13:08:20 -07:00
preloader.go *: update `interface{}` to `any` and `go.mod` version to `go 1.19` (#6544) 2023-08-14 09:04:46 -07:00
regenerate.sh reflection: generate protobuf files from grpc-proto (#5799) 2022-11-21 15:48:12 -08:00
resolver_conn_wrapper.go test: update client state subscriber test to be not flaky and more stressful about rapid updates (#6512) 2023-08-10 15:12:06 -07:00
resolver_test.go attributes: print typed nil values instead of panic (#6574) 2023-09-22 12:09:02 -07:00
rpc_util.go client: fix ClientStream.Header() behavior (#6557) 2023-08-18 08:05:48 -07:00
rpc_util_test.go rpc_util: Reuse memory buffer for receiving message (#5862) 2023-06-27 08:58:10 -07:00
server.go grpc: Add a pointer of server to ctx passed into stats handler (#6750) 2023-10-26 16:30:26 -04:00
server_ext_test.go server: prohibit more than MaxConcurrentStreams handlers from running at once (#6703) 2023-10-10 10:51:45 -07:00
server_test.go *: update `interface{}` to `any` and `go.mod` version to `go 1.19` (#6544) 2023-08-14 09:04:46 -07:00
service_config.go cleanup: use new Duration type in base ServiceConfig (#6284) 2023-05-15 15:48:02 -07:00
service_config_test.go cleanup: use new Duration type in base ServiceConfig (#6284) 2023-05-15 15:48:02 -07:00
shared_buffer_pool.go *: update `interface{}` to `any` and `go.mod` version to `go 1.19` (#6544) 2023-08-14 09:04:46 -07:00
shared_buffer_pool_test.go rpc_util: Reuse memory buffer for receiving message (#5862) 2023-06-27 08:58:10 -07:00
stream.go idle: decrement active call count for streaming RPCs only when the call completes (#6610) 2023-09-11 08:39:06 -07:00
stream_test.go grpc_test: rename import for grpc_testing (#6594) 2023-08-29 13:52:17 -07:00
trace.go *: update `interface{}` to `any` and `go.mod` version to `go 1.19` (#6544) 2023-08-14 09:04:46 -07:00
trace_test.go trace: fix getting family for the method (#3216) 2019-12-19 13:23:11 -08:00
version.go Change version to 1.60.0-dev (#6697) 2023-10-05 16:40:43 -07:00
vet.sh vet: ensure all usages of grpc_testing package are renamed when importing (#6595) 2023-08-29 15:27:50 -07:00

README.md

gRPC-Go

GoDoc GoReportCard codecov

The Go implementation of gRPC: A high performance, open source, general RPC framework that puts mobile and HTTP/2 first. For more information see the Go gRPC docs, or jump directly into the quick start.

Prerequisites

Installation

Simply add the following import to your code, and then go [build|run|test] will automatically fetch the necessary dependencies:

import "google.golang.org/grpc"

Note: If you are trying to access grpc-go from China, see the FAQ below.

Learn more

FAQ

I/O Timeout Errors

The golang.org domain may be blocked from some countries. go get usually produces an error like the following when this happens:

$ go get -u google.golang.org/grpc
package google.golang.org/grpc: unrecognized import path "google.golang.org/grpc" (https fetch: Get https://google.golang.org/grpc?go-get=1: dial tcp 216.239.37.1:443: i/o timeout)

To build Go code, there are several options:

  • Set up a VPN and access google.golang.org through that.

  • With Go module support: it is possible to use the replace feature of go mod to create aliases for golang.org packages. In your project's directory:

    go mod edit -replace=google.golang.org/grpc=github.com/grpc/grpc-go@latest
    go mod tidy
    go mod vendor
    go build -mod=vendor
    

    Again, this will need to be done for all transitive dependencies hosted on golang.org as well. For details, refer to golang/go issue #28652.

Compiling error, undefined: grpc.SupportPackageIsVersion

Please update to the latest version of gRPC-Go using go get google.golang.org/grpc.

How to turn on logging

The default logger is controlled by environment variables. Turn everything on like this:

$ export GRPC_GO_LOG_VERBOSITY_LEVEL=99
$ export GRPC_GO_LOG_SEVERITY_LEVEL=info

The RPC failed with error "code = Unavailable desc = transport is closing"

This error means the connection the RPC is using was closed, and there are many possible reasons, including:

  1. mis-configured transport credentials, connection failed on handshaking
  2. bytes disrupted, possibly by a proxy in between
  3. server shutdown
  4. Keepalive parameters caused connection shutdown, for example if you have configured your server to terminate connections regularly to trigger DNS lookups. If this is the case, you may want to increase your MaxConnectionAgeGrace, to allow longer RPC calls to finish.

It can be tricky to debug this because the error happens on the client side but the root cause of the connection being closed is on the server side. Turn on logging on both client and server, and see if there are any transport errors.