The Go language implementation of gRPC. HTTP/2 based RPC
Go to file
Adhityaa Chandrasekar 642675125e codec/proto: reuse of marshal byte buffers (#3167)
Performance benchmarks can be found below. Obviously, a 8 KiB
request/response is tailored to showcase this improvement as this is
where codec buffer reuse shines, but I've run other benchmarks too (like
1-byte requests and responses) and there's no discernable impact on
performance.

We do not allow reuse of buffers when stat handlers or binlogs are
turned on. This is because those two may need access to the data and
payload even after the data has been written to the wire. In such cases,
we never return the data back to the pool.

A buffer reuse threshold of 1 KiB was determined after several
experiments. There's diminished returns when buffer reuse is enabled for
smaller messages (actually, a negative impact).

unary-networkMode_none-bufConn_false-keepalive_false-benchTime_40s-trace_false-latency_0s-kbps_0-MTU_0-maxConcurrentCalls_6-reqSize_8192B-respSize_8192B-compressor_off-channelz_false-preloader_false
               Title       Before        After Percentage
            TotalOps       839638       906223     7.93%
             SendOps            0            0      NaN%
             RecvOps            0            0      NaN%
            Bytes/op    103788.29     80592.47   -22.35%
           Allocs/op       183.33       189.30     3.27%
             ReqT/op 1375662899.20 1484755763.20     7.93%
            RespT/op 1375662899.20 1484755763.20     7.93%
            50th-Lat    238.746µs    225.019µs    -5.75%
            90th-Lat    514.253µs    456.439µs   -11.24%
            99th-Lat    711.083µs    702.466µs    -1.21%
             Avg-Lat     285.45µs    264.456µs    -7.35%
2019-12-20 09:41:23 -08:00
.github github: make stalebot monitor PRs, too (#3202) 2019-11-21 12:37:51 -08:00
Documentation codec/proto: reuse of marshal byte buffers (#3167) 2019-12-20 09:41:23 -08:00
attributes resolver: introduce attributes package and use it for Address and State (#3151) 2019-11-06 16:53:23 -08:00
backoff client: add WithConnectParams to configure connection backoff and timeout (#2960) 2019-10-03 16:47:13 -07:00
balancer grpclb: do not send redundant empty load reports to remote LB (#3249) 2019-12-12 14:10:47 -08:00
benchmark benchmark: include go and grpc version in result files (#3242) 2019-12-12 13:18:36 -08:00
binarylog/grpc_binarylog_v1 binarylog: implement methodlogger (#2334) 2018-10-18 17:27:11 -07:00
channelz internal: update proto library version (#3025) 2019-09-17 13:49:26 -07:00
codes docs: add note about retrying UNAVAILABLE (#2774) 2019-04-15 14:59:43 -06:00
connectivity fix: typos (#2591) 2019-01-23 09:59:48 -08:00
credentials credentials: move TLS implementation to a separate file (#3243) 2019-12-11 13:11:24 -08:00
encoding codec/proto: reuse of marshal byte buffers (#3167) 2019-12-20 09:41:23 -08:00
examples Update README.md (#3231) 2019-12-11 13:12:25 -08:00
grpclog internal: fix typos in comments (#3046) 2019-09-30 15:30:07 -07:00
health balancer: add V2Picker, ClientConn.UpdateState, SubConnState.ConnectionError (#3186) 2019-11-21 10:27:29 -08:00
internal codec/proto: reuse of marshal byte buffers (#3167) 2019-12-20 09:41:23 -08:00
interop travis: run interop tests with examples (#3229) 2019-12-04 15:55:45 -08:00
keepalive keepalive: apply minimum ping time of 10s to client and 1s to server (#2642) 2019-02-21 13:09:37 -08:00
metadata cleanup: replace "x/net/context" import with "context" (#2439) 2018-11-12 13:30:41 -08:00
naming Update go.mod for golang/x/tools and staticcheck (#2832) 2019-05-24 11:13:46 -07:00
peer cleanup: replace "x/net/context" import with "context" (#2439) 2018-11-12 13:30:41 -08:00
profiling profiling: add cmd binary for retrieving and processing data (#3161) 2019-12-20 09:28:08 -08:00
reflection cleanup: no x/net/context (#3120) 2019-10-29 13:06:26 -07:00
resolver resolver: rename Option to Options, leaving type aliases for now (#3175) 2019-11-12 15:23:46 -08:00
serviceconfig resolver: add State fields to support error handling (#2951) 2019-10-04 12:59:43 -07:00
stats stats: attach metadata to In/Out Headers/Trailers (#3169) 2019-11-14 15:22:36 -08:00
status cleanup: fix generic comparisons on protobuf messages (#3153) 2019-11-06 14:25:07 -08:00
stress fix typos (#3111) 2019-10-22 10:46:34 -07:00
tap cleanup: replace "x/net/context" import with "context" (#2439) 2018-11-12 13:30:41 -08:00
test balancer: add V2Picker, ClientConn.UpdateState, SubConnState.ConnectionError (#3186) 2019-11-21 10:27:29 -08:00
testdata testdata: get test assets related to package root instead of GOPATH (#2272) 2018-08-22 09:00:39 -07:00
xds xds: Improve cdsbalancer_test.go (#3277) 2019-12-19 13:47:34 -08:00
.travis.yml travis: run interop tests with examples (#3229) 2019-12-04 15:55:45 -08:00
AUTHORS add AUTHORS and LICENSE 2017-06-08 14:37:28 +02:00
CODE-OF-CONDUCT.md Update governance, contributing, code of conduct docs (#3033) 2019-09-23 11:24:27 -07:00
CONTRIBUTING.md Update governance, contributing, code of conduct docs (#3033) 2019-09-23 11:24:27 -07:00
GOVERNANCE.md Update governance, contributing, code of conduct docs (#3033) 2019-09-23 11:24:27 -07:00
LICENSE Make Apache 2.0 LICENSE file a verbatim copy (#1329) 2017-06-21 10:20:47 -07:00
MAINTAINERS.md change from Inc. to LLC for Google (#2997) 2019-08-26 12:49:55 -07:00
Makefile makefile: remove testappengine from make all (#2621) 2019-02-07 13:44:42 -08:00
README.md internal: clean up README (#2764) 2019-04-11 10:11:17 -07:00
backoff.go client: add WithConnectParams to configure connection backoff and timeout (#2960) 2019-10-03 16:47:13 -07:00
balancer.go docs: clarify "deprecated" to indicate whether some features may be removed in 1.x (#2900) 2019-07-11 14:05:18 -07:00
balancer_conn_wrappers.go balancer: add V2Picker, ClientConn.UpdateState, SubConnState.ConnectionError (#3186) 2019-11-21 10:27:29 -08:00
balancer_conn_wrappers_test.go balancer: add V2Picker, ClientConn.UpdateState, SubConnState.ConnectionError (#3186) 2019-11-21 10:27:29 -08:00
balancer_switching_test.go balancer: add V2Picker, ClientConn.UpdateState, SubConnState.ConnectionError (#3186) 2019-11-21 10:27:29 -08:00
balancer_test.go balancer: add V2Picker, ClientConn.UpdateState, SubConnState.ConnectionError (#3186) 2019-11-21 10:27:29 -08:00
balancer_v1_wrapper.go balancer: add V2Picker, ClientConn.UpdateState, SubConnState.ConnectionError (#3186) 2019-11-21 10:27:29 -08:00
call.go fix: typos (#2591) 2019-01-23 09:59:48 -08:00
call_test.go interceptor: new APIs for chaining client interceptors. (#2696) 2019-04-15 11:13:34 -07:00
clientconn.go balancer: add V2Picker, ClientConn.UpdateState, SubConnState.ConnectionError (#3186) 2019-11-21 10:27:29 -08:00
clientconn_state_transition_test.go client: fix race between transport draining and new RPCs (#2919) 2019-07-22 16:07:55 -07:00
clientconn_test.go resolver: move dns and passthrough to internal (#3116) 2019-10-22 13:01:54 -07:00
codec.go codec/proto: reuse of marshal byte buffers (#3167) 2019-12-20 09:41:23 -08:00
codec_test.go grpctest: add new package to manage tests and support per-test setup/teardown (#2523) 2019-01-07 14:24:56 -08:00
codegen.sh FIX: use /usr/bin/env bash in shebang 2016-12-17 20:45:30 +01:00
dialoptions.go godoc: clarify WithTimeout deprecation note (#3226) 2019-12-12 13:29:02 -08:00
doc.go Fix missing and wrong license (#1422) 2017-08-04 13:46:18 -07:00
go.mod xds: Initial implementation of a client using the v2 API (#3144) 2019-11-12 10:31:11 -08:00
go.sum xds: Initial implementation of a client using the v2 API (#3144) 2019-11-12 10:31:11 -08:00
grpc_test.go balancer: add V2Picker, ClientConn.UpdateState, SubConnState.ConnectionError (#3186) 2019-11-21 10:27:29 -08:00
install_gae.sh testing: upgrade appengine sdk to version 1.9.68 (#2311) 2018-09-18 10:42:17 -07:00
interceptor.go cleanup: replace "x/net/context" import with "context" (#2439) 2018-11-12 13:30:41 -08:00
picker_wrapper.go balancer: add V2Picker, ClientConn.UpdateState, SubConnState.ConnectionError (#3186) 2019-11-21 10:27:29 -08:00
picker_wrapper_test.go balancer: add V2Picker, ClientConn.UpdateState, SubConnState.ConnectionError (#3186) 2019-11-21 10:27:29 -08:00
pickfirst.go balancer: add V2Picker, ClientConn.UpdateState, SubConnState.ConnectionError (#3186) 2019-11-21 10:27:29 -08:00
pickfirst_test.go client: remove option to send RPCs before HTTP/2 handshake is completed (#2904) 2019-07-12 13:37:27 -07:00
preloader.go codec/proto: reuse of marshal byte buffers (#3167) 2019-12-20 09:41:23 -08:00
proxy.go proxy: support basic authentication (#2426) 2018-11-13 14:59:16 -08:00
proxy_test.go proxy_test: Fix a goroutine-leak bug in testHTTPConnect: now use channel done to store err and call t.Fatalf when err not nil (#3080) 2019-10-09 10:12:01 -07:00
resolver_conn_wrapper.go grpc: Defer the unlock in newCCResolverWrapper (#3255) 2019-12-13 10:55:51 -08:00
resolver_conn_wrapper_test.go balancer: add V2Picker, ClientConn.UpdateState, SubConnState.ConnectionError (#3186) 2019-11-21 10:27:29 -08:00
rpc_util.go Use exact size, if known, to allocate decompression buffer (#3048) 2019-10-04 10:05:56 -07:00
rpc_util_test.go Remove call to proto.Clone() in http2Server.WriteStatus. (#2842) 2019-06-10 15:03:12 -07:00
server.go codec/proto: reuse of marshal byte buffers (#3167) 2019-12-20 09:41:23 -08:00
server_test.go grpctest: add new package to manage tests and support per-test setup/teardown (#2523) 2019-01-07 14:24:56 -08:00
service_config.go resolver: add State fields to support error handling (#2951) 2019-10-04 12:59:43 -07:00
service_config_test.go resolver: add State fields to support error handling (#2951) 2019-10-04 12:59:43 -07:00
stream.go codec/proto: reuse of marshal byte buffers (#3167) 2019-12-20 09:41:23 -08:00
trace.go trace: fix getting family for the method (#3216) 2019-12-19 13:23:11 -08:00
trace_test.go trace: fix getting family for the method (#3216) 2019-12-19 13:23:11 -08:00
version.go Change version to 1.27.0-dev (#3263) 2019-12-17 14:10:24 -08:00
vet.sh codec/proto: reuse of marshal byte buffers (#3167) 2019-12-20 09:41:23 -08:00

README.md

gRPC-Go

Build Status GoDoc GoReportCard

The Go implementation of gRPC: A high performance, open source, general RPC framework that puts mobile and HTTP/2 first. For more information see the gRPC Quick Start: Go guide.

Installation

To install this package, you need to install Go and setup your Go workspace on your computer. The simplest way to install the library is to run:

$ go get -u google.golang.org/grpc

With Go module support (Go 1.11+), simply import "google.golang.org/grpc" in your source code and go [build|run|test] will automatically download the necessary dependencies (Go modules ref).

If you are trying to access grpc-go from within China, please see the FAQ below.

Prerequisites

gRPC-Go requires Go 1.9 or later.

Documentation

Performance

Performance benchmark data for grpc-go and other languages is maintained in this dashboard.

Status

General Availability Google Cloud Platform Launch Stages.

FAQ

I/O Timeout Errors

The golang.org domain may be blocked from some countries. go get usually produces an error like the following when this happens:

$ go get -u google.golang.org/grpc
package google.golang.org/grpc: unrecognized import path "google.golang.org/grpc" (https fetch: Get https://google.golang.org/grpc?go-get=1: dial tcp 216.239.37.1:443: i/o timeout)

To build Go code, there are several options:

  • Set up a VPN and access google.golang.org through that.

  • Without Go module support: git clone the repo manually:

    git clone https://github.com/grpc/grpc-go.git $GOPATH/src/google.golang.org/grpc
    

    You will need to do the same for all of grpc's dependencies in golang.org, e.g. golang.org/x/net.

  • With Go module support: it is possible to use the replace feature of go mod to create aliases for golang.org packages. In your project's directory:

    go mod edit -replace=google.golang.org/grpc=github.com/grpc/grpc-go@latest
    go mod tidy
    go mod vendor
    go build -mod=vendor
    

    Again, this will need to be done for all transitive dependencies hosted on golang.org as well. Please refer to this issue in the golang repo regarding this concern.

Compiling error, undefined: grpc.SupportPackageIsVersion

Please update proto package, gRPC package and rebuild the proto files:

  • go get -u github.com/golang/protobuf/{proto,protoc-gen-go}
  • go get -u google.golang.org/grpc
  • protoc --go_out=plugins=grpc:. *.proto

How to turn on logging

The default logger is controlled by the environment variables. Turn everything on by setting:

GRPC_GO_LOG_VERBOSITY_LEVEL=99 GRPC_GO_LOG_SEVERITY_LEVEL=info

The RPC failed with error "code = Unavailable desc = transport is closing"

This error means the connection the RPC is using was closed, and there are many possible reasons, including:

  1. mis-configured transport credentials, connection failed on handshaking
  2. bytes disrupted, possibly by a proxy in between
  3. server shutdown

It can be tricky to debug this because the error happens on the client side but the root cause of the connection being closed is on the server side. Turn on logging on both client and server, and see if there are any transport errors.