The Java gRPC implementation. HTTP/2 based RPC
Go to file
Chengyuan Zhang 2adeff56fe
xds: refactor resource subscription implementation in XdsClient (#7458)
Introduce ResourceSubscriber for tracking the state of a single resource.

Every time newly subscribing to some resource, a corresponding ResourceSubscriber is created. Note it does not control the resource discovery RPCs. It is still the XdsClient that sends RPCs for with all subscribed resource names for each type. A ResourceSubscriber can have the following states:

  - When the initial resource fetch timer (respTimer) is pending, the resource is under discovery, the resource data is unknown. Even if the XdsClient receives a response not containing the corresponding resource, it does not mean the resource is absent. We still need to wait until a response containing the resource data coming or the timer being fired. The timer is scheduled when the ResourceSubscriber is created. So the XdsClient should always create the corresponding ResourceSubscriber when it starts to subscribe a new resource.

  - If the resource fetch timer is not pending, we must know the existence of the resource data. If data field is set, it is the most recently received resource data (aka, cached entry). Otherwise, absent field is set to true, indicating the resource does not exist. The exceptional case is when the ADS stream is closed and in the retry backoff period. During that period, respTimer is cancelled and the resource existence may or may not be known. Once the backoff finishes, the XdsClient will reschedule the respTimer when it recreates the ADS stream and re-request all the resources.

Watchers can be added to existing ResourceSubscribers. At the time the watcher is added, its callback will be invoked if we've already known the existence of the resource. Otherwise, the watcher will just sit there and wait data or absence to come in the future.
2020-09-28 13:43:41 -07:00
.github github: Remove bug label from newly filed bugs 2020-06-26 10:41:34 -05:00
all Remove grpc-rls from grpc-all dependencies 2020-06-11 19:06:20 +00:00
alts Revert "Call Cipher APIs with non-direct ByteBuffers and perform copies in the ALTS code. (cl/308901367)" 2020-09-10 12:12:11 -05:00
android android, cronet, android-interop-testing, example/drop support for android SDK versions older than 16 (#7253) 2020-07-28 12:40:55 -07:00
android-interop-testing android, cronet, android-interop-testing, example/drop support for android SDK versions older than 16 (#7253) 2020-07-28 12:40:55 -07:00
api api, core: delete io.grpc.LoadBalancer.loadBalancingConfig attribute (#7440) 2020-09-18 12:54:48 -07:00
auth all: migrate gradle build to java-library plugin 2020-05-04 16:44:30 -07:00
benchmarks api, core: create ForwardingServerBuilder and ServerImplBuilder 2020-09-03 16:26:04 -04:00
bom rls: add proto and converter (#6743) 2020-02-28 21:41:19 -08:00
buildscripts build, examples, README.md: Update protobuf gradle plugin version to 0.8.13 (#7355) 2020-09-21 10:42:06 -07:00
census Fix lint warnings 2020-08-07 14:49:50 -05:00
compiler all: fix lint 2020-08-28 13:00:44 -07:00
context Fix lint warnings 2020-08-07 14:49:50 -05:00
core Revert "core: delay sending cancel request on client-side when deadline expires (#6328)" (#7457) 2020-09-25 10:38:21 -07:00
cronet Update README etc to reference 1.32.1 2020-09-10 14:50:48 -05:00
documentation Update README etc to reference 1.32.1 2020-09-10 14:50:48 -05:00
examples build, examples, README.md: Update protobuf gradle plugin version to 0.8.13 (#7355) 2020-09-21 10:42:06 -07:00
gae-interop-testing Explain test value for flow control window 2020-09-02 14:51:39 -04:00
gradle/wrapper Upgrade to Gradle 6.5.1 2020-07-06 15:40:45 -07:00
grpclb grpclb: cache requestConnection if no subchannel created 2020-09-16 16:48:22 -07:00
interop-testing core, netty: server builders extend a public API class 2020-09-03 16:26:04 -04:00
netty netty: Add support for IBMJSSE2 (#7422) 2020-09-16 08:07:52 -07:00
okhttp okhttp: cleanup channel in channel builder tests 2020-09-16 11:38:55 -04:00
protobuf all: migrate gradle build to java-library plugin 2020-05-04 16:44:30 -07:00
protobuf-lite all: migrate gradle build to java-library plugin 2020-05-04 16:44:30 -07:00
rls rls: fix RLS_DATA_KEY propagation in headers 2020-09-28 09:56:01 -07:00
services Fix lint warnings 2020-08-07 14:49:50 -05:00
stub stub: Clarify ServerCallStreamObserver cancellation 2020-07-01 11:58:53 -07:00
testing okhttp, testing: remove server builder accessor hacks 2020-09-03 16:26:04 -04:00
testing-proto gradle: Fix Gradle 6 warnings 2020-07-31 09:52:36 -05:00
xds xds: refactor resource subscription implementation in XdsClient (#7458) 2020-09-28 13:43:41 -07:00
.bazelignore bazel: ignore examples/ from root WORKSPACE 2018-12-18 14:54:57 -07:00
.gitattributes Delete protobuf-nano 2019-05-22 08:49:07 -07:00
.gitignore Fix gitignore for Intellij filebased import 2019-07-08 17:11:26 -07:00
.travis.yml Delete example-kotlin (#6936) 2020-04-16 13:55:05 -07:00
AUTHORS all: update to Apache 2 licence 2017-05-31 13:29:01 -07:00
BUILD.bazel core: Move io.grpc to grpc-api 2019-04-16 21:45:40 -07:00
CODE-OF-CONDUCT.md Update governance, contributing, code of conduct docs (#6171) 2019-09-20 16:28:42 -07:00
COMPILING.md doc: update protoc version requirement (#7064) 2020-05-27 09:11:47 -07:00
CONTRIBUTING.md Update governance, contributing, code of conduct docs (#6171) 2019-09-20 16:28:42 -07:00
GOVERNANCE.md Update governance, contributing, code of conduct docs (#6171) 2019-09-20 16:28:42 -07:00
LICENSE fix LICENSE file (#3107) 2017-06-20 08:52:39 +02:00
MAINTAINERS.md Re-add ericgribkoff to current maintainer list (#6308) 2019-10-28 23:30:24 -07:00
NOTICE.txt xds: rollback PGV dependency from using maven artifact to importing proto source 2020-03-27 17:09:27 -07:00
README.md build, examples, README.md: Update protobuf gradle plugin version to 0.8.13 (#7355) 2020-09-21 10:42:06 -07:00
RELEASING.md RELEASING.md: Add missing repo+branch for gh-pages git pull 2020-08-13 11:09:42 -07:00
SECURITY.md Revert "SECURITY.md: add instruction for disabling Conscrypt's default TrustManager (#6962)" (#7428) 2020-09-16 10:07:52 -07:00
WORKSPACE bazel: Support maven_install 2019-12-30 12:08:42 -08:00
build.gradle Upgrade Conscrypt to 2.5.1 2020-09-10 12:12:11 -05:00
codecov.yml Disable codecov comment and changes status 2016-05-01 22:39:12 -07:00
gradlew all: update to gradle 4.0.1 2017-07-12 10:07:14 -07:00
gradlew.bat all: update to gradle 3.2 2016-11-23 14:43:18 -08:00
java_grpc_library.bzl java_grpc_library: Inline find_java_toolchain and find_java_runtime_toolchain 2020-01-30 12:55:40 -08:00
repositories.bzl Upgrade to Netty 4.1.51 and tcnative 2.0.31 2020-08-25 14:52:21 -07:00
run-test-client.sh Avoid interop build instructions when already built 2018-10-11 17:17:13 -07:00
run-test-server.sh Avoid interop build instructions when already built 2018-10-11 17:17:13 -07:00
settings.gradle build, examples, README.md: Update protobuf gradle plugin version to 0.8.13 (#7355) 2020-09-21 10:42:06 -07:00

README.md

gRPC-Java - An RPC library and framework

gRPC-Java works with JDK 7. gRPC-Java clients are supported on Android API levels 16 and up (Jelly Bean and later). Deploying gRPC servers on an Android device is not supported.

TLS usage typically requires using Java 8, or Play Services Dynamic Security Provider on Android. Please see the Security Readme.

Homepage: grpc.io
Mailing List: grpc-io@googlegroups.com

Join the chat at https://gitter.im/grpc/grpc Build Status Coverage Status

Getting Started

For a guided tour, take a look at the quick start guide or the more explanatory gRPC basics.

The examples and the Android example are standalone projects that showcase the usage of gRPC.

Download

Download the JARs. Or for Maven with non-Android, add to your pom.xml:

<dependency>
  <groupId>io.grpc</groupId>
  <artifactId>grpc-netty-shaded</artifactId>
  <version>1.32.1</version>
</dependency>
<dependency>
  <groupId>io.grpc</groupId>
  <artifactId>grpc-protobuf</artifactId>
  <version>1.32.1</version>
</dependency>
<dependency>
  <groupId>io.grpc</groupId>
  <artifactId>grpc-stub</artifactId>
  <version>1.32.1</version>
</dependency>
<dependency> <!-- necessary for Java 9+ -->
  <groupId>org.apache.tomcat</groupId>
  <artifactId>annotations-api</artifactId>
  <version>6.0.53</version>
  <scope>provided</scope>
</dependency>

Or for Gradle with non-Android, add to your dependencies:

implementation 'io.grpc:grpc-netty-shaded:1.32.1'
implementation 'io.grpc:grpc-protobuf:1.32.1'
implementation 'io.grpc:grpc-stub:1.32.1'
compileOnly 'org.apache.tomcat:annotations-api:6.0.53' // necessary for Java 9+

For Android client, use grpc-okhttp instead of grpc-netty-shaded and grpc-protobuf-lite instead of grpc-protobuf:

implementation 'io.grpc:grpc-okhttp:1.32.1'
implementation 'io.grpc:grpc-protobuf-lite:1.32.1'
implementation 'io.grpc:grpc-stub:1.32.1'
compileOnly 'org.apache.tomcat:annotations-api:6.0.53' // necessary for Java 9+

Development snapshots are available in Sonatypes's snapshot repository.

Generated Code

For protobuf-based codegen, you can put your proto files in the src/main/proto and src/test/proto directories along with an appropriate plugin.

For protobuf-based codegen integrated with the Maven build system, you can use protobuf-maven-plugin (Eclipse and NetBeans users should also look at os-maven-plugin's IDE documentation):

<build>
  <extensions>
    <extension>
      <groupId>kr.motd.maven</groupId>
      <artifactId>os-maven-plugin</artifactId>
      <version>1.6.2</version>
    </extension>
  </extensions>
  <plugins>
    <plugin>
      <groupId>org.xolstice.maven.plugins</groupId>
      <artifactId>protobuf-maven-plugin</artifactId>
      <version>0.6.1</version>
      <configuration>
        <protocArtifact>com.google.protobuf:protoc:3.12.0:exe:${os.detected.classifier}</protocArtifact>
        <pluginId>grpc-java</pluginId>
        <pluginArtifact>io.grpc:protoc-gen-grpc-java:1.32.1:exe:${os.detected.classifier}</pluginArtifact>
      </configuration>
      <executions>
        <execution>
          <goals>
            <goal>compile</goal>
            <goal>compile-custom</goal>
          </goals>
        </execution>
      </executions>
    </plugin>
  </plugins>
</build>

For protobuf-based codegen integrated with the Gradle build system, you can use protobuf-gradle-plugin:

plugins {
    id 'com.google.protobuf' version '0.8.13'
}

protobuf {
  protoc {
    artifact = "com.google.protobuf:protoc:3.12.0"
  }
  plugins {
    grpc {
      artifact = 'io.grpc:protoc-gen-grpc-java:1.32.1'
    }
  }
  generateProtoTasks {
    all()*.plugins {
      grpc {}
    }
  }
}

The prebuilt protoc-gen-grpc-java binary uses glibc on Linux. If you are compiling on Alpine Linux, you may want to use the Alpine grpc-java package which uses musl instead.

API Stability

APIs annotated with @Internal are for internal use by the gRPC library and should not be used by gRPC users. APIs annotated with @ExperimentalApi are subject to change in future releases, and library code that other projects may depend on should not use these APIs.

We recommend using the grpc-java-api-checker (an Error Prone plugin) to check for usages of @ExperimentalApi and @Internal in any library code that depends on gRPC. It may also be used to check for @Internal usage or unintended @ExperimentalApi consumption in non-library code.

How to Build

If you are making changes to gRPC-Java, see the compiling instructions.

High-level Components

At a high level there are three distinct layers to the library: Stub, Channel, and Transport.

Stub

The Stub layer is what is exposed to most developers and provides type-safe bindings to whatever datamodel/IDL/interface you are adapting. gRPC comes with a plugin to the protocol-buffers compiler that generates Stub interfaces out of .proto files, but bindings to other datamodel/IDL are easy and encouraged.

Channel

The Channel layer is an abstraction over Transport handling that is suitable for interception/decoration and exposes more behavior to the application than the Stub layer. It is intended to be easy for application frameworks to use this layer to address cross-cutting concerns such as logging, monitoring, auth, etc.

Transport

The Transport layer does the heavy lifting of putting and taking bytes off the wire. The interfaces to it are abstract just enough to allow plugging in of different implementations. Note the transport layer API is considered internal to gRPC and has weaker API guarantees than the core API under package io.grpc.

gRPC comes with three Transport implementations:

  1. The Netty-based transport is the main transport implementation based on Netty. It is for both the client and the server.
  2. The OkHttp-based transport is a lightweight transport based on OkHttp. It is mainly for use on Android and is for client only.
  3. The in-process transport is for when a server is in the same process as the client. It is useful for testing, while also being safe for production use.