The Java gRPC implementation. HTTP/2 based RPC
Go to file
Eric Anderson d82613a74c
xds: Fix cluster selection races when updating config selector
Listener2.onResult() doesn't require running in the sync context, so
when called from the sync context it is guaranteed not to do its
processing immediately (instead, it schedules work into the sync
context).

The code was doing an update dance: 1) update service config to add new
cluster, 2) update config selector to use new cluster, 3) update service
config to remove old clusters. But the onResult() wasn't being processed
immediately, so the actual execution order was 2, 1, 3 which has a small
window where RPCs will fail. But onResult2() does run immediately. And
since ca4819ac6, updateBalancingState() updates the picker immediately.

cleanUpRoutes() was also racy because it updated the routingConfig
before swapping to the new config selector, so RPCs could fail saying
there was no route instead of the useful error message. Even with the
opposite order, some RPCs may be executing the while loop of
selectConfig(), trying to acquire a cluster. The code unreffed the
clusters before updating the routingConfig, so those RPCs could go into
a tight loop until the routingConfig was updated. Also, once the
routingConfig was updated to EMPTY those RPCs would similarly
see the wrong error message. To give the correct error message,
selectConfig() must fail such RPCs directly, and once it can do that
there's no need to stop using the config selector in error cases. This
has the benefit of fewer moving parts and more consistent threading
among cases.

The added test was able to detect the race 2% of the time. The slower
the code/machine, the more reliable the test failed. ca4819ac6 along
with this commit reduced it to 0 failures in 1000 runs.

Discovered when investigating b/394850611
2025-03-07 10:33:35 -08:00
.github Replace Kokoro ARM build with GitHub Actions 2025-02-04 10:51:13 -08:00
all all:Add GCP CSM Observability (#11305) 2024-06-21 14:35:39 -07:00
alts alts: Add ClientCall support to AltsContextUtil 2025-01-30 16:10:19 -08:00
android Replace jsr305's GuardedBy with Error Prone's 2025-01-10 08:16:48 -08:00
android-interop-testing interop-testing: Move soak out of AbstractInteropTest 2025-01-14 13:28:10 -08:00
api Replace jsr305's GuardedBy with Error Prone's 2025-01-10 08:16:48 -08:00
auth Re-enable animalsniffer, fixing violations 2024-12-19 07:54:54 -08:00
authz Re-enable animalsniffer, fixing violations 2024-12-19 07:54:54 -08:00
benchmarks Fix typo in deprecated blocking stub javadoc. (#11772) 2024-12-26 13:31:34 -08:00
binder Replace jsr305's GuardedBy with Error Prone's 2025-01-10 08:16:48 -08:00
bom use gradle java-platform in grpc-bom; Fixes #5530 (#11875) 2025-02-05 11:10:39 -08:00
buildSrc Upgrade dependencies 2024-07-11 15:09:00 -07:00
buildscripts s2a: Use protos published under com.google.s2a.proto.v2. (#11908) 2025-02-19 16:59:50 -08:00
census Replace jsr305's GuardedBy with Error Prone's 2025-01-10 08:16:48 -08:00
compiler Start 1.72.0 development cycle (#11907) 2025-02-18 19:46:02 +05:30
context api, context: fix bazel build: export api from context and remove context dep from api (#10326) 2023-06-29 13:51:13 -07:00
contextstorage Re-enable animalsniffer, fixing violations 2024-12-19 07:54:54 -08:00
core core: Apply ManagedChannelImpl's updateBalancingState() immediately 2025-03-06 12:31:10 -08:00
cronet Replace jsr305's GuardedBy with Error Prone's 2025-01-10 08:16:48 -08:00
documentation services: Deprecate V1alpha (#11681) 2024-11-12 12:27:40 +05:30
examples Start 1.72.0 development cycle (#11907) 2025-02-18 19:46:02 +05:30
gae-interop-testing gae-interop-testing: Remove duplicate repositories 2025-01-03 09:29:08 -08:00
gcp-csm-observability Re-enable animalsniffer, fixing violations 2024-12-19 07:54:54 -08:00
gcp-observability gcp-observability: Optimize GcpObservabilityTest.enableObservability execution time (#11783) 2025-01-24 16:50:41 +05:30
googleapis Re-enable animalsniffer, fixing violations 2024-12-19 07:54:54 -08:00
gradle s2a: Use protos published under com.google.s2a.proto.v2. (#11908) 2025-02-19 16:59:50 -08:00
grpclb Replace jsr305's GuardedBy with Error Prone's 2025-01-10 08:16:48 -08:00
inprocess Replace jsr305's GuardedBy with Error Prone's 2025-01-10 08:16:48 -08:00
interop-testing Use acceptResolvedAddresses() in easy cases 2025-02-20 21:25:55 -08:00
istio-interop-testing Fix typo in deprecated blocking stub javadoc. (#11772) 2024-12-26 13:31:34 -08:00
netty netty: Per-rpc authority verification against peer cert subject names (#11724) 2025-02-24 20:28:11 +05:30
okhttp netty: Per-rpc authority verification against peer cert subject names (#11724) 2025-02-24 20:28:11 +05:30
opentelemetry Replace jsr305's GuardedBy with Error Prone's 2025-01-10 08:16:48 -08:00
protobuf protobuf: Stabilize marshallerWithRecursionLimit (#11884) 2025-02-07 14:16:13 +05:30
protobuf-lite protobuf: Stabilize marshallerWithRecursionLimit (#11884) 2025-02-07 14:16:13 +05:30
rls rls: allow maxAge to exceed 5m if staleAge is set (#11931) 2025-03-04 10:02:03 +05:30
s2a s2a: Use protos published under com.google.s2a.proto.v2. (#11908) 2025-02-19 16:59:50 -08:00
services Use acceptResolvedAddresses() in easy cases 2025-02-20 21:25:55 -08:00
servlet servlet: Provide Gradle a filter version number 2025-02-14 15:45:44 -08:00
stub stub: Eliminate invalid test cases where different threads were calling close from the thread writing. (#11822) 2025-01-15 10:43:48 -08:00
testing Re-enable animalsniffer, fixing violations 2024-12-19 07:54:54 -08:00
testing-proto Fix typo in deprecated blocking stub javadoc. (#11772) 2024-12-26 13:31:34 -08:00
util Use acceptResolvedAddresses() in easy cases 2025-02-20 21:25:55 -08:00
xds xds: Fix cluster selection races when updating config selector 2025-03-07 10:33:35 -08:00
.bazelignore bazel: ignore examples/ from root WORKSPACE 2018-12-18 14:54:57 -07:00
.bazelrc Upgrade Protobuf Java to 3.22.3 (aka 22.3) 2023-04-17 13:16:20 -07:00
.gitattributes gitattributes: Show diffs for golden generated code 2021-07-02 22:11:40 -07:00
.gitignore bazel: Add support for bzlmod (#11046) 2024-04-04 08:36:55 -07:00
AUTHORS all: update to Apache 2 licence 2017-05-31 13:29:01 -07:00
BUILD.bazel bazel: Use the `artifact` macro for loading maven deps 2024-03-28 14:33:32 -07:00
CODE-OF-CONDUCT.md Update governance, contributing, code of conduct docs (#6171) 2019-09-20 16:28:42 -07:00
COMPILING.md COMPILING.md: Fix small typo 2023-09-14 12:03:20 -07:00
CONTRIBUTING.md CONTRIBUTING.md: Update commit guidelines 2024-08-07 16:34:11 -07:00
GOVERNANCE.md Update governance, contributing, code of conduct docs (#6171) 2019-09-20 16:28:42 -07:00
LICENSE fix LICENSE file (#3107) 2017-06-20 08:52:39 +02:00
MAINTAINERS.md Update MAINTAINERS.md (#11241) 2024-07-24 10:19:10 -07:00
MODULE.bazel s2a: Use protos published under com.google.s2a.proto.v2. (#11908) 2025-02-19 16:59:50 -08:00
NOTICE.txt xds: rollback PGV dependency from using maven artifact to importing proto source 2020-03-27 17:09:27 -07:00
README.md Update README etc to reference 1.70.0 (#11854) 2025-01-24 15:21:14 +05:30
RELEASING.md RELEASING.md: Fix interop_matrix image name (#11653) 2024-10-30 10:59:03 +05:30
SECURITY.md Upgrade netty-tcnative to 2.0.70 2025-02-13 12:41:56 -08:00
WORKSPACE Add `load()` statements for the Bazel builtin top-level java symbols (#11105) 2024-04-17 16:43:21 -07:00
WORKSPACE.bzlmod bazel: Add support for bzlmod (#11046) 2024-04-04 08:36:55 -07:00
build.gradle Start 1.72.0 development cycle (#11907) 2025-02-18 19:46:02 +05:30
codecov.yml Disable codecov comment and changes status 2016-05-01 22:39:12 -07:00
gradlew Bump gradle from 8.3 to 8.5 (#10791) 2024-01-12 16:01:48 -08:00
gradlew.bat Bump gradle from 8.3 to 8.5 (#10791) 2024-01-12 16:01:48 -08:00
java_grpc_library.bzl reorder bazel rule parameters to satisfy CheckBzlFormat (#11118) 2024-04-22 16:14:47 -07:00
repositories.bzl s2a: Use protos published under com.google.s2a.proto.v2. (#11908) 2025-02-19 16:59:50 -08:00
run-test-client.sh Avoid interop build instructions when already built 2018-10-11 17:17:13 -07:00
run-test-server.sh Avoid interop build instructions when already built 2018-10-11 17:17:13 -07:00
settings.gradle Upgrade gradle and gradle plugin versions. (#11906) 2025-02-19 17:25:54 +05:30

README.md

gRPC-Java - An RPC library and framework

Homepage: grpc.io
Mailing List: grpc-io@googlegroups.com

Join the chat at https://gitter.im/grpc/grpc GitHub Actions Linux Testing Line Coverage Status Branch-adjusted Line Coverage Status

Supported Platforms

gRPC-Java supports Java 8 and later. Android minSdkVersion 21 (Lollipop) and later are supported with Java 8 language desugaring.

TLS usage on Android typically requires Play Services Dynamic Security Provider. Please see the Security Readme.

Older Java versions are not directly supported, but a branch remains available for fixes and releases. See gRFC P5 JDK Version Support Policy.

Java version gRPC Branch
7 1.41.x

Getting Started

For a guided tour, take a look at the quick start guide or the more explanatory gRPC basics.

The examples and the Android example are standalone projects that showcase the usage of gRPC.

Download

Download the JARs. Or for Maven with non-Android, add to your pom.xml:

<dependency>
  <groupId>io.grpc</groupId>
  <artifactId>grpc-netty-shaded</artifactId>
  <version>1.70.0</version>
  <scope>runtime</scope>
</dependency>
<dependency>
  <groupId>io.grpc</groupId>
  <artifactId>grpc-protobuf</artifactId>
  <version>1.70.0</version>
</dependency>
<dependency>
  <groupId>io.grpc</groupId>
  <artifactId>grpc-stub</artifactId>
  <version>1.70.0</version>
</dependency>
<dependency> <!-- necessary for Java 9+ -->
  <groupId>org.apache.tomcat</groupId>
  <artifactId>annotations-api</artifactId>
  <version>6.0.53</version>
  <scope>provided</scope>
</dependency>

Or for Gradle with non-Android, add to your dependencies:

runtimeOnly 'io.grpc:grpc-netty-shaded:1.70.0'
implementation 'io.grpc:grpc-protobuf:1.70.0'
implementation 'io.grpc:grpc-stub:1.70.0'
compileOnly 'org.apache.tomcat:annotations-api:6.0.53' // necessary for Java 9+

For Android client, use grpc-okhttp instead of grpc-netty-shaded and grpc-protobuf-lite instead of grpc-protobuf:

implementation 'io.grpc:grpc-okhttp:1.70.0'
implementation 'io.grpc:grpc-protobuf-lite:1.70.0'
implementation 'io.grpc:grpc-stub:1.70.0'
compileOnly 'org.apache.tomcat:annotations-api:6.0.53' // necessary for Java 9+

For Bazel, you can either use Maven (with the GAVs from above), or use @io_grpc_grpc_java//api et al (see below).

Development snapshots are available in Sonatypes's snapshot repository.

Generated Code

For protobuf-based codegen, you can put your proto files in the src/main/proto and src/test/proto directories along with an appropriate plugin.

For protobuf-based codegen integrated with the Maven build system, you can use protobuf-maven-plugin (Eclipse and NetBeans users should also look at os-maven-plugin's IDE documentation):

<build>
  <extensions>
    <extension>
      <groupId>kr.motd.maven</groupId>
      <artifactId>os-maven-plugin</artifactId>
      <version>1.7.1</version>
    </extension>
  </extensions>
  <plugins>
    <plugin>
      <groupId>org.xolstice.maven.plugins</groupId>
      <artifactId>protobuf-maven-plugin</artifactId>
      <version>0.6.1</version>
      <configuration>
        <protocArtifact>com.google.protobuf:protoc:3.25.5:exe:${os.detected.classifier}</protocArtifact>
        <pluginId>grpc-java</pluginId>
        <pluginArtifact>io.grpc:protoc-gen-grpc-java:1.70.0:exe:${os.detected.classifier}</pluginArtifact>
      </configuration>
      <executions>
        <execution>
          <goals>
            <goal>compile</goal>
            <goal>compile-custom</goal>
          </goals>
        </execution>
      </executions>
    </plugin>
  </plugins>
</build>

For non-Android protobuf-based codegen integrated with the Gradle build system, you can use protobuf-gradle-plugin:

plugins {
    id 'com.google.protobuf' version '0.9.4'
}

protobuf {
  protoc {
    artifact = "com.google.protobuf:protoc:3.25.5"
  }
  plugins {
    grpc {
      artifact = 'io.grpc:protoc-gen-grpc-java:1.70.0'
    }
  }
  generateProtoTasks {
    all()*.plugins {
      grpc {}
    }
  }
}

The prebuilt protoc-gen-grpc-java binary uses glibc on Linux. If you are compiling on Alpine Linux, you may want to use the Alpine grpc-java package which uses musl instead.

For Android protobuf-based codegen integrated with the Gradle build system, also use protobuf-gradle-plugin but specify the 'lite' options:

plugins {
    id 'com.google.protobuf' version '0.9.4'
}

protobuf {
  protoc {
    artifact = "com.google.protobuf:protoc:3.25.5"
  }
  plugins {
    grpc {
      artifact = 'io.grpc:protoc-gen-grpc-java:1.70.0'
    }
  }
  generateProtoTasks {
    all().each { task ->
      task.builtins {
        java { option 'lite' }
      }
      task.plugins {
        grpc { option 'lite' }
      }
    }
  }
}

For Bazel, use the proto_library and the java_proto_library (no load() required) and load("@io_grpc_grpc_java//:java_grpc_library.bzl", "java_grpc_library") (from this project), as in this example BUILD.bazel.

API Stability

APIs annotated with @Internal are for internal use by the gRPC library and should not be used by gRPC users. APIs annotated with @ExperimentalApi are subject to change in future releases, and library code that other projects may depend on should not use these APIs.

We recommend using the grpc-java-api-checker (an Error Prone plugin) to check for usages of @ExperimentalApi and @Internal in any library code that depends on gRPC. It may also be used to check for @Internal usage or unintended @ExperimentalApi consumption in non-library code.

How to Build

If you are making changes to gRPC-Java, see the compiling instructions.

High-level Components

At a high level there are three distinct layers to the library: Stub, Channel, and Transport.

Stub

The Stub layer is what is exposed to most developers and provides type-safe bindings to whatever datamodel/IDL/interface you are adapting. gRPC comes with a plugin to the protocol-buffers compiler that generates Stub interfaces out of .proto files, but bindings to other datamodel/IDL are easy and encouraged.

Channel

The Channel layer is an abstraction over Transport handling that is suitable for interception/decoration and exposes more behavior to the application than the Stub layer. It is intended to be easy for application frameworks to use this layer to address cross-cutting concerns such as logging, monitoring, auth, etc.

Transport

The Transport layer does the heavy lifting of putting and taking bytes off the wire. The interfaces to it are abstract just enough to allow plugging in of different implementations. Note the transport layer API is considered internal to gRPC and has weaker API guarantees than the core API under package io.grpc.

gRPC comes with multiple Transport implementations:

  1. The Netty-based HTTP/2 transport is the main transport implementation based on Netty. It is not officially supported on Android. There is a "grpc-netty-shaded" version of this transport. It is generally preferred over using the Netty-based transport directly as it requires less dependency management and is easier to upgrade within many applications.
  2. The OkHttp-based HTTP/2 transport is a lightweight transport based on Okio and forked low-level parts of OkHttp. It is mainly for use on Android.
  3. The in-process transport is for when a server is in the same process as the client. It is used frequently for testing, while also being safe for production use.
  4. The Binder transport is for Android cross-process communication on a single device.