Skip to content

fix(direct path verification): Updating direct path enforcement strategy#4635

Merged
abhishek10004 merged 2 commits into
masterfrom
abhishek/directpath_fix
Apr 21, 2026
Merged

fix(direct path verification): Updating direct path enforcement strategy#4635
abhishek10004 merged 2 commits into
masterfrom
abhishek/directpath_fix

Conversation

@abhishek10004
Copy link
Copy Markdown
Collaborator

@abhishek10004 abhishek10004 commented Apr 21, 2026

Description

Updating the direct path enforcement strategy:

  • For zonal buckets, log direct path verification status but do not block client creation on it
  • For non-zonal buckets, block grpc client creation on direct path verification status. In case of failure in detecting direct path status, fallback to http client would happen based on the set grpc-strategy

Also, updated the timeout to 15 seconds for direct path verification

Link to the issue in case of a bug fix.

Testing details

  1. Manual - Done
  2. Unit tests - NA
  3. Integration tests - Done

Any backward incompatible change? If so, please explain.

@abhishek10004 abhishek10004 requested a review from a team as a code owner April 21, 2026 07:34
@abhishek10004 abhishek10004 added the execute-integration-tests Run only integration tests label Apr 21, 2026
@github-actions github-actions Bot added the remind-reviewers Auto remind reviewers in attention set for review post 24hrs of inactivity on PR. label Apr 21, 2026
@gemini-code-assist
Copy link
Copy Markdown
Contributor

Summary of Changes

Hello, I'm Gemini Code Assist1! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed!

This pull request refines the direct path enforcement strategy for storage client creation. It introduces conditional logic to handle zonal versus non-zonal buckets differently, ensuring that zonal buckets do not block client creation upon verification failure, while non-zonal buckets maintain strict enforcement. Additionally, the verification timeout has been significantly increased to improve the reliability of the detection process.

Highlights

  • Direct Path Enforcement: Updated the enforcement strategy to allow non-blocking verification for zonal buckets, while enforcing blocking behavior for non-zonal buckets.
  • Timeout Adjustment: Increased the direct path verification timeout from 1 millisecond to 15 seconds to ensure reliable detection.
Using Gemini Code Assist

The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.

Invoking Gemini

You can request assistance from Gemini at any point by creating a comment using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands on the current page.

Feature Command Description
Code Review /gemini review Performs a code review for the current pull request in its current state.
Pull Request Summary /gemini summary Provides a summary of the current pull request in its current state.
Comment @gemini-code-assist Responds in comments when explicitly tagged, both in pull request comments and review comments.
Help /gemini help Displays a list of available commands.

Customization

To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.

Limitations & Feedback

Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for GitHub and other Google products, sign up here.

Footnotes

  1. Review the Privacy Notices, Generative AI Prohibited Use Policy, Terms of Service, and learn how to configure Gemini Code Assist in GitHub here. Gemini can make mistakes, so double check it and use code with caution.

Copy link
Copy Markdown
Contributor

@gemini-code-assist gemini-code-assist Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request increases the DirectPath detection timeout to 15 seconds and makes DirectPath verification failures fatal for regional buckets. The review feedback identifies an inconsistency between the new timeout and the maximum retry duration that could lead to premature cancellation, suggests refining log messages to correctly reflect the execution flow when verification fails, and recommends removing a redundant parameter in the gRPC client creation logic.

Comment thread internal/storage/storage_handle.go
Comment thread internal/storage/storage_handle.go
Comment thread internal/storage/storage_handle.go Outdated
@codecov
Copy link
Copy Markdown

codecov Bot commented Apr 21, 2026

Codecov Report

❌ Patch coverage is 42.85714% with 4 lines in your changes missing coverage. Please review.
✅ Project coverage is 83.66%. Comparing base (b426baf) to head (635f77f).
⚠️ Report is 7 commits behind head on master.

Files with missing lines Patch % Lines
internal/storage/storage_handle.go 42.85% 3 Missing and 1 partial ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##           master    #4635      +/-   ##
==========================================
+ Coverage   83.62%   83.66%   +0.04%     
==========================================
  Files         164      164              
  Lines       20278    20279       +1     
==========================================
+ Hits        16958    16967       +9     
+ Misses       2678     2673       -5     
+ Partials      642      639       -3     
Flag Coverage Δ
unittests 83.66% <42.85%> (+0.04%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
Comment thread internal/storage/storage_handle.go Outdated
Comment thread internal/storage/storage_handle.go
@abhishek10004 abhishek10004 merged commit 24c54ca into master Apr 21, 2026
15 checks passed
@abhishek10004 abhishek10004 deleted the abhishek/directpath_fix branch April 21, 2026 12:37
vadlakondaswetha pushed a commit that referenced this pull request Apr 23, 2026
…egy (#4635)

Updating the direct path enforcement strategy:

- For zonal buckets, log direct path verification status but do not block client creation on it
- For non-zonal buckets, block grpc client creation on direct path verification status. In case of failure in detecting direct path status, fallback to http client would happen based on the set grpc-strategy

Also, updated the timeout to 15 seconds for direct path verification.
PranjalC100 pushed a commit that referenced this pull request Apr 24, 2026
…egy (#4635)

Updating the direct path enforcement strategy:

- For zonal buckets, log direct path verification status but do not block client creation on it
- For non-zonal buckets, block grpc client creation on direct path verification status. In case of failure in detecting direct path status, fallback to http client would happen based on the set grpc-strategy

Also, updated the timeout to 15 seconds for direct path verification.
PranjalC100 added a commit that referenced this pull request Apr 29, 2026
* feat: making direct-path verification non-fatal until dummy-stat calls becomes reliable (#4628)

* feat: add skipDirectPathEnforcement parameter to createGRPCClientHandle to allow conditional DirectPath enforcement

* chore: increase directPathDetectionTimeout from 10 seconds to 5 minutes

* simplifying a bit

* making direct-path verification non-fatal

* removing the timeout from the client creation

* minor change

* removing empty line

* fix(buffered_reader): Fixing a memory leak in buffered reader (#4638)

Fixes a memory leak in the buffered reader code during multi-block reads. Previously, if an initial block downloaded successfully but a later block failed (triggering a fallback), the reference counts on the successfully downloaded blocks were never decremented. This PR addresses the leak by catching gcsx.FallbackToAnotherReader errors and calling a new releaseInflightBlocks helper to immediately invoke callbacks and release references for any in-flight blocks.

* fix(direct path verification): Updating direct path enforcement strategy (#4635)

Updating the direct path enforcement strategy:

- For zonal buckets, log direct path verification status but do not block client creation on it
- For non-zonal buckets, block grpc client creation on direct path verification status. In case of failure in detecting direct path status, fallback to http client would happen based on the set grpc-strategy

Also, updated the timeout to 15 seconds for direct path verification.

* feat(dp-check): removing older cp check utility (#4494)

* feat(dp-check): removing older cp check utility

* validation package is already disabled hence removing the skip

---------

Co-authored-by: Prince Kumar <princer@google.com>
Co-authored-by: Abhishek Gupta <abhishekmgupta@google.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

execute-integration-tests Run only integration tests remind-reviewers Auto remind reviewers in attention set for review post 24hrs of inactivity on PR.

2 participants