-
Notifications
You must be signed in to change notification settings - Fork 2.1k
[Do Not Merge] Defensive mechanism for lease renewal #46875
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
This reverts commit 2115e36.
* add cfp logs * react to comments * react to comments * react to comments * react to comments * add log line for release errors
…edRangeCacheRefresh [Spark]SupportSystemPropertyForFeedRangeCacheRefreshInterval
…range read feed (Azure#21) * Added a way to limit prefetch and page size for ReadFeed of PartitionKeyRange. * Added additional logging. * Added additional logging. * Added additional logging. * DOUBLE CHECK IMPACT - comment out feed range refresh interval setting * Addressing review comments. * Addressing review comments. * Addressing review comments. * Addressing review comments. * Addressing review comments. * Disable fault injection CFP test. * Addressing review comments.
…eshInterval fixTests
…geCacheForCFP AddWireup using partition key range cache for cfp
…zure#23) * Added a way to limit prefetch and page size for ReadFeed of PartitionKeyRange. * Added additional logging. * Added additional logging. * Added additional logging. * DOUBLE CHECK IMPACT - comment out feed range refresh interval setting * Addressing review comments. * Addressing review comments. * Addressing review comments. * Addressing review comments. * Addressing review comments. * Disable fault injection CFP test. * Addressing review comments. * Revert Spark test fixes.
…Planning-dev improvePerfDuringPartitionPlanning
|
/azp run java - cosmos - spark |
|
Azure Pipelines successfully started running 1 pipeline(s). |
2 similar comments
|
Azure Pipelines successfully started running 1 pipeline(s). |
|
Azure Pipelines successfully started running 1 pipeline(s). |
| } | ||
|
|
||
| return this.partitionKeyRangeCache.tryLookupAsync(BridgeInternal.getMetaDataDiagnosticContext(request.requestContext.cosmosDiagnostics), documentCollectionValueHolder.v.getResourceId(), null, null) | ||
| StringBuilder sb = new StringBuilder("RxDocumentClientImpl.createDocumentInternal:").append(","); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I do not think we want to check in the log change in master, maybe have one PR only includes the defensive mechanism change?
|
/azp run java - cosmos - tests |
|
/azp run java - cosmos - kafka |
|
/azp run java - cosmos - spark |
|
Azure Pipelines successfully started running 1 pipeline(s). |
2 similar comments
|
Azure Pipelines successfully started running 1 pipeline(s). |
|
Azure Pipelines successfully started running 1 pipeline(s). |
|
/azp run java - cosmos - tests |
|
Azure Pipelines successfully started running 1 pipeline(s). |
1 similar comment
|
Azure Pipelines successfully started running 1 pipeline(s). |
|
/azp run java - cosmos - kafka |
|
Azure Pipelines successfully started running 1 pipeline(s). |
|
/azp run java - cosmos - spark |
|
Azure Pipelines successfully started running 1 pipeline(s). |
Description
Change feed processor will now stop renewing a lease if after 25 * the lease renewal interval there haven't been any results processed. This should allow for another worker to pick up this lease.
Implementation
PartitionSupervisorImpl already has the logic for stopping the renew and processing threads for a partition for exceptions. This was extended to stop both the processing and renewing threads when a change hasn't being processed after 25 * the lease renewal interval. The last processed time tracked is taking after we receive a response from change feed.