Add a guide page about the ParslPoolExecutor #4035
Open
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
A few other grammar/style fixes too: avoiding the 2nd-person, not repeating a word within the same paragraph.
benclifford
reviewed
Dec 2, 2025
|
|
||
| 3. *No Multiprocessing Objects*: Tools such as the :class:`multiprocessing.Queue` and | ||
| `synchronization primitives <https://docs.python.org/3/library/multiprocessing.html#synchronization-primitives>`_ | ||
| may not work in Parsl without specific configuration of the :class:`multiprocessing.Manager`. |
Collaborator
There was a problem hiding this comment.
I would simplify this to those objects will not work.
if you want to overlay your own self-constructed comms network using however you want, then so be it but you don't need to be tricked into thinking that's a good idea in this intro guide.
benclifford
reviewed
Dec 2, 2025
| The core concept of workflows is that Parsl Apps produce **Futures** | ||
| with all features from those in Python's :mod:`concurrent.futures` module and more. | ||
|
|
||
| The Parsl programs must contain a ``parsl.load`` statement to start |
Collaborator
There was a problem hiding this comment.
not true, if you're passing in a config like with ParslPoolExecutor(config=config) as pool: ?
Contributor
Author
There was a problem hiding this comment.
Yep. That need fixing
benclifford
reviewed
Dec 2, 2025
| workflow | ||
| exceptions | ||
| lifted_ops | ||
| logging |
Collaborator
There was a problem hiding this comment.
this is from your adjacent PR I think and doesn't belong here?
Contributor
Author
There was a problem hiding this comment.
Oops. Yea, I messed up my commits
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Expands the documentation about the
concurrent.futures.Executor-based interface to Parsl (ParslPoolExecutor).I've been using this more lately and had a conversation with @jan-janssen about it. So, it's probably past time we introduce it to users more clearly.
Changed Behaviour
Expands the documentation
Fixes
N/A
Type of change