Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Preparation for] remove channels on 7th November 2024 #3650

Draft
wants to merge 112 commits into
base: master
Choose a base branch
from

Conversation

benclifford
Copy link
Collaborator

@benclifford benclifford commented Oct 23, 2024

Preparation for implementing #3515 on 7th November 2024

This PR is some preparation for flushing out issues - accompanied by many companion PRs which do not need to wait until 7th November.

Changed Behaviour

Channel configurations, even configurations to the default LocalChannel, will break.

Inherited unix environments (from parent process) are inherited differently: execution will now use the environment at time of execution, rather than time of LocalChannel initialization.

Type of change

  • Code maintenance/cleanup

benclifford added a commit that referenced this pull request Oct 23, 2024
This is part of staged removal of channels - see issue #3515 and PR #3650.
benclifford added a commit that referenced this pull request Oct 24, 2024
This is part of staged removal of channels - see issue #3515 and PR #3650.

Co-authored-by: Kevin Hunter Kesling <kevin@globus.org>
Conflicts:
	parsl/channels/base.py
	parsl/channels/local/local.py
	parsl/providers/cluster_provider.py
	parsl/providers/condor/condor.py
	parsl/providers/grid_engine/grid_engine.py
	parsl/providers/lsf/lsf.py
	parsl/providers/pbspro/pbspro.py
	parsl/providers/slurm/slurm.py
	parsl/providers/torque/torque.py
	parsl/tests/test_providers/test_local_provider.py
 Conflicts:
	docs/reference.rst
	parsl/channels/base.py
	parsl/channels/errors.py
	parsl/channels/local/local.py
	parsl/dataflow/dflow.py
	parsl/tests/test_channels/test_local_channel.py
 Conflicts:
	docs/userguide/plugins.rst
	parsl/channels/base.py
	parsl/channels/local/local.py
	parsl/tests/test_providers/test_pbspro_template.py
	parsl/tests/test_providers/test_slurm_template.py
 Conflicts:
	parsl/channels/local/local.py
	parsl/dataflow/dflow.py
This has been a basically dead code path since removal of non-remote
channels:

Either a user chooses to not move files (overriding move_files to False)
and the push_file was not used.

Or the default push_file was used, but:
* this is always LocalChannel now (PR #3677)
* the script directory is always the local script directory (PR #3688)
and so the local channel code always skips making a copy

This commit simplies all of that away into using the script path directly
with putting it through the above complicated no-op.
Conflicts:
	parsl/providers/slurm/slurm.py
Conflicts:
	parsl/channels/base.py
	parsl/channels/local/local.py
	parsl/providers/local/local.py
Conflicts:
	parsl/channels/base.py
	parsl/channels/local/local.py
	parsl/providers/local/local.py
Conflicts:
parsl/channels/base.py
parsl/channels/local/local.py
parsl/tests/test_channels/test_large_output.py
parsl/tests/test_channels/test_local_channel.py
parsl/utils.py
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant