Changes

This is a record of all past pytask-parallel releases and what went into them in reverse chronological order. Releases follow semantic versioning and all releases are available on PyPI and Anaconda.org.

0.5.0 - 2024-xx-xx

  • #85 simplifies code since loky is a dependency.

  • #86 adds support for dask.

  • #88 updates handling Traceback.

  • #89 restructures the package.

  • #92 redirects stdout and stderr from processes and loky and shows them in error reports.

  • #93 adds documentation on readthedocs.

  • #94 implements ParallelBackend.NONE as the default backend.

  • #95 formalizes parallel backends and apply wrappers for backends with threads or processes automatically.

  • #96 handles local paths with remote executors. PathNodes are not supported as dependencies or products (except for return annotations).

  • #99 changes that all tasks that are ready are being scheduled. It improves interactions with adaptive scaling. #98 does handle the resulting issues: no strong adherence to priorities, no pending status.

  • #100 adds project management with rye.

  • #101 adds syncing for local paths as dependencies or products in remote environments with the same OS.

  • #106 fixes #99 such that only when there are coiled functions, all ready tasks are submitted.

  • #107 removes status from pytask_execute_task_log_start hook call.

0.4.1 - 2024-01-12

  • #72 moves the project to pyproject.toml.

  • #75 updates the release strategy.

  • #79 add tests for Jupyter and fix parallelization with PythonNodes.

  • #80 adds support for partialed functions.

  • #82 fixes testing with pytask v0.4.5.

0.4.0 - 2023-10-07

  • #62 deprecates Python 3.7.

  • #64 aligns pytask-parallel with pytask v0.4.0rc2.

  • #66 deactivates parallelization for dry-runs.

  • #67 fixes parallelization with partialed task functions.

  • #68 raises more informative error message when breakpoint() was uses when parallelizing with processes or loky.

0.3.1 - 2023-05-27

  • #56 refactors the ProcessPoolExecutor.

  • #57 does some housekeeping.

  • #59 sets the default backend to ProcessPoolExecutor even when loky is installed.

0.3.0 - 2023-01-23

  • #50 deprecates INI configurations and aligns the package with pytask v0.3.

  • #51 adds ruff and refurb.

0.2.1 - 2022-08-19

  • #43 adds docformatter.

  • #44 allows to capture warnings from subprocesses. Fixes #41.

  • #45 replaces the delay command line option with an internal, dynamic parameter. Fixes #41.

  • #46 adds a dynamic sleep duration during the execution. Fixes #42.

0.2.0 - 2022-04-15

0.1.1 - 2022-02-08

  • #30 removes unnecessary content from tox.ini.

  • #33 skips concurrent CI builds.

  • #34 deprecates Python 3.6 and adds support for Python 3.10.

0.1.0 - 2021-07-20

  • #19 adds conda-forge to the README.rst.

  • #22 add note that the debugger cannot be used together with pytask-parallel.

  • #24 replaces versioneer with setuptools-scm.

  • #25 aborts build and prints reports on KeyboardInterrupt.

  • #27 enables rich tracebacks from subprocesses.

0.0.8 - 2021-03-05

  • #17 fixes the unidentifiable version.

0.0.7 - 2021-03-04

  • #14 fixes some post-release issues.

  • #16 add dependencies to setup.py and changes the default backend to loky.

0.0.6 - 2021-02-27

  • #12 replaces all occurrences of n_processes with n_workers.

  • #13 adds a license, versioneer, and allows publishing on PyPI.

0.0.5 - 2020-12-28

  • #5 fixes the CI and other smaller issues.

  • #8 aligns pytask-parallel with task priorities in pytask v0.0.11.

  • #9 enables –max-failures. Closes #7.

  • #10 releases v0.0.5.

0.0.4 - 2020-10-30

  • #4 implement an executor with loky.

0.0.3 - 2020-09-12

  • #3 align the program with pytask v0.0.6.

0.0.2 - 2020-08-12

  • #1 prepares the plugin for pytask v0.0.5.

  • #2 better parsing and callbacks.

0.0.1 - 2020-07-17

  • Initial commit which combined the whole effort to release v0.0.1.