-
Notifications
You must be signed in to change notification settings - Fork 3
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Add initial library and config
- Loading branch information
Showing
45 changed files
with
12,180 additions
and
1 deletion.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,44 @@ | ||
name: Publish | ||
|
||
on: | ||
release: | ||
types: [published] | ||
|
||
permissions: | ||
contents: read | ||
|
||
jobs: | ||
publish: | ||
runs-on: ubuntu-latest | ||
|
||
strategy: | ||
matrix: | ||
python-version: ['3.8'] | ||
|
||
steps: | ||
- uses: actions/checkout@v3 | ||
with: | ||
# See https://github.com/actions/checkout/issues/261 | ||
ref: ${{ github.event.pull_request.head.sha }} | ||
fetch-depth: 0 | ||
- name: Set up Python ${{ matrix.python-version }} | ||
uses: actions/setup-python@v4 | ||
with: | ||
python-version: ${{ matrix.python-version }} | ||
- name: Install dependencies | ||
run: | | ||
python -m pip install --upgrade build twine | ||
- name: Create packages | ||
run: python -m build | ||
- name: Run twine check | ||
run: twine check dist/* | ||
# - name: Publish distribution 📦 to Test PyPI | ||
# uses: pypa/gh-action-pypi-publish@release/v1 | ||
# with: | ||
# password: ${{ secrets.TEST_PYPI_API_TOKEN }} | ||
# repository_url: https://test.pypi.org/legacy/ | ||
- name: Publish distribution 📦 to PyPI | ||
if: startsWith(github.ref, 'refs/tags') | ||
uses: pypa/gh-action-pypi-publish@release/v1 | ||
with: | ||
password: ${{ secrets.PYPI_API_TOKEN }} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,78 @@ | ||
# See: | ||
# - https://github.com/ymyzk/tox-gh-actions/tree/master/.github/workflows | ||
name: Test | ||
|
||
on: | ||
push: | ||
branches: [main] | ||
pull_request: | ||
branches: [main] | ||
|
||
permissions: | ||
contents: read | ||
|
||
jobs: | ||
# Run pytest and linters | ||
test: | ||
runs-on: ${{ matrix.platform }} | ||
|
||
strategy: | ||
fail-fast: false | ||
matrix: | ||
# See https://help.github.com/articles/virtual-environments-for-github-actions | ||
platform: | ||
- ubuntu-latest | ||
- macos-latest | ||
- windows-latest | ||
python-version: ['3.7', '3.8', '3.9', '3.10', '3.11', 'pypy-3.8'] | ||
|
||
steps: | ||
- uses: actions/checkout@v3 | ||
if: ${{ ! startsWith(matrix.python-version, 'pypy-') }} | ||
- uses: actions/checkout@v1 | ||
if: ${{ startsWith(matrix.python-version, 'pypy-') }} | ||
# Using actions/checkout@v2 or later with pypy causes an error | ||
# (see https://foss.heptapod.net/pypy/pypy/-/issues/3640) | ||
- name: Set up Python ${{ matrix.python-version }} | ||
uses: actions/setup-python@v4 | ||
with: | ||
python-version: ${{ matrix.python-version }} | ||
- name: Install dependencies | ||
run: | | ||
python -m pip install --upgrade setuptools pip wheel | ||
python -m pip install tox-gh-actions | ||
- name: Test with tox | ||
run: tox | ||
|
||
# Test building and publishing | ||
# See: | ||
# - https://packaging.python.org/en/latest/guides/publishing-package-distribution-releases-using-github-actions-ci-cd-workflows/ | ||
# - https://packaging.python.org/en/latest/tutorials/packaging-projects/ | ||
# - https://www.seanh.cc/2022/05/21/publishing-python-packages-from-github-actions/ | ||
publish-test: | ||
runs-on: ubuntu-latest | ||
|
||
needs: [test] | ||
|
||
strategy: | ||
matrix: | ||
python-version: ['3.8'] | ||
|
||
steps: | ||
- uses: actions/checkout@v3 | ||
with: | ||
# See https://github.com/actions/checkout/issues/261 | ||
ref: ${{ github.event.pull_request.head.sha }} | ||
# Grab entire history for setuptools_scm | ||
fetch-depth: 0 | ||
- name: Set up Python ${{ matrix.python-version }} | ||
uses: actions/setup-python@v4 | ||
with: | ||
python-version: ${{ matrix.python-version }} | ||
- name: Install dependencies | ||
run: | | ||
python -m pip install --upgrade build twine | ||
- name: Create packages | ||
run: python -m build | ||
- name: Run twine check | ||
run: twine check dist/* |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,7 @@ | ||
*.pyc | ||
build | ||
dist | ||
*.egg-info | ||
.tox | ||
version.py | ||
*.ipynb_checkpoints |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1 +1,107 @@ | ||
# leda | ||
# leda | ||
|
||
Generate static reports with interactive widgets from Jupyter notebooks | ||
|
||
[![PyPI version](https://badge.fury.io/py/leda.svg)](https://badge.fury.io/py/leda) | ||
[![PyPI Supported Python Versions](https://img.shields.io/pypi/pyversions/leda.svg)](https://pypi.python.org/pypi/leda/) | ||
[![GitHub Actions (Tests)](https://github.com/ansatzcapital/leda/workflows/Test/badge.svg)](https://github.com/ansatzcapital/leda) | ||
|
||
## Quick Start | ||
|
||
Generate a static HTML report from a Jupyter notebook: | ||
|
||
```bash | ||
python -m leda /path/to/nb.ipynb --output-dir ./outputs/ | ||
|
||
# Optional args: | ||
python -m leda /path/to/nb.ipynb --output-dir ./outputs/ \ | ||
-i "abc = 123" -k "other_kernel" --cell-timeout 100 | ||
``` | ||
|
||
This will automatically include formatting tweaks, including, e.g., hiding all input code. | ||
|
||
`-i` (`--inject`) is used to inject user code via a new cell prepended to the notebook during generation. | ||
|
||
Think of it like [`voila`](https://voila.readthedocs.io/en/stable/using.html) | ||
or [nbviewer](https://nbviewer.org/) but with widgets. | ||
|
||
**Note**: `leda` assumes that all code is run in a trusted environment, so please be careful. | ||
|
||
### Interaction/Widgets | ||
|
||
`leda` provides an `%%interact` [magic](https://ipython.readthedocs.io/en/stable/interactive/magics.html) | ||
that makes it easy to create outputs based on widgets, like: | ||
|
||
```python | ||
%%interact mult0=[1,2,3],mult1=[10,100,1000] | ||
df = pd.DataFrame({"a": [1, 2, 3]}) * mult0 * mult1 | ||
df.plot(title=f"Foo: {mult0}, {mult1}") | ||
``` | ||
|
||
There are two types of interact modes: dynamic and static. Dynamic mode is when you're running the Jupyter notebook | ||
live, in which case you will re-compute the cell output every time you select a different `mult`. | ||
|
||
In a static mode (using whichever static widget backend is configured), the library will pre-compute | ||
all possible combinations of widget states ([see Cartesian product](https://en.wikipedia.org/wiki/Cartesian_product)) | ||
and then render a static HTML report that contains widgets that look and feel like the dynamic widgets | ||
(despite being pre-rendered). | ||
|
||
### Report Web UI Server | ||
|
||
Unlike [`voila`](https://voila.readthedocs.io/en/stable/using.html), because all report output is **static HTML**, | ||
you can stand up a report web UI server that suits your needs very easily. That means: | ||
- It's trivial to set up in many cases. | ||
- It's as scalable as your web server. | ||
- It's more cost-efficient because there are no runtimes whatsoever. | ||
- You don't have to worry about old versions no longer working due to code or data changes, so the historical | ||
archive of old reports never expire or change or break. | ||
|
||
For example, you can generate the report to a file, upload that file to a shared location, and then stand | ||
up a bare-bones `nginx` server to serve the files. (Instead of having a two-step of generation + upload, | ||
you could alternatively implement your own `leda.gen.base.ReportPublisher` and create a generation script of your own). | ||
|
||
### Params | ||
|
||
Reports can be parametrized so that the user can set different values for each report run. | ||
|
||
In the notebook, just use `leda.get_param()`: | ||
|
||
```python | ||
data_id = leda.get_param("data_id", dynamic_default=1, static_default=2) | ||
``` | ||
|
||
And then change the injected code during each run: | ||
|
||
```bash | ||
python -m leda /path/to/nb.ipynb --output ./outputs/ -i "data_id = 100" | ||
``` | ||
|
||
### Modular | ||
|
||
`leda` is built to work with multiple visualization and widget libraries. | ||
|
||
Works with these visualization libraries: | ||
- [`matplotlib`](https://matplotlib.org/) | ||
- [`plotly`](https://plotly.com/python/) | ||
|
||
With the default dynamic widget library: | ||
- [`ipywidgets`](https://ipywidgets.readthedocs.io/en/stable/) | ||
|
||
And with these static widget libraries: | ||
- [`static_ipywidgets`](https://github.com/jakevdp/ipywidgets-static) (vendored and modified) | ||
- [`panel`](https://panel.holoviz.org/) | ||
|
||
## Testing | ||
|
||
See the `requirements-bundle*.txt` for version bundles that we currently test manually. | ||
|
||
he most important next task for leda development would be to | ||
(1) automate testing generating reports (reports may contain many random | ||
strs that don't affect the output but make it impossible to do a simple `diff`), and (2) expand | ||
the number of bundles being tested (especially to the newer versions). | ||
|
||
(All of these bundles will be tested against Linux/macOS/Windows and various python versions.) | ||
|
||
## Known Issues | ||
|
||
- Not all widget states of `matplotlib` update when using `panel` static interact mode: https://github.com/holoviz/panel/issues/1222 |
Oops, something went wrong.