HackerTrans
TopNewTrendsCommentsPastAskShowJobs

mscolnick

no profile record

Submissions

Show HN: WASM-powered codespaces for Python notebooks on GitHub

docs.marimo.io
204 points·by mscolnick·anno scorso·27 comments

Visualizing text embeddings with MotherDuck and marimo

motherduck.com
3 points·by mscolnick·2 anni fa·0 comments

Transform a repository of Python notebooks into a collection of data apps

marimo.io
1 points·by mscolnick·2 anni fa·0 comments

Building AI chatbots with marimo, Python, and ell

marimo.io
1 points·by mscolnick·2 anni fa·0 comments

Marimo notebooks bring Vega-Altair charts to life

marimo.io
1 points·by mscolnick·2 anni fa·0 comments

Taming randomness in ML models with hypothesis testing and marimo

blog.mozilla.ai
54 points·by mscolnick·2 anni fa·7 comments

Package reproducibility in Python notebooks using uv isolated environments

marimo.io
37 points·by mscolnick·2 anni fa·14 comments

Sandbox Python notebooks with uv and marimo

github.com
4 points·by mscolnick·2 anni fa·3 comments

Build Marimo Plugins with Anywidget

marimo.io
2 points·by mscolnick·2 anni fa·1 comments

comments

mscolnick
·3 mesi fa·discuss
team effort, but this awesome goes to Trevor
mscolnick
·3 mesi fa·discuss
How do you teach the model to use this new API? Wouldn't they be more effective just using the polars/pandas API which is has been well trained with?
mscolnick
·3 mesi fa·discuss
This is cool. Do you still use this? There has been ideas thrown around to add "prompt" cells to marimo that can similarly create outputs or downstream cells and the prompts are serialized to the notebook py file and part of the DAG.
mscolnick
·11 mesi fa·discuss
it would be awesome if this embedded marimo notebooks that run on WebAssembly (via https://marimo.app/)
mscolnick
·anno scorso·discuss
1. marimo
mscolnick
·anno scorso·discuss
It wasn't included in the blog, but marimo also supports a markdown format, in case you're interested:

    marimo edit notebook.md
mscolnick
·anno scorso·discuss
The parent comment wasn't fully correct. marimo doesn't store outputs in the notebook file, but it does have many ways outputs are stored alongside the notebook, or remotely if you'd like: HTML, ipynb, pickle
mscolnick
·anno scorso·discuss
It may be preferable to create a variable tied to a UI element that can be used as a toggle to view each analysis.

choice = mo.ui.dropdown(['train', 'split')

data = load(choice.value)

processed = process(data)

visualize(processed)

This way, you can toggle between just more than two if needed. If you need to see both at once, you'd want to refactor the processing and visualizing step into functions, and then just duplicate the finals cell(s).

marimo has a multi-column mode, so you can view them side-by-side
mscolnick
·anno scorso·discuss
The default "store" is a local FileStore. In your case, it will save the outputs to a file on disk called `my_cache`.

We plan to add more stores like Redis, S3-bucket, or an external server, since you may not always want to commit this file, but like you said want others to avoid the computation.
mscolnick
·anno scorso·discuss
> One design decision they made is that outputs are not stored

This is not quite true. Outputs are not stored...in the Python file*. marimo does store outputs in the `/__marimo__` folder with settings enabled.

> writing the boiler plate to let the reader load the results.

Therea are some primitives to do this for you, such as mo.persistent_cache. This can be an annotation or 'with' block. It intelligently knows when either the source code or inputs change.

The plan is to take this one step further than storing just the output. Because marimo knows the dependencies of each cell, in a future version, it will store each output AND let you know which are stale based on code changes. This is being built by Dylan (from the blog) and inspired by Nix.
mscolnick
·anno scorso·discuss
Looks awesome! big fans of pyodide, congrats on the launch
mscolnick
·anno scorso·discuss
You might be interested in marimo [1], which does not store your outputs in the notebook artifact. Also the files are stored at pure-python instead of json, which LLMs much prefer / easier for them to parse.

[1]: https://github.com/marimo-team/marimo
mscolnick
·anno scorso·discuss
Thanks for sharing these resources
mscolnick
·anno scorso·discuss
It is much smaller than that, Pyodide is only 2.8mb and the Python stdlib is 2.3mb when zipped
mscolnick
·anno scorso·discuss
Yea, this can be hosted on GitHub pages without any vendor infra (no marimo.app)

These are two separate features:

1) marimo.app + github.com/path/to/nb.ipynb does run on marimo.app infra. this is what the Show HN was about

2) separately, you can use the marimo CLI to export assets to deploy to GitHub page: `marimo export html-wasm notebook.py -o output_dir --mode run` which can then can be uploaded to GH pages. This does not find all the data in your repo, so you would need to stick any data you was to access in a /public folder for your site. More docs here: https://docs.marimo.io/guides/exporting/?h=marimo+export+htm...
mscolnick
·2 anni fa·discuss
it’s already possible to do this: marimo export script nb.py

Pure-python also helps to work with existing tools out of the box: formatting, linting, pytest, importing notebooks as modules, composition, PEP 723 inline metadata
mscolnick
·2 anni fa·discuss
this sort of hackery to work with jupyter notebooks is exactly why we are building marimo (https://github.com/marimo-team/marimo). this should not be the standard
mscolnick
·2 anni fa·discuss
marimo has a playground to run notebooks via WebAssembly - similar to Bento - without having to deploy yourself: https://marimo.app/
mscolnick
·2 anni fa·discuss
We would like to make this configurable via a setting so you don't need to pass it through the CLI every time. And I agree, maybe a tooltip/notification to nudge them in that direction.

We would also like to auto-detect a pyproject.toml, and use that when desired.
mscolnick
·2 anni fa·discuss
uv + marimo lets you run Python notebooks in a sandboxed environment.

This increases reproducibility and helps prevent environment pollution. If your notebook has inline script metadata, marimo will automatically install the enumerated packages before running the notebook; if it doesn't, marimo will prompt you to install the missing packages on notebook startup.