Get help from the marimo community

Home
Members
lucharo
l
lucharo
Offline, last seen 2 weeks ago
Joined November 25, 2024
Hi, I work with kedro at work. Kedro is a framework to build DS/ML pipelines, I don't love it but it's what my company uses and I think we can make it work, it's pretty customisable at least.

Kedro is very geared towards jupyter notebook users. They rely on magic command to load special kedro variables such as the catalog, conf file, etc. I use to love magic when I got to know jupyter but nowadays I really don't like anymore.

The point is, this magic makes some variables available in the global namespace so that the user doesn't have to worry about loading the right config/catalog. This seems like a patchy fix, because to be honest, they don't have a robust solution to load these files from a simple python script or for example marimo notebook. They also have special commands kedro jupyter lab and kedro jupyter notebook that "inject" these variables for the user before hand. See a thread of the issues with Kedro configs + marimo here: https://kedro-org.slack.com/archives/C03RKP2LW64/p1736872610928369

I wonder if it'd be possible to have a similar kedro marimo edit command to integrate marimo into this framework.

PS: With all the work you've done on data flows and DAGs I think you actually are in a prime position to create a clean ML pipeline framework, would love to hear your thoughts on that. @Akshay @Myles Scolnick
5 comments
M
l
As you can see in the picture attached from my notebook data flow the cell where I create my DB connection is not linked to the SQL cell below it. This is to be expected because these two cells don't share variables but at the same is wrong because these cells depend on each other for execution. I don't know what a good solution for this is at the moment.

I think I suggested in another post to have a DB connection tab on the left side menu, this wouldn't solve this particular issue but might be beneficial. @Myles Scolnick
13 comments
M
l
Plain Text
➜ ~/projects/nbs git:(lcr-mer-772) ✗ VPN ✓
$ head -n 2 zon.py                                                                 16:21:45
# /// script
# requires-python = ">=3.11"
➜ ~/projects/nbs git:(lcr-mer-772) ✗ VPN ✓
$ uv run marimo run --sandbox zon.py                                               16:21:47
warning: No `requires-python` value found in the workspace. Defaulting to `>=3.12`.


I am a bit confused at this warning message, I have defined a valid requires-python attribute yet this is happening.

On another front, is it incorrect to use sandboxes the way I am doing it? i.e. using uv run before the marimo call?
12 comments
M
l
Do you recommend using a global marimo installation or a per-environment marimo installation?
4 comments
M
l
J
https://docs.marimo.io/api/caching.html

Or would I need to turn it into a python cell then run it?
1 comment
l
I know this isn't a uv community but the marimo one but I know there are a lot of big uv fans here. I am little confused about some elements of uv, can somebody enlighten me please?

https://github.com/astral-sh/uv/issues/9219
1 comment
l