Trying to use the inline plotting, I'm using kitty.

Here's the code:

% matplotlib inline
import matplotlib.pyplot as plt
plt.plot([1, 2, 3, 4])
plt.ylabel('some numbers')
plt.show()

This will immediately exit to the terminal and print the following strace

  File "/Users/yingzhu/miniconda3/envs/python38/lib/python3.8/site-packages/prompt_toolkit/layout/containers.py", line 716, in write_to_screen
    c.write_to_screen(
  File "/Users/yingzhu/miniconda3/envs/python38/lib/python3.8/site-packages/euporie/scroll.py", line 115, in write_to_screen
    self.to_draw = self.arrange_children(write_position)
  File "/Users/yingzhu/miniconda3/envs/python38/lib/python3.8/site-packages/euporie/scroll.py", line 426, in arrange_children
    size = self.get_child_size(i, refresh=True)
  File "/Users/yingzhu/miniconda3/envs/python38/lib/python3.8/site-packages/euporie/scroll.py", line 392, in get_child_size
    size = container.preferred_height(
  File "/Users/yingzhu/miniconda3/envs/python38/lib/python3.8/site-packages/prompt_toolkit/layout/containers.py", line 795, in preferred_height
    return self.content.preferred_height(width, max_available_height)
  File "/Users/yingzhu/miniconda3/envs/python38/lib/python3.8/site-packages/prompt_toolkit/layout/containers.py", line 325, in preferred_height
    dimensions = [
  File "/Users/yingzhu/miniconda3/envs/python38/lib/python3.8/site-packages/prompt_toolkit/layout/containers.py", line 326, in <listcomp>
    c.preferred_height(width, max_available_height) for c in self._all_children
  File "/Users/yingzhu/miniconda3/envs/python38/lib/python3.8/site-packages/prompt_toolkit/layout/containers.py", line 2625, in preferred_height
    return self.content.preferred_height(width, max_available_height)
  File "/Users/yingzhu/miniconda3/envs/python38/lib/python3.8/site-packages/prompt_toolkit/layout/containers.py", line 571, in preferred_height
    sizes = self._divide_widths(width)
  File "/Users/yingzhu/miniconda3/envs/python38/lib/python3.8/site-packages/prompt_toolkit/layout/containers.py", line 632, in _divide_widths
    dimensions = [c.preferred_width(width) for c in children]
  File "/Users/yingzhu/miniconda3/envs/python38/lib/python3.8/site-packages/prompt_toolkit/layout/containers.py", line 632, in <listcomp>
    dimensions = [c.preferred_width(width) for c in children]
  File "/Users/yingzhu/miniconda3/envs/python38/lib/python3.8/site-packages/prompt_toolkit/layout/containers.py", line 316, in preferred_width
    dimensions = [c.preferred_width(max_available_width) for c in self.children]
  File "/Users/yingzhu/miniconda3/envs/python38/lib/python3.8/site-packages/prompt_toolkit/layout/containers.py", line 316, in <listcomp>
    dimensions = [c.preferred_width(max_available_width) for c in self.children]
  File "/Users/yingzhu/miniconda3/envs/python38/lib/python3.8/site-packages/euporie/output.py", line 124, in preferred_width
    return self.content.preferred_width(*args, **kwargs)

Exception 'TextArea' object has no attribute 'preferred_width'

Some setup info:

❯ kitty --version
kitty 0.19.3 created by Kovid Goyal
❯ pip list | rg prompt-toolkit
prompt-toolkit                3.0.18
❯ pip list | rg matplot
matplotlib                    3.4.2
matplotlib-inline             0.1.2
❯ uname -a
Darwin MacBook-Air-4 20.3.0 Darwin Kernel Version 20.3.0: Mon Dec  7 22:03:58 PST 2020; root:xnu-7195.80.16.111.1~1/RELEASE_ARM64_T8101 arm64
❯ pip list | rg euporie
euporie                       0.1.9
❯ pip list | rg ipython
ipython                       7.16.0
ipython-genutils              0.2.0
ptipython                     1.0.1
❯ python --version
Python 3.8.6

When I use my mouse to left click-and-drag the scrollbar in Euporie Notebook, the scrolling is very irregular. Additionally, when I release the left mouse button, the scroll bar sometimes continues to be dragged with the vertical motion of my mouse; an additional click on the scrollbar seems to remove this effect.

The versions of software I am using, as well as a GIF that demonstrates my issue, are included below.

• euporie 2.0.7
• Python 3.10.4
• Ubuntu 22.04
• gnome-terminal 3.44.0

Would it be possible to implement (1) a menu entry that refresh the notebook (i.e. reload it from file) and (2) a feature that continuously monitor the notebook file for changes, and if there are changes, automatically reload it?

The use case is: I edit the notebook in plain vim with the percentage format, and then convert it back to notebook format with jupytext.

I know euporie has vim keybindings, but I have a whole ecosystem in vim which goes beyond keybindings (custom keybindings, plugins, etc.), so I would like to edit the notebook in plain vim, and update it with jupytext.

It would be great if euporie could refresh the notebook automatically.

I've tried euporie on WSL (with Ubuntu) and it works. Now I need to use it on Windows because my python package (arcpy) is just running on Windows. I installed it via pipx on Windows but cannot configure it with a non-default kernel. Is it something you can help?

my existing kernels:

C:\Users\asharaf>jupyter kernelspec list
Available kernels:
  python3    C:\Users\asharaf\AppData\Local\ESRI\conda\envs\arcgispro-py3-clone\share\jupyter\kernels\python3
  xpython    C:\Users\asharaf\AppData\Local\ESRI\conda\envs\arcgispro-py3-clone\share\jupyter\kernels\xpython

euporie configuration file:

PS C:\Users\asharaf\AppData\Local\euporie> cat .\config.json
{
  "color_scheme": "dark",
  "syntax_theme": "native",
  "notebook": {
    "expand": false,
    "always_show_tab_bar": true,
    "show_cell_borders": false,
    "kernel_connection_file": "C:\Users\asharaf\AppData\Local\ESRI\conda\envs\arcgispro-py3-clone\share\jupyter\kernels\python3\kernel.json",
    "kernel_name": "python3"
  },
  "console": {
    "color_scheme": "default",
    "syntax_theme": "dracula"
  },
  "preview": {
    "show_cell_borders": true
  }
}

euporie log:

Hi, Can someone give me a config file example for euporie notebook for non-default kernel name and kernel connection file? I am using it on Windows and can't connect to an existing kernel in a python venv.

C:\Users\asharaf>jupyter kernelspec list
Available kernels:
  python3    C:\Users\asharaf\AppData\Local\ESRI\conda\envs\arcgispro-py3-clone\share\jupyter\kernels\python3
  xpython    C:\Users\asharaf\AppData\Local\ESRI\conda\envs\arcgispro-py3-clone\share\jupyter\kernels\xpython

While playing with your euporie browser example I saw that you do a low quality prerendering of graphics while they are not fully in viewport, and once they are fully in the viewport, switch to better quality with sixel.

This currently raises 3 issues:

• low UX, as peeps first see a blurry preview like thingy
• issues with overly big graphics not fitting into the viewport - no chance to get nice quality output here at all?
• (blurry preview still has cell width issues, at least in the browser variant)

Thus I wonder if it would be feasible to do partial sixel rendering.

Now the main issue with sixels is - it is very expensive to convert the original image into sixel in the first place, as it needs quantization and dithering. So ideally one want to do that only once and cache the result. On the other hand the advanced image algos needed for sixel conversion kinda make pre-slicing the original image into line parts and separately convert to sixel a no-go, as the created color palettes and dithering pattern are not stable (would lead to ugly stitching artefacts).

A possible solution to all those downsides would be a sixel-cropping library, eg.:

• create full sixel repr of the original image
• crop into that sixel as needed (pull pixel area WxH with needed colors)
• print the cropped part

A more involved solution would be to write own sixel converter capable to freeze the color palette, and do the substitution on slices of the original image. This would need one initial quantization step creating a color substitution map with dithering marks. With that slices can be created pretty fast and memory efficient. (I suggested something similar here for the julia peeps, as they are keen to code such a thingy on their own).

So I wonder if you are interested in such an enhancement for sixel output. In general I'd lean more towards to the sixel-crop library idea, which should be straight forward to implement.

Howdy!

I'm really loving the direction euporie is headed. One small request would be to allow customization of the cursor depending on the editing mode. Many people who use modal text editors (e.g., Vim, but not trying to flame any wars) configure their editors to change the cursor shape depending on the mode. For instance, I use a block cursor for command mode and a vertical bar for insert mode (as well as an underline for replace mode, but the former is way more important).

This could be done easily by allowing the user to set a string that may contain escape sequences that is emitted during mode changes, akin to Readline's vi-ins-mode-string and vi-cmd-mode-string. This would also enable further creative uses.

If you'd be willing to provide some pointers to spots in the codebase, I'd be happy to attempt an implementation.

Thanks again for your awesome work!

First off: absolutely stoked to see this project - comes so close to my ideal workflow that I got very excited brainstorming additional suggestions. Thanks a ton!

Right now, my jupyter TUI workflow is essentially using Neovim on a left kitty split and ptipython on the right side (i.e. ptpython using the ipython shell. This works surprisingly well for everything (and works across every language, too, just need a REPL). Here's some ideas coming from that.

There is a couple of niceties that ptpython does that would be absolutely fantastic to have in euporie

1) improved vim mode:

ptpython allows you to use vim on an individual input cell. right now to my understanding euporie only allows it on a notebook level, however this basically forces me to use e for every simple edit, which is kind of disturbing to the workflow since I have to do e -> <edit thing> -> :x -> ctrl-r.

Cooler would be if it would be solved like in the jupyterlab vim extension where single escape gets you to normal mode in a jupyter notebook level and shift escape or double escape gets you to vim mode on a notebook level. Another way to remove friction here is to make a write of the temp file executes the respective cell, so we could at least get rid of the last ctrl-r (by the time of write I'm pretty committed to executing it so the ctrl-r feels superfluous).

It would also be helpful to make sure that the tempfile has the right filetype (e..g use .py ending to make sure the editor filetype recognition works and you have LSP etc available)

2) function signatures and other advanced features (or even LSP support)?

3) autosuggestion

4) completion while typing

(3/4 look something like this in practice)

5) Variable viewer

Like the jupyterlab equivalent

This is such a cool app! Thank you for this! :)

I tried to run it in iterm2 using Python 3.11.0 on macOS Ventura (13.0.1) after running:

python -m pip install --user euporie
euporie-notebook

And it launches, but when I do CTRL+n to create a new notebook, it unfortunately gives an error:

I can't select the ? in that image, but I can select copy traceback, which doesn't do anything immediately, but if I hit CTRL+q, it prints the following traceback

2022-12-01 08:24:02 CRITICAL Uncaught exception     euporie.core.log.handle_exception:421
Traceback (most recent call last):
    File "/Users/friend/Library/Python/3.11/bin/euporie-notebook", line 8, in <module>
      sys.exit(main())
               ^^^^^^
    File "/Users/friend/Library/Python/3.11/lib/python/site-packages/euporie/notebook/__main__.py", line 8, in main
      __main__.main(__name__.split(".")[1])
    File "/Users/friend/Library/Python/3.11/lib/python/site-packages/euporie/core/__main__.py", line 10, in main
      return entry.load().launch()
             ^^^^^^^^^^^^^^^^^^^^^
    File "/Users/friend/Library/Python/3.11/lib/python/site-packages/euporie/core/app.py", line 534, in launch
      return cls().run()
             ^^^^^^^^^^^
   File "/Users/friend/Library/Python/3.11/lib/python/site-packages/prompt_toolkit/application/application.py",
  line 978, in run    return loop.run_until_complete(
             ^^^^^^^^^^^^^^^^^^^^^^^^
   File
  "/usr/local/Cellar/[email protected]/3.11.0/Frameworks/Python.framework/Versions/3.11/lib/python3.11/asyncio/base_event…
  , line 650, in run_until_complete    return future.result()
             ^^^^^^^^^^^^^^^
   File "/Users/friend/Library/Python/3.11/lib/python/site-packages/prompt_toolkit/application/application.py",
  line 891, in run_async    await self.cancel_and_wait_for_background_tasks()
   File "/Users/friend/Library/Python/3.11/lib/python/site-packages/euporie/core/app.py", line 832, in
  cancel_and_wait_for_background_tasks    for task in self.background_tasks:
                  ^^^^^^^^^^^^^^^^^^^^^
  AttributeError: 'NotebookApp' object has no attribute 'background_tasks'

I also tried uninstalling with pip and then reinstalling with pipx, but got the same error and traceback:

2022-12-01 08:40:32 CRITICAL Uncaught exception
euporie.core.log.handle_exception:421
Traceback (most recent call last):
              File "/Users/friend/.local/bin/euporie", line 8, in <module>
                sys.exit(main())
                         ^^^^^^
             File
            "/Users/friend/.local/pipx/venvs/euporie/lib/python3.11/site-packages/euporie…
            , line 10, in main    return entry.load().launch()
                       ^^^^^^^^^^^^^^^^^^^^^
             File
            "/Users/friend/.local/pipx/venvs/euporie/lib/python3.11/site-packages/euporie…
            , line 32, in launch    main(app)
             File
            "/Users/friend/.local/pipx/venvs/euporie/lib/python3.11/site-packages/euporie…
            , line 10, in main    return entry.load().launch()
                       ^^^^^^^^^^^^^^^^^^^^^
             File
            "/Users/friend/.local/pipx/venvs/euporie/lib/python3.11/site-packages/euporie…
            , line 534, in launch    return cls().run()
                       ^^^^^^^^^^^
             File
            "/Users/friend/.local/pipx/venvs/euporie/lib/python3.11/site-packages/prompt_…
            , line 978, in run    return loop.run_until_complete(
                       ^^^^^^^^^^^^^^^^^^^^^^^^
             File
            "/usr/local/Cellar/[email protected]/3.11.0/Frameworks/Python.framework/Versions/3.…
            , line 650, in run_until_complete    return future.result()
                       ^^^^^^^^^^^^^^^
             File
            "/Users/friend/.local/pipx/venvs/euporie/lib/python3.11/site-packages/prompt_…
            , line 891, in run_async    await self.cancel_and_wait_for_background_tasks()
             File
            "/Users/friend/.local/pipx/venvs/euporie/lib/python3.11/site-packages/euporie…
            , line 832, in cancel_and_wait_for_background_tasks    for task in self.
            background_tasks:                ^^^^^^^^^^^^^^^^^^^^^
            AttributeError: 'NotebookApp' object has no attribute 'background_tasks'

Thank you for this awesome tool! I love the Vim-like keybindings of Euporie.

While using Euporie, I sometimes mistakenly delete cells, but could not find a way to recover.

It would be great if Euporie has "Undo Delete Cells" feature similar to Jupyter.

Alternatively, it would be also helpful to have an option to back up the deleted cells in the tmp directory (e.g. /tmp/euporie_deleted_cell_2022-12-30T23:59:59.py) so that users can recover later.

Is it a known limitation in Alacritty terminal that can't render the images well?

I don't know anything about sixel and not sure if is usable on Windows. I installed timg in my python env and it broke it.

Hi,

I would like to add a keybinding to run all cells.

The doc says:

This parameter takes the form of a mapping, where they keys are references to modes or components to which a set of key-bindings apply, and the values are mapping of command names to lists of keys. Key bindings set in the configuration will entirely over-ride the default binding, so if you want to add an additional binding for a command while retaining the default, you will need to include the default binding in the configuration.

1. Where do I find, in the doc, the list of valid "command names"?
2. How do I "include the default binding in the configuration"?

Command line: euporie-notebook --kernel-name=ir 2_matching.ipynb

Config file:

{
  "app": {
    "edit_mode": "vi",
    "line_numbers": false
  },
  "notebook": {
    "edit_mode": "vi",
    "line_numbers": true,
	"autocomplete": true,
	"autosuggest": true,
	"autoinspect": true,
	"log_file": "[MY HOME DIRECTORY]/Documents/euporie.log",
	"log_level": "debug"
  }
}

Trying to run two very simple lines (can't yank in system clipboard):

The execution never ends, the * is shown in the cell forever.

From the logs it looks like it times out waiting for kernel response:

2022-12-23 09:31:07 DEBUG   [euporie.core.terminal.send:115] Sending query '\x1b]10;?\x1b\\\x1b]11;?\x1b\\\x1b]4;0;?\x1b\\\x1b]4;1;?\x1b\\\x1b]4;2;?\x1b\\\x1b]4;3;?\x1b\\\x1b]4;4;?\x1b\\\x1b]4;5;?\x1b\\\x1b]4;6;?\x1b\\\x1b]4;7;?\x1b\\\x1b]4;8;?\x1b\\\x1b]4;9;?\x1b\\\x1b]4;10;?\x1b\\\x1b]4;11;?\x1b\\\x1b]4;12;?\x1b\\\x1b]4;13;?\x1b\\\x1b]4;14;?\x1b\\\x1b]4;15;?\x1b\\' for Colors
2022-12-23 09:31:07 DEBUG   [euporie.core.terminal.send:115] Sending query '\x1b[14t' for PixelDimensions
2022-12-23 09:31:07 DEBUG   [euporie.core.terminal.send:115] Sending query '\x1b[c' for SixelGraphicsStatus
2022-12-23 09:31:07 DEBUG   [euporie.core.terminal.send:115] Sending query '\x1b[s\x1b_Gi=4294967295,s=1,v=1,a=q,t=d,f=24;AAAA\x1b\\\x1b[u\x1b[2K' for KittyGraphicsStatus
2022-12-23 09:31:07 DEBUG   [euporie.core.terminal.send:115] Sending query '\x1b[>q' for ItermGraphicsStatus
2022-12-23 09:31:07 DEBUG   [euporie.core.terminal.send:115] Sending query '\x1b[?1016$p' for SgrPixelStatus
2022-12-23 09:31:07 DEBUG   [euporie.core.terminal._handle_response:98] Got terminal response for 'Colors'
2022-12-23 09:31:07 DEBUG   [euporie.core.terminal._handle_response:98] Got terminal response for 'Colors'
2022-12-23 09:31:07 DEBUG   [euporie.core.terminal._handle_response:98] Got terminal response for 'Colors'
2022-12-23 09:31:07 DEBUG   [euporie.core.terminal._handle_response:98] Got terminal response for 'Colors'
2022-12-23 09:31:07 DEBUG   [euporie.core.terminal._handle_response:98] Got terminal response for 'Colors'
2022-12-23 09:31:07 DEBUG   [euporie.core.terminal._handle_response:98] Got terminal response for 'Colors'
2022-12-23 09:31:07 DEBUG   [euporie.core.terminal._handle_response:98] Got terminal response for 'Colors'
2022-12-23 09:31:07 DEBUG   [euporie.core.terminal._handle_response:98] Got terminal response for 'Colors'
2022-12-23 09:31:07 DEBUG   [euporie.core.terminal._handle_response:98] Got terminal response for 'Colors'
2022-12-23 09:31:07 DEBUG   [euporie.core.terminal._handle_response:98] Got terminal response for 'Colors'
2022-12-23 09:31:07 DEBUG   [euporie.core.terminal._handle_response:98] Got terminal response for 'Colors'
2022-12-23 09:31:07 DEBUG   [euporie.core.terminal._handle_response:98] Got terminal response for 'Colors'
2022-12-23 09:31:07 DEBUG   [euporie.core.terminal._handle_response:98] Got terminal response for 'Colors'
2022-12-23 09:31:07 DEBUG   [euporie.core.terminal._handle_response:98] Got terminal response for 'Colors'
2022-12-23 09:31:07 DEBUG   [euporie.core.terminal._handle_response:98] Got terminal response for 'Colors'
2022-12-23 09:31:07 DEBUG   [euporie.core.terminal._handle_response:98] Got terminal response for 'Colors'
2022-12-23 09:31:07 DEBUG   [euporie.core.terminal._handle_response:98] Got terminal response for 'Colors'
2022-12-23 09:31:07 DEBUG   [euporie.core.terminal._handle_response:98] Got terminal response for 'Colors'
2022-12-23 09:31:07 DEBUG   [euporie.core.terminal._handle_response:98] Got terminal response for 'KittyGraphicsStatus'
2022-12-23 09:31:07 DEBUG   [euporie.core.terminal._handle_response:98] Got terminal response for 'ItermGraphicsStatus'
2022-12-23 09:31:07 DEBUG   [euporie.core.terminal._handle_response:98] Got terminal response for 'SgrPixelStatus'
2022-12-23 09:31:07 INFO    [euporie.core.app.open_file:554] Opening file 2_matching.ipynb
2022-12-23 09:31:07 DEBUG   [euporie.core.tabs.notebook.__init__:78] Loading notebooks [PATH TO MY NOTEBOOK]
2022-12-23 09:31:07 DEBUG   [euporie.core.kernel.start_:260] Starting kernel
2022-12-23 09:31:07 DEBUG   [euporie.core.kernel.start_:287] Started kernel
2022-12-23 09:31:07 DEBUG   [euporie.core.kernel.start_:306] Waiting for kernel to become ready
2022-12-23 09:31:08 DEBUG   [euporie.core.tabs.notebook.run_cell:298] Queuing running of cell 0
2022-12-23 09:31:08 DEBUG   [euporie.core.kernel.start_:315] Kernel b96350a1-c5ab-4d4c-a722-6a0d651c9a4e ready
2022-12-23 09:31:08 DEBUG   [euporie.core.kernel.poll:363] Waiting for shell messages
2022-12-23 09:31:08 DEBUG   [euporie.core.kernel.poll:363] Waiting for iopub messages
2022-12-23 09:31:08 DEBUG   [euporie.core.kernel.poll:363] Waiting for stdin messages
2022-12-23 09:31:08 DEBUG   [euporie.core.tabs.base.kernel_started:178] Running 1 kernel tasks
2022-12-23 09:31:08 DEBUG   [euporie.core.kernel.history_:803] Timed out waiting for kernel info response

1. here it says that "configuration options are listed below", but nothing is listed
2. here it talks about the configuration file, but it is not explained what are the valid configuration options. My understanding is that they are the same as the command line options, but (1) without the -- at the start, (2) with - in the middle substituted with _ (e.g. the --color-scheme command line options becomes the color_scheme config file option), and (3) command line options that don't take parameters are boolean options in the config file. I think we should write that.

Changing Cell's Type has incorrect description . It is explaining how to close notebook instead of how to change cell's type. Corresponding file in repo. Maybe we can add good first issue