This pull request fixes and modernized the approach to deploying/packaging PyQt5 with Pyinstaller. Please provide feedback! The primary approach is explained in qt.py -- read the comments there.

This works on Windows and Linux. Mac seems to work except for QtWebEngine. @tallforasmurf and any other Mac experts, please provide help! The latest Travis error is Could not find QtWebEngineProcess -- see hook-PyQt5.QtWebEngineWidgets.py, where I assume the following line is wrong:

datas += [(os.path.join(q_library_info['DataPath'], 'lib', 'QtWebEngineCore.framework', 'Helpers', 'QtWebEngineProcess.app', 'Contents', 'MacOS', 'QtWebEngineProcess'), os.path.join('PyQt5', 'Qt', 'lib', 'QtWebEngineCore.framework', 'Helpers', 'QtWebEngineProcess.app', 'Contents', 'MacOS')),]

This pull request preserves the order in which modules are imported by the user application. Because that is both needful and good.

Specifically, a new public lib.modulegraph.modulegraph.Node.order attribute – guaranteed to monotonically increase on every module importation and hence provide a reliable means of comparing importation order – is added. (Tested and working, you may be sure.)

This low-level machinery partially fixes #1367. Hooks may now test the order in which two hypothetical modules foo and bar were initially imported as follows:

from PyInstaller.utils.hooks.hookutils import logger

def hook(mod):
    if mod.graph.findNode('foo').order < mod.graph.findNode('bar').order:
        logger.debug('Module "foo" imported before module "bar". Why? I dunno.')
    else:
        logger.debug('Module "bar" imported before module "foo". Suck it, you.')

    return mod

What About #1367? Why You No Fix, Huh?

Would someone (...hey, no names: @htgoebel) mind posting a minimal-length example (MLE) demonstrating the exact issue of #1367?

While I do have the Python 2 version of wxPython locally installed, I'm unsure how to properly replicate this issue. I know; it's probably trivial. I'm feeble-brained, but hard-working. As soon as I get an MLE, I'll append a commit to this pull request fixing #1367 in entirety.

What Else? There's Always Something Else

wxPython's Python 2 version (referred to as "Classic") and Python 3 version (referred to as "Phoenix") appear to be very dissimilar – to the point of actually being different projects that confusingly share the same name. Our import hooks should probably account for these differences in ways I cannot possibly fathom.

Thus spaketh Walt.

Apple just unveiled their M1 chip yesterday and that got me thinking about the impact it will have on PyInstaller and the apps packaged with it.

Will this require a complete rewrite of the way PyInstaller functions or there's an alternative to it.

Edit: Note

This pull request does not include a compiled version of the bootloader. If you want to test this PR, you have to recompile the bootloader. Please follow the instructions in the official PyInstaller documentation here. Please make sure that you build for your architecture (64- or 32bit). To test the recompiled bootloader and this feature, please run the automatic test, instructions can be found here. The test is called test_pyi_splash

If you are running a splashscreen-enable bootloader and have bundled resources for it (i.e. you have used a Splash build target), you should see a message similar to SPLASH: Found splash screen resources. in the console of the bootloader. If you do not see such a message, please confirm that you have compiled the correct bootloader and used the Splash build target accordingly. Details on how to use this feature can be found in the documentation, which you also need to recompile. To compile the documentation, please follow these instructions.

Original post

So, following on #4581 now a new implementation of the splash screen based on Tcl/Tk (the same library that tkinter uses). The idea of the splash screen came from #4354.

This change implements a splash screen based on Tcl/Tk, which is bundled by PyInstaller at compile time. The splash screen is now (unlike #4581) able to show the progress when unpacking a one-file archive.

The bootloader extracts the necessary files in onefile mode and starts a minimal Tcl/Tk environment in which a script is executed that starts the splash screen. Although this feature is platform independent, I have only tested it on Windows.

For the communication between Python and the splash screen the pyi_splash Python module is (again) bundled as fake modules. This has not changed much compared to #4581.

Of course I will add documentation/changelog in the next days and squash/reword the commits.

I'm not able to get multiprocessing to work in spawn mode on macOS when using pyinstaller. The following script runs fine in the interpreter, but when using pyinstaller it enters an infinite recursive loop that keeps starting new processes.

I'm using Python 3 from Anaconda (Python 3.5.2 |Continuum Analytics, Inc.| (default, Jul 2 2016, 17:52:12) ), on macOS 10.12.2, with the development version of pyinstaller (3.3.dev0+483c819).

import sys
from multiprocessing import freeze_support, set_start_method, Process

def test():
    print('In subprocess')

if __name__ == '__main__':
    print(sys.argv,)
    freeze_support()
    set_start_method('spawn')

    print('In main')
    proc = Process(target=test)
    proc.start()
    proc.join()

PyInstaller: 3.0.dev8 Python: 3.5.0 64bit Platform: Windows-10.0.10240

Freezing any code in this environment output some warnings: https://gist.githubusercontent.com/AcidWeb/aa423c3f402cb86f1806/raw/d0bc853ffe262a4dfccef9febf0fac0b086aa458/gistfile1.txt

This is output of pyinstaller test.py where test.py is empty file(!).

Download latest version of MSYS2: http://repo.msys2.org/distrib/x86_64/msys2-x86_64-20200629.exe

After install, in an MSYS2 shell (not MinGW) neither of the following work: (1) pacman -S python3-pip pip install https://github.com/pyinstaller/pyinstaller/archive/develop.zip

(2) pacman -S mingw-w64-x86_64-python-pip pip install https://github.com/pyinstaller/pyinstaller/archive/develop.zip

Both fail at the install with the following error:

ERROR: Command errored out with exit status 1: command: /usr/bin/python3.exe /usr/lib/python3.8/site-packages/pip/_vendor/pep517/_in_process.py build_wheel /tmp/tmp_ucc0221 cwd: /tmp/pip-req-build-ls4kydx6 Complete output (4 lines): running bdist_wheel running build running build_bootloader Your platform is not yet supported. Please define constant PYDYLIB_NAMES for your platform.

ERROR: Failed building wheel for pyinstaller Failed to build pyinstaller ERROR: Could not build wheels for pyinstaller which use PEP 517 and cannot be installed directly

This is the exact same issue as the one below answered by Dan Yeaw: https://github.com/pyinstaller/pyinstaller/issues/4570

And according to him, PyInstaller should work on Python3.8: https://stackoverflow.com/questions/54728231/how-to-fix-pyinstaller-in-msys2-mingw-your-platform-is-not-yet-supported

Am I missing something...?

latest Anaconda 2 64bit (4.4.0) python 2.7.13 PyQt 5.6.0 pyinstaller 3.4.dev0+g162fe92d

When I try to freeze this minimalized example with pyinstaller:

from PyQt5 import QtWidgets
import sys
if __name__ == "__main__":
    app = QtWidgets.QApplication(sys.argv)
    print 'app loaded'

The resulting executable is throwing

This application failed to start because it could not find or load the Qt platform plugin "windows"
in "".

In the DIST Folder PyInstaller is in fact providing the Qt dlls:

...\DIST\minimalized\PYQT5
└───Qt
    └───plugins
        ├───iconengines
        │       qsvgicon.dll
        │
        ├───imageformats
        │       qdds.dll
        │       qgif.dll
        │       qicns.dll
        │       qico.dll
        │       qjpeg.dll
        │       qsvg.dll
        │       qtga.dll
        │       qtiff.dll
        │       qwbmp.dll
        │       qwebp.dll
        │
        ├───platforms
        │       qminimal.dll
        │       qoffscreen.dll
        │       qwindows.dll
        │
        └───printsupport
                windowsprintersupport.dll

As far as I can tell, Qt is looking for the libaries at some default paths, rather than in the provided directory. When I add anacondas qt.conf (located at C:\ProgramData\Anaconda2) in the spec file as external file the program is running correctly. The content of the spec file is

[Paths]
Prefix = C:/ProgramData/Anaconda2/Library
Binaries = C:/ProgramData/Anaconda2/Library/bin
Libraries = C:/ProgramData/Anaconda2/Library/lib
Headers = C:/ProgramData/Anaconda2/Library/include/qt

As this file is system specific the resulting exe is not really stand alone. As there is no 1:1 mapping from the present PyQt5 path to the folders in the...\Libary\ path how does a system independend qt.conf file look like? And shouldn't the hook file for PyQt create the qt.conf automatically? Thanks for your support!

On mac PyInstaller doesn't seem to copy Tcl and Tk once both are copied to the folder the error is gone.

module = imp.load_module(fullname, fp, filename, self._c_ext_tuple)
ImportError: dlopen(_tkinter.so, 2): Library not loaded: @loader_path/Tcl
  Referenced from: _tkinter.so
  Reason: image not found

When i compile any script using pyinstaller i get TypeError: an integer is required (got type bytes)

i tried both with and without UPX, still the same error, i even tried installing the latest dev builds and it's still the same error.

Here's the log:

PS C:\Users\sl4v\Desktop\Projects\wikia-download-gui> py -m PyInstaller .\wikia_dl_gui.py --debug=all
104 INFO: PyInstaller: 3.5.dev0+0cbe7fba3
104 INFO: Python: 3.8.0b1
106 INFO: Platform: Windows-10-10.0.17134-SP0
113 INFO: wrote C:\Users\sl4v\Desktop\Projects\wikia-download-gui\wikia_dl_gui.spec
116 INFO: UPX is not available.
118 INFO: Extending PYTHONPATH with paths
['C:\\Users\\sl4v\\Desktop\\Projects\\wikia-download-gui',
 'C:\\Users\\sl4v\\Desktop\\Projects\\wikia-download-gui']
119 INFO: checking Analysis
267 INFO: checking PYZ
267 INFO: Building PYZ because PYZ-00.toc is non existent
268 INFO: Building PYZ (ZlibArchive) C:\Users\sl4v\Desktop\Projects\wikia-download-gui\build\wikia_dl_gui\PYZ-00.pyz
Traceback (most recent call last):
  File "C:\Users\sl4v\AppData\Local\Programs\Python\Python38\lib\runpy.py", line 192, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "C:\Users\sl4v\AppData\Local\Programs\Python\Python38\lib\runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "C:\Users\sl4v\AppData\Local\Programs\Python\Python38\lib\site-packages\PyInstaller\__main__.py", line 118, in <module>
    run()
  File "C:\Users\sl4v\AppData\Local\Programs\Python\Python38\lib\site-packages\PyInstaller\__main__.py", line 111, in run
    run_build(pyi_config, spec_file, **vars(args))
  File "C:\Users\sl4v\AppData\Local\Programs\Python\Python38\lib\site-packages\PyInstaller\__main__.py", line 63, in run_build
    PyInstaller.building.build_main.main(pyi_config, spec_file, **kwargs)
  File "C:\Users\sl4v\AppData\Local\Programs\Python\Python38\lib\site-packages\PyInstaller\building\build_main.py", line 844, in main
    build(specfile, kw.get('distpath'), kw.get('workpath'), kw.get('clean_build'))
  File "C:\Users\sl4v\AppData\Local\Programs\Python\Python38\lib\site-packages\PyInstaller\building\build_main.py", line 791, in build
    exec(code, spec_namespace)
  File "C:\Users\sl4v\Desktop\Projects\wikia-download-gui\wikia_dl_gui.spec", line 18, in <module>
    pyz = PYZ(a.pure, a.zipped_data,
  File "C:\Users\sl4v\AppData\Local\Programs\Python\Python38\lib\site-packages\PyInstaller\building\api.py", line 98, in __init__
    self.__postinit__()
  File "C:\Users\sl4v\AppData\Local\Programs\Python\Python38\lib\site-packages\PyInstaller\building\datastruct.py", line 158, in __postinit__
    self.assemble()
  File "C:\Users\sl4v\AppData\Local\Programs\Python\Python38\lib\site-packages\PyInstaller\building\api.py", line 128, in assemble
    self.code_dict = {
  File "C:\Users\sl4v\AppData\Local\Programs\Python\Python38\lib\site-packages\PyInstaller\building\api.py", line 129, in <dictcomp>
    key: strip_paths_in_code(code)
  File "C:\Users\sl4v\AppData\Local\Programs\Python\Python38\lib\site-packages\PyInstaller\building\utils.py", line 652, in strip_paths_in_code
    consts = tuple(
  File "C:\Users\sl4v\AppData\Local\Programs\Python\Python38\lib\site-packages\PyInstaller\building\utils.py", line 653, in <genexpr>
    strip_paths_in_code(const_co, new_filename)
  File "C:\Users\sl4v\AppData\Local\Programs\Python\Python38\lib\site-packages\PyInstaller\building\utils.py", line 660, in strip_paths_in_code
    return code_func(co.co_argcount, co.co_kwonlyargcount, co.co_nlocals, co.co_stacksize,
TypeError: an integer is required (got type bytes)

Hi,

Im trying build for Raspberry PI 3.

But im getting this error:

Fatal error: PyInstaller does not include a pre-compiled bootloader for your
platform. For more details and instructions how to build the bootloader see
<https://pyinstaller.readthedocs.io/en/stable/bootloader-building.html>

There is any bootloader that work om armv7 and armv8?

Thanks.

Description of the issue

My PySide6-based app will periodically hang straight after launch on macOS Ventura 13.0.1. It doesn't happen every time - probably 1 in 10 or so launches hang. When I run the code unfrozen, it never hangs. I've reproduced the bug using a really minimal example below: just displaying a single message dialog.

Context information (for bug reports)

• Output of pyinstaller --version: 5.7.0

• Version of Python: Python 3.10.9 (v3.10.9:1dd9be6584, Dec 6 2022, 14:37:36) [Clang 13.0.0 (clang-1300.0.29.30)]

• Platform: macOS Ventura 13.0.1

• How you installed Python: From python.org (macOS 64-bit universal2 installer)

• Did you also try this on another platform? Does it work there? Haven't tried yet.

• try the latest development version: Tried latest devel version - hangs still occur.

  • [x] start with clean installation
  • [x] use the latest development version
  • [x] Run your frozen program from a command window (shell) — instead of double-clicking on it

When I run the frozen app from the command line (./dist/HangTest.app/Contents/MacOS/HangTest) it never seems to hang. The hang only occurs when launched from the Finder.

• [x] Package your program in --onedir mode
• [x] Package without UPX, say: use the option --noupx or set upx=False in your .spec-file
• [x] Repackage you application in verbose/debug mode. For this, pass the option --debug to pyi-makespec or pyinstaller or use EXE(..., debug=1, ...) in your .spec file.

A minimal example program which shows the error

hang_test.py

from PySide6 import QtCore, QtWidgets
from PySide6.QtCore import Qt


def main():
    app = QtWidgets.QApplication()
    QtWidgets.QMessageBox.information(None, "Test", "Hello World!")


if __name__ == "__main__":
    main()

hang_test.spec

# -*- mode: python ; coding: utf-8 -*-


#
# Set various parameters
#
app_version = "0.1.0"
onefile = False
block_cipher = None


#
# Main spec file elements
#
a = Analysis(['hang_test.py'],
        binaries=[],
        datas=[],
        hiddenimports=[],
        hookspath=[],
        runtime_hooks=[],
        excludes=[],
        win_no_prefer_redirects=False,
        win_private_assemblies=False,
        cipher=block_cipher,
        noarchive=False
    )

pyz = PYZ(a.pure, a.zipped_data,
            cipher=block_cipher)

exe = EXE(pyz,
        a.scripts,
        a.binaries if onefile else [],
        a.zipfiles if onefile else [],
        a.datas if onefile else [],
        exclude_binaries=not onefile,
        name='HangTest',
        debug=True,
        bootloader_ignore_signals=False,
        strip=False,
        upx=False,
        upx_exclude=[],
        runtime_tmpdir=None,
        console=False,
        disable_windowed_traceback=False,
        argv_emulation=True,
        target_arch='universal2',
        codesign_identity=None,
        entitlements_file=None,
    )
bundle_obj = exe

if not onefile:
    coll = COLLECT(
            exe,
            a.binaries,
            a.zipfiles,
            a.datas,
            strip=False,
            upx=True,
            upx_exclude=[],
            name='HangTest',
        )
    bundle_obj = coll

app = BUNDLE(bundle_obj,
        name='HangTest.app',
        bundle_identifier="app.hangtest",
        info_plist={
            'CFBundleShortVersionString': app_version,
        }
    )

Stacktrace / full error message

Diagnostic Report with stacktrace attached: HangTest_2022-12-27-225244.hang.txt

System:

• OS: Windows 10 Pro
• Python: 3.9.15
• tensorflow-cpu: 2.10.0
• tensorflow-directml-plugin: latest
• pyinstaller: latest (from develop branch)

Error:

Traceback (most recent call last):
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\utils\hooks\__init__.py", line 621, in collect_submodules
    modules, subpackages, on_error = isolated_python.call(_collect_submodules, name, on_error)
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\isolated\_parent.py", line 302, in call
    ok, output = loads(b64decode(self._read_handle.readline()))
EOFError: EOF read where object expected

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<PATH>\anaconda3\envs\direct_ml\lib\runpy.py", line 197, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "<PATH>\anaconda3\envs\direct_ml\lib\runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "<PATH>\anaconda3\envs\direct_ml\Scripts\pyinstaller.exe\__main__.py", line 7, in <module>
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\__main__.py", line 194, in _console_script_run
    run()
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\__main__.py", line 180, in run
    run_build(pyi_config, spec_file, **vars(args))
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\__main__.py", line 61, in run_build
    PyInstaller.building.build_main.main(pyi_config, spec_file, **kwargs)
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\building\build_main.py", line 972, in main
    build(specfile, distpath, workpath, clean_build)
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\building\build_main.py", line 894, in build
    exec(code, spec_namespace)
  File "gpu_test.spec", line 6, in <module>
    a = Analysis(
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\building\build_main.py", line 411, in __init__
    self.__postinit__()
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\building\datastruct.py", line 173, in __postinit__
    self.assemble()
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\building\build_main.py", line 574, in assemble
    priority_scripts.append(self.graph.add_script(script))
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\depend\analysis.py", line 269, in add_script
    self._top_script_node = super().add_script(pathname)
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\lib\modulegraph\modulegraph.py", line 1433, in add_script
    self._process_imports(n)
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\lib\modulegraph\modulegraph.py", line 2850, in _process_imports
    target_modules = self._safe_import_hook(*import_info, **kwargs)
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\depend\analysis.py", line 382, in _safe_import_hook
    return super()._safe_import_hook(target_module_partname, source_module, target_attr_names, level, edge_attr)
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\lib\modulegraph\modulegraph.py", line 2301, in _safe_import_hook
    target_modules = self.import_hook(
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\lib\modulegraph\modulegraph.py", line 1505, in import_hook
    target_package, target_module_partname = self._find_head_package(
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\lib\modulegraph\modulegraph.py", line 1684, in _find_head_package
    target_package = self._safe_import_module(
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\depend\analysis.py", line 429, in _safe_import_module
    return super()._safe_import_module(module_basename, module_name, parent_package)
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\lib\modulegraph\modulegraph.py", line 2062, in _safe_import_module
    self._process_imports(n)
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\lib\modulegraph\modulegraph.py", line 2850, in _process_imports
    target_modules = self._safe_import_hook(*import_info, **kwargs)
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\depend\analysis.py", line 369, in _safe_import_hook
    excluded_imports = self._find_all_excluded_imports(source_module.identifier)
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\depend\analysis.py", line 357, in _find_all_excluded_imports
    excluded_imports.update(module_hook.excludedimports)
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\depend\imphook.py", line 320, in __getattr__
    self._load_hook_module()
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\depend\imphook.py", line 387, in _load_hook_module
    self._hook_module = importlib_load_source(self.hook_module_name, self.hook_filename)
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\compat.py", line 612, in importlib_load_source
    return mod_loader.load_module()
  File "<frozen importlib._bootstrap_external>", line 529, in _check_name_wrapper
  File "<frozen importlib._bootstrap_external>", line 1029, in load_module
  File "<frozen importlib._bootstrap_external>", line 854, in load_module
  File "<frozen importlib._bootstrap>", line 274, in _load_module_shim
  File "<frozen importlib._bootstrap>", line 711, in _load
  File "<frozen importlib._bootstrap>", line 680, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 850, in exec_module
  File "<frozen importlib._bootstrap>", line 228, in _call_with_frames_removed
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\_pyinstaller_hooks_contrib\hooks\stdhooks\hook-tensorflow.py", line 66, in <module>
    hiddenimports = collect_submodules('tensorflow',
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\utils\hooks\__init__.py", line 629, in collect_submodules
    todo.append(subpackage_name)
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\isolated\_parent.py", line 244, in __exit__
    self._write_handle.flush()
OSError: [Errno 22] Invalid argument
Traceback (most recent call last):
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\utils\hooks\__init__.py", line 621, in collect_submodules
    modules, subpackages, on_error = isolated_python.call(_collect_submodules, name, on_error)
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\isolated\_parent.py", line 302, in call
    ok, output = loads(b64decode(self._read_handle.readline()))
EOFError: EOF read where object expected

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<PATH>\anaconda3\envs\direct_ml\lib\runpy.py", line 197, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "<PATH>\anaconda3\envs\direct_ml\lib\runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "<PATH>\anaconda3\envs\direct_ml\Scripts\pyinstaller.exe\__main__.py", line 7, in <module>
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\__main__.py", line 194, in _console_script_run
    run()
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\__main__.py", line 180, in run
    run_build(pyi_config, spec_file, **vars(args))
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\__main__.py", line 61, in run_build
    PyInstaller.building.build_main.main(pyi_config, spec_file, **kwargs)
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\building\build_main.py", line 972, in main
    build(specfile, distpath, workpath, clean_build)
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\building\build_main.py", line 894, in build
    exec(code, spec_namespace)
  File "gpu_test.spec", line 6, in <module>
    a = Analysis(
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\building\build_main.py", line 411, in __init__
    self.__postinit__()
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\building\datastruct.py", line 173, in __postinit__
    self.assemble()
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\building\build_main.py", line 574, in assemble
    priority_scripts.append(self.graph.add_script(script))
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\depend\analysis.py", line 269, in add_script
    self._top_script_node = super().add_script(pathname)
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\lib\modulegraph\modulegraph.py", line 1433, in add_script
    self._process_imports(n)
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\lib\modulegraph\modulegraph.py", line 2850, in _process_imports
    target_modules = self._safe_import_hook(*import_info, **kwargs)
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\depend\analysis.py", line 382, in _safe_import_hook
    return super()._safe_import_hook(target_module_partname, source_module, target_attr_names, level, edge_attr)
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\lib\modulegraph\modulegraph.py", line 2301, in _safe_import_hook
    target_modules = self.import_hook(
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\lib\modulegraph\modulegraph.py", line 1505, in import_hook
    target_package, target_module_partname = self._find_head_package(
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\lib\modulegraph\modulegraph.py", line 1684, in _find_head_package
    target_package = self._safe_import_module(
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\depend\analysis.py", line 429, in _safe_import_module
    return super()._safe_import_module(module_basename, module_name, parent_package)
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\lib\modulegraph\modulegraph.py", line 2062, in _safe_import_module
    self._process_imports(n)
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\lib\modulegraph\modulegraph.py", line 2850, in _process_imports
    target_modules = self._safe_import_hook(*import_info, **kwargs)
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\depend\analysis.py", line 369, in _safe_import_hook
    excluded_imports = self._find_all_excluded_imports(source_module.identifier)
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\depend\analysis.py", line 357, in _find_all_excluded_imports
    excluded_imports.update(module_hook.excludedimports)
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\depend\imphook.py", line 320, in __getattr__
    self._load_hook_module()
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\depend\imphook.py", line 387, in _load_hook_module
    self._hook_module = importlib_load_source(self.hook_module_name, self.hook_filename)
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\compat.py", line 612, in importlib_load_source
    return mod_loader.load_module()
  File "<frozen importlib._bootstrap_external>", line 529, in _check_name_wrapper
  File "<frozen importlib._bootstrap_external>", line 1029, in load_module
  File "<frozen importlib._bootstrap_external>", line 854, in load_module
  File "<frozen importlib._bootstrap>", line 274, in _load_module_shim
  File "<frozen importlib._bootstrap>", line 711, in _load
  File "<frozen importlib._bootstrap>", line 680, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 850, in exec_module
  File "<frozen importlib._bootstrap>", line 228, in _call_with_frames_removed
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\_pyinstaller_hooks_contrib\hooks\stdhooks\hook-tensorflow.py", line 66, in <module>
    hiddenimports = collect_submodules('tensorflow',
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\utils\hooks\__init__.py", line 629, in collect_submodules
    todo.append(subpackage_name)
  File "<PATH>\anaconda3\envs\direct_ml\lib\site-packages\PyInstaller\isolated\_parent.py", line 244, in __exit__
    self._write_handle.flush()
OSError: [Errno 22] Invalid argument

All dependencies log.txt main.spec

Description of the issue

When sending codesign_identity=None to the EXE command, the installer builds and runs fine. When I change the line to codesign_identity="MYCODESIGNIDENTITY", where MYCODESIGNIDENTITY equals the output of security find-identity -v -p codesigning, the build still runs fine, but I get the following output:

rosetta error: /var/db/oah/917482492ec43b48e06e350e9a9aa4e60ce7dd6ad9ad94c6222af10b1e1b9aef/96ed8dde1118dc8c7862ddcc233351816dc66939a23ae532bcfaa54b2f39d3b7/libffi.7.dylib.aot: unable to mmap __TEXT: 1
[1]    21337 trace trap  dist/OpenBBTerminal/OpenBBTerminal

Context information (for bug reports)

• Output of pyinstaller --version: 5.7.0

• Version of Python: 3.9.6

• Platform: macOS: Ventura 13.0.1

• How you installed Python: onda

• Did you also try this on another platform? Does it work there? N/A

• try the latest development version, using the following command:

pip install https://github.com/pyinstaller/pyinstaller/archive/develop.zip

• follow all the instructions in our "If Things Go Wrong" Guide (https://github.com/pyinstaller/pyinstaller/wiki/If-Things-Go-Wrong) and

Make sure everything is packaged correctly

• [x] start with clean installation
• [x] use the latest development version
• [x] Run your frozen program from a command window (shell) — instead of double-clicking on it
• [x] Package your program in --onedir mode
• [x] Package without UPX, say: use the option --noupx or set upx=False in your .spec-file
• [x] Repackage you application in verbose/debug mode. For this, pass the option --debug to pyi-makespec or pyinstaller or use EXE(..., debug=1, ...) in your .spec file.

A minimal example program which shows the error

(paste text here)
“Minimal“ means: remove everything from your code which is not relevant for this bug,
esp. don't use external programs, remote requests, etc.
A very good example is https://gist.github.com/ronen/024cdae9ff2d50488438. This one helped
us reproducing and fixing a quite complex problem within approx 1 hour.

Description of the issue

Our project is trying to move our data files into our module and pyinstaller fails to do handle this on macos because our --name is the same as our one and only module. When I run pyinstaller, I pass --name Foo --add-data=foo/datadir:foo and pyinstaller fails because it has already created Foo in the dist bundle:

Pyinstaller needs to make a directory at '/Users/me/Documents/foo.git/dist/Foo/foo', but there already exists a file at that path!

(If MacOS wasn't case-sensitive, this likely would work because of the capitalization of the app name, but alas)

I've also tried --add-data=foo:foo to add the whole module, but the same problem exists, although the error is slightly different (see below in the stacktrace section).

We are trying to "be good" and use importlib-resources in our app to find the data files by module:

with importlib_resources.as_file(
            importlib_resources.files('foo.datadir')
            .joinpath('datafile')
        ) as d:

I can get data files into the bundle just fine by doing:

--add-data=foo/datadir:datadir

...but importlib won't find them there because of the foo. module scoping.

It seems to me (not knowing much about MacOS app requirements) that these files should be able to go into Resources and importlib should be taught to find them there so that we don't have this conflict. If I mangle the --name I pass to pyinstaller, then it works because there is no conflict, but then my app's "name" in the title bar, app menu, etc is wrong, which is very unfortunate.

If there's something else I can do to work around this that doesn't involve mangling the app name or restructuring out project substantially that would be great. At this point, it seems like I will have to do "importlib.resources or find relative to _ _ file _ _" in our code.

Context information (for bug reports)

• Output of pyinstaller --version: 5.7.0 (also tried from develop.zip per template)
• Version of Python: 3.10.8 (but also repro'd on 3.8
• Platform: MacOS (Monterey and Big Sur)
• How you installed Python: Both platform-provided and brew, same difference
• Did you also try this on another platform? Does it work there? MacOS-specific

Make sure everything is packaged correctly

• [ X ] start with clean installation
• [ X ] use the latest development version
• [ X ] Run your frozen program from a command window (shell) — instead of double-clicking on it
• [ X ] Package your program in --onedir mode
• [ N/A ] Package without UPX, say: use the option --noupx or set upx=False in your .spec-file
• [ N/A ] Repackage you application in verbose/debug mode. For this, pass the option --debug to pyi-makespec or pyinstaller or use EXE(..., debug=1, ...) in your .spec file.

A minimal example program which shows the error

It would need to be a multi-file tree to reproduce this. I could do it, if necessary but I think it's probably clear. Our directory structure looks like this:

project/
  foo.py
  foo/
    somecode1.py
    somecode2.py
    drivers/
      morecode.py
    datadir/
        datafile

And I'm calling pyinstaller like:

pyinstaller --name Foo --add-data=foo/datadir:foo foo.py

Stacktrace / full error message

If I do --add-data=foo/datadir:foo I get this:

Pyinstaller needs to make a directory at '/Users/me/Documents/foo.git/dist/Foo/foo', but there already exists a file at that path!

If I do --add-data=foo:foo I get this:

Traceback (most recent call last):
  File "/opt/homebrew/bin/pyinstaller", line 8, in <module>
    sys.exit(_console_script_run())
  File "/opt/homebrew/lib/python3.10/site-packages/PyInstaller/__main__.py", line 194, in _console_script_run
    run()
  File "/opt/homebrew/lib/python3.10/site-packages/PyInstaller/__main__.py", line 180, in run
    run_build(pyi_config, spec_file, **vars(args))
  File "/opt/homebrew/lib/python3.10/site-packages/PyInstaller/__main__.py", line 61, in run_build
    PyInstaller.building.build_main.main(pyi_config, spec_file, **kwargs)
  File "/opt/homebrew/lib/python3.10/site-packages/PyInstaller/building/build_main.py", line 971, in main
    build(specfile, distpath, workpath, clean_build)
  File "/opt/homebrew/lib/python3.10/site-packages/PyInstaller/building/build_main.py", line 893, in build
    exec(code, spec_namespace)
  File "/Users/me/Documents/foo.git/Foo.spec", line 41, in <module>
    coll = COLLECT(
  File "/opt/homebrew/lib/python3.10/site-packages/PyInstaller/building/api.py", line 892, in __init__
    self.__postinit__()
  File "/opt/homebrew/lib/python3.10/site-packages/PyInstaller/building/datastruct.py", line 173, in __postinit__
    self.assemble()
  File "/opt/homebrew/lib/python3.10/site-packages/PyInstaller/building/api.py", line 926, in assemble
    os.makedirs(todir)
  File "/opt/homebrew/Cellar/[email protected]/3.10.8/Frameworks/Python.framework/Versions/3.10/lib/python3.10/os.py", line 215, in makedirs
    makedirs(head, exist_ok=exist_ok)
  File "/opt/homebrew/Cellar/[email protected]/3.10.8/Frameworks/Python.framework/Versions/3.10/lib/python3.10/os.py", line 225, in makedirs
    mkdir(name, mode)
NotADirectoryError: [Errno 20] Not a directory: '/Users/me/Documents/foo.git/dist/Foo/foo/drivers'

When application includes the following import:

import PySide6.QtQml

Running the frozen application results in the following runtime error:

ImportError: libpyside6qml.abi3.so.6.4: cannot open shared object file: No such file or directory

Context information

• Output of pyinstaller --version: 5.6.1
• Version of Python: 3.10.6
• Platform: Ubuntu 22.04.1, 5.15.0-52-generic
• How you installed Python: apt (included in distro
• Did you also try this on another platform? No
• Latest dev version: Yes, downloaded and tried today, same result

Make sure everything is packaged correctly

• [x] start with clean installation
• [x] use the latest development version
• [x] Run your frozen program from a command window (shell) — instead of double-clicking on it
• [x] Package your program in --onedir mode
• [x] Package without UPX, say: use the option --noupx or set upx=False in your .spec-file
• [x] Repackage you application in verbose/debug mode. For this, pass the option --debug to pyi-makespec or pyinstaller or use EXE(..., debug=1, ...) in your .spec file.

A minimal example program which shows the error

import PySide6.QtQml   # just this one line is needed to reproduce

Stacktrace / full error message

import _frozen_importlib # frozen
import _imp # builtin
import '_thread' # <class '_frozen_importlib.BuiltinImporter'>
import '_warnings' # <class '_frozen_importlib.BuiltinImporter'>
import '_weakref' # <class '_frozen_importlib.BuiltinImporter'>
import '_io' # <class '_frozen_importlib.BuiltinImporter'>
import 'marshal' # <class '_frozen_importlib.BuiltinImporter'>
import 'posix' # <class '_frozen_importlib.BuiltinImporter'>
import '_frozen_importlib_external' # <class '_frozen_importlib.FrozenImporter'>
# installing zipimport hook
import 'time' # <class '_frozen_importlib.BuiltinImporter'>
import 'zipimport' # <class '_frozen_importlib.FrozenImporter'>
# installed zipimport hook
# zipimport: found 161 names in '/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip'
import '_codecs' # <class '_frozen_importlib.BuiltinImporter'>
import 'codecs' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/">
import 'encodings.aliases' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/encodings/">
import 'encodings' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/">
import 'encodings.utf_8' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/encodings/">
import '_signal' # <class '_frozen_importlib.BuiltinImporter'>
import '_abc' # <class '_frozen_importlib.BuiltinImporter'>
import 'abc' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/">
import 'io' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/">
import '_struct' # <class '_frozen_importlib.BuiltinImporter'>
import 'zlib' # <class '_frozen_importlib.BuiltinImporter'>
import '_stat' # <class '_frozen_importlib.BuiltinImporter'>
import 'stat' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/">
import '_collections_abc' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/">
import 'genericpath' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/">
import 'posixpath' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/">
import 'os' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/">
import 'types' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/">
import 'enum' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/">
import '_sre' # <class '_frozen_importlib.BuiltinImporter'>
import 'sre_constants' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/">
import 'sre_parse' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/">
import 'sre_compile' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/">
import 'itertools' # <class '_frozen_importlib.BuiltinImporter'>
import 'keyword' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/">
import '_operator' # <class '_frozen_importlib.BuiltinImporter'>
import 'operator' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/">
import 'reprlib' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/">
import '_collections' # <class '_frozen_importlib.BuiltinImporter'>
import 'collections' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/">
import '_functools' # <class '_frozen_importlib.BuiltinImporter'>
import 'functools' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/">
import '_locale' # <class '_frozen_importlib.BuiltinImporter'>
import 'copyreg' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/">
import 're' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/">
import 'fnmatch' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/">
import 'ntpath' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/">
import 'warnings' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/">
import 'errno' # <class '_frozen_importlib.BuiltinImporter'>
import 'urllib' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/">
import 'urllib.parse' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/urllib/">
import 'pathlib' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/">
import 'token' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/">
import 'tokenize' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/">
# PyInstaller: FrozenImporter(/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/test?65843)
# ctypes not found in PYZ
import inspect # PyInstaller PYZ
import ast # PyInstaller PYZ
import '_ast' # <class '_frozen_importlib.BuiltinImporter'>
import contextlib # PyInstaller PYZ
import 'contextlib' # <pyimod02_importers.FrozenImporter object at 0x7fb4a93dc640>
import 'ast' # <pyimod02_importers.FrozenImporter object at 0x7fb4a93dc640>
import dis # PyInstaller PYZ
import opcode # PyInstaller PYZ
# _opcode not found in PYZ
# extension module '_opcode' loaded from '/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so'
# extension module '_opcode' executed from '/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so'
import '_opcode' # <_frozen_importlib_external.ExtensionFileLoader object at 0x7fb4a921a290>
import 'opcode' # <pyimod02_importers.FrozenImporter object at 0x7fb4a93dc640>
import 'dis' # <pyimod02_importers.FrozenImporter object at 0x7fb4a93dc640>
# collections.abc not found in PYZ
import 'collections.abc' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/collections/">
import importlib # PyInstaller PYZ
import 'importlib' # <pyimod02_importers.FrozenImporter object at 0x7fb4a93dc640>
import importlib.machinery as importlib.machinery # PyInstaller PYZ (__path__ override: importlib)
import 'importlib.machinery' # <pyimod02_importers.FrozenImporter object at 0x7fb4a93dc640>
# linecache not found in PYZ
import 'linecache' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/">
import 'inspect' # <pyimod02_importers.FrozenImporter object at 0x7fb4a93dc640>
import subprocess # PyInstaller PYZ
import signal # PyInstaller PYZ
import 'signal' # <pyimod02_importers.FrozenImporter object at 0x7fb4a93dc640>
import threading # PyInstaller PYZ
# _weakrefset not found in PYZ
import '_weakrefset' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/">
import 'threading' # <pyimod02_importers.FrozenImporter object at 0x7fb4a93dc640>
import 'fcntl' # <class '_frozen_importlib.BuiltinImporter'>
# msvcrt not found in PYZ
import '_posixsubprocess' # <class '_frozen_importlib.BuiltinImporter'>
import 'select' # <class '_frozen_importlib.BuiltinImporter'>
import selectors # PyInstaller PYZ
import 'math' # <class '_frozen_importlib.BuiltinImporter'>
import 'selectors' # <pyimod02_importers.FrozenImporter object at 0x7fb4a93dc640>
import 'subprocess' # <pyimod02_importers.FrozenImporter object at 0x7fb4a93dc640>
import PySide6 # PyInstaller PYZ
import textwrap # PyInstaller PYZ
import 'textwrap' # <pyimod02_importers.FrozenImporter object at 0x7fb4a93dc640>
import shiboken6 # PyInstaller PYZ
import zipfile # PyInstaller PYZ
import 'binascii' # <class '_frozen_importlib.BuiltinImporter'>
import importlib.util as importlib.util # PyInstaller PYZ (__path__ override: importlib)
import importlib._abc as importlib._abc # PyInstaller PYZ (__path__ override: importlib)
import 'importlib._abc' # <pyimod02_importers.FrozenImporter object at 0x7fb4a93dc640>
import 'importlib.util' # <pyimod02_importers.FrozenImporter object at 0x7fb4a93dc640>
import shutil # PyInstaller PYZ
import bz2 # PyInstaller PYZ
import _compression # PyInstaller PYZ
import '_compression' # <pyimod02_importers.FrozenImporter object at 0x7fb4a93dc640>
# _bz2 not found in PYZ
# extension module '_bz2' loaded from '/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so'
# extension module '_bz2' executed from '/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so'
import '_bz2' # <_frozen_importlib_external.ExtensionFileLoader object at 0x7fb4a92d2e60>
import 'bz2' # <pyimod02_importers.FrozenImporter object at 0x7fb4a93dc640>
import lzma # PyInstaller PYZ
# _lzma not found in PYZ
# extension module '_lzma' loaded from '/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so'
# extension module '_lzma' executed from '/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so'
import '_lzma' # <_frozen_importlib_external.ExtensionFileLoader object at 0x7fb4a92d34c0>
import 'lzma' # <pyimod02_importers.FrozenImporter object at 0x7fb4a93dc640>
import 'shutil' # <pyimod02_importers.FrozenImporter object at 0x7fb4a93dc640>
import 'zipfile' # <pyimod02_importers.FrozenImporter object at 0x7fb4a93dc640>
import base64 # PyInstaller PYZ
import 'base64' # <pyimod02_importers.FrozenImporter object at 0x7fb4a93dc640>
# traceback not found in PYZ
import 'traceback' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/">
import tempfile # PyInstaller PYZ
import random # PyInstaller PYZ
import bisect # PyInstaller PYZ
import '_bisect' # <class '_frozen_importlib.BuiltinImporter'>
import 'bisect' # <pyimod02_importers.FrozenImporter object at 0x7fb4a93dc640>
import '_random' # <class '_frozen_importlib.BuiltinImporter'>
import '_sha512' # <class '_frozen_importlib.BuiltinImporter'>
import 'random' # <pyimod02_importers.FrozenImporter object at 0x7fb4a93dc640>
# weakref not found in PYZ
import 'weakref' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/">
import 'tempfile' # <pyimod02_importers.FrozenImporter object at 0x7fb4a93dc640>
import typing # PyInstaller PYZ
import 'typing' # <pyimod02_importers.FrozenImporter object at 0x7fb4a93dc640>
# shiboken6.Shiboken not found in PYZ
# numpy not found in PYZ
import 'xxsubtype' # <class '_frozen_importlib.BuiltinImporter'>
# encodings.cp437 not found in PYZ
import 'encodings.cp437' # <zipimporter object "/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/base_library.zip/encodings/">
import 'shibokensupport' # <signature_bootstrap.EmbeddableZipImporter object at 0x7fb4a9162230>
import 'shibokensupport.signature' # <signature_bootstrap.EmbeddableZipImporter object at 0x7fb4a9162230>
import 'shibokensupport.feature' # <signature_bootstrap.EmbeddableZipImporter object at 0x7fb4a9162230>
import 'shibokensupport.signature.mapping' # <signature_bootstrap.EmbeddableZipImporter object at 0x7fb4a9162230>
import 'shibokensupport.signature.errorhandler' # <signature_bootstrap.EmbeddableZipImporter object at 0x7fb4a9162230>
import 'shibokensupport.signature.layout' # <signature_bootstrap.EmbeddableZipImporter object at 0x7fb4a9162230>
import 'shibokensupport.signature.lib' # <signature_bootstrap.EmbeddableZipImporter object at 0x7fb4a9162230>
import 'shibokensupport.signature.lib.tool' # <signature_bootstrap.EmbeddableZipImporter object at 0x7fb4a9162230>
import 'shibokensupport.signature.parser' # <signature_bootstrap.EmbeddableZipImporter object at 0x7fb4a9162230>
# PySide6.support not found in PYZ
import 'shibokensupport.signature.importhandler' # <signature_bootstrap.EmbeddableZipImporter object at 0x7fb4a9162230>
import 'shibokensupport.signature.lib.enum_sig' # <signature_bootstrap.EmbeddableZipImporter object at 0x7fb4a9162230>
import argparse # PyInstaller PYZ
import gettext # PyInstaller PYZ
import 'gettext' # <pyimod02_importers.FrozenImporter object at 0x7fb4a93dc640>
import 'argparse' # <pyimod02_importers.FrozenImporter object at 0x7fb4a93dc640>
import logging # PyInstaller PYZ
import string # PyInstaller PYZ
import '_string' # <class '_frozen_importlib.BuiltinImporter'>
import 'string' # <pyimod02_importers.FrozenImporter object at 0x7fb4a93dc640>
import 'atexit' # <class '_frozen_importlib.BuiltinImporter'>
import 'logging' # <pyimod02_importers.FrozenImporter object at 0x7fb4a93dc640>
# shiboken6.Shiboken not found in PYZ
# extension module 'shiboken6.Shiboken' loaded from '/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/shiboken6/Shiboken.abi3.so'
# extension module 'shiboken6.Shiboken' executed from '/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/shiboken6/Shiboken.abi3.so'
import 'shiboken6.Shiboken' # <_frozen_importlib_external.ExtensionFileLoader object at 0x7fb4a9179a20>
import 'shibokensupport.signature.lib.pyi_generator' # <signature_bootstrap.EmbeddableZipImporter object at 0x7fb4a9162230>
# PySide6.support not found in PYZ
import 'shibokensupport.signature.loader' # <signature_bootstrap.EmbeddableZipImporter object at 0x7fb4a9162230>
# extension module 'shiboken6.Shiboken' loaded from '/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/shiboken6/Shiboken.abi3.so'
# extension module 'shiboken6.Shiboken' executed from '/home/automator/sandbox/pyinstaller-pyside6-testcase/dist/test/shiboken6/Shiboken.abi3.so'
import 'shiboken6.Shiboken' # <_frozen_importlib_external.ExtensionFileLoader object at 0x7fb4a90feaa0>
import 'shiboken6' # <pyimod02_importers.FrozenImporter object at 0x7fb4a93dc640>
import 'PySide6' # <pyimod02_importers.FrozenImporter object at 0x7fb4a93dc640>
# PySide6.QtQml not found in PYZ
Traceback (most recent call last):
  File "test.py", line 1, in <module>
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 674, in _load_unlocked
  File "<frozen importlib._bootstrap>", line 571, in module_from_spec
  File "<frozen importlib._bootstrap_external>", line 1176, in create_module
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
ImportError: libpyside6qml.abi3.so.6.4: cannot open shared object file: No such file or directory
[104115] Failed to execute script 'test' due to unhandled exception!
# (snip)

Description of the issue

This issue is a collection of problems with the app bundles that pyinstall builds for macOS. It is meant to point out things that could easily be fixed and would result in cleaner, actually usable app bundles:

1. removing all RPATH entries is not what you want to do

• it seems like the right thing to do but you really only want to remove absolute RPATHs (not pointing to system libraries) and convert them to @rpath relatives
• this goes for all dependencies off all binary python modules as well as the interpreter and wrapper itself

2. @executable_path/../Frameworks and optionally @executable_path should be added via install_name_tool -add_rpath

• this plays together with the point 1) as it allows the dynamic linker to look in the executable's directory as well as in the relative Frameworks directory and actually find dylibs there. What currently happens if you have a binary module that tries to load a dependency dynamically at runtime is that the frozen app will crash as there are no known paths to look for that dependency and dyld does not look in the current directory by default.

3. Contents/MacOS should contain only binaries and symlinks

• this mainly concerns apps that want to be notarised (most macOS apps these days) or be listed in the Mac AppStore
• it's consistent with the bundle layout for most native apps

4. (after 3 is implemented) the PyInstall bootstrapper needs to set PYTHONPATH to include @executable_dir/../Frameworks

• this step would remove the requirement to symlink directories and .so files from ../Frameworks back to the bin directory

Here's a comparison of the layout of a simply PyInstaller Qt6 bundle and a bundle modified to include the suggested changes:

• plain PyInstaller output:

qt6demo2.app/Contents qt6demo2.app/Contents/Frameworks qt6demo2.app/Contents/Info.plist qt6demo2.app/Contents/MacOS qt6demo2.app/Contents/MacOS/PySide6 ... [all of PySide6's contents] qt6demo2.app/Contents/MacOS/Python qt6demo2.app/Contents/MacOS/QtCore qt6demo2.app/Contents/MacOS/QtDBus qt6demo2.app/Contents/MacOS/QtGui qt6demo2.app/Contents/MacOS/QtNetwork qt6demo2.app/Contents/MacOS/QtOpenGL qt6demo2.app/Contents/MacOS/QtQml qt6demo2.app/Contents/MacOS/QtQmlModels qt6demo2.app/Contents/MacOS/QtQuick qt6demo2.app/Contents/MacOS/QtSvg qt6demo2.app/Contents/MacOS/QtVirtualKeyboard qt6demo2.app/Contents/MacOS/QtWidgets qt6demo2.app/Contents/MacOS/base_library.zip -> ../Resources/base_library.zip qt6demo2.app/Contents/MacOS/lib-dynload qt6demo2.app/Contents/MacOS/lib-dynload/_bisect.cpython-310-darwin.so ... [all of Python's native module so files] qt6demo2.app/Contents/MacOS/lib-dynload/zlib.cpython-310-darwin.so qt6demo2.app/Contents/MacOS/libcrypto.1.1.dylib qt6demo2.app/Contents/MacOS/liblzma.5.dylib qt6demo2.app/Contents/MacOS/libmpdec.2.5.1.dylib qt6demo2.app/Contents/MacOS/libpyside6.abi3.6.3.dylib qt6demo2.app/Contents/MacOS/libshiboken6.abi3.6.3.dylib qt6demo2.app/Contents/MacOS/libssl.1.1.dylib qt6demo2.app/Contents/MacOS/qt6demo2 qt6demo2.app/Contents/MacOS/shiboken6 qt6demo2.app/Contents/MacOS/shiboken6/Shiboken.abi3.so qt6demo2.app/Contents/Resources qt6demo2.app/Contents/Resources/base_library.zip qt6demo2.app/Contents/Resources/icon-windowed.icns qt6demo2.app/Contents/_CodeSignature qt6demo2.app/Contents/_CodeSignature/CodeResources

$ otool -l qt6demo2.app/Contents/MacOS/qt6demo2 | grep -b3 RPATH
<empty>
$ otool -l qt6demo2.app/Contents/MacOS/Python | grep -b3 RPATH
12194-      current version 1311.100.3
12227-compatibility version 1.0.0
12255-Load command 14
12271:          cmd LC_RPATH
12294-      cmdsize 32
12311-         path /opt/homebrew/lib (offset 12)
12355-Load command 15

• same bundle but with fixed locations for shared libraries and runtime data + fixed rpaths:

qt6demo2.app qt6demo2.app/Contents qt6demo2.app/Contents/Frameworks qt6demo2.app/Contents/Frameworks/PySide6 ... [all of PySide6's contents] qt6demo2.app/Contents/Frameworks/lib-dynload qt6demo2.app/Contents/Frameworks/lib-dynload/_bisect.cpython-310-darwin.so ... [all of Python's native module so files] qt6demo2.app/Contents/Frameworks/lib-dynload/_blake2.cpython-310-darwin.so qt6demo2.app/Contents/Frameworks/libcrypto.1.1.dylib qt6demo2.app/Contents/Frameworks/liblzma.5.dylib qt6demo2.app/Contents/Frameworks/libmpdec.2.5.1.dylib qt6demo2.app/Contents/Frameworks/libpyside6.abi3.6.3.dylib qt6demo2.app/Contents/Frameworks/libshiboken6.abi3.6.3.dylib qt6demo2.app/Contents/Frameworks/libssl.1.1.dylib qt6demo2.app/Contents/Frameworks/shiboken6 qt6demo2.app/Contents/Frameworks/shiboken6/Shiboken.abi3.so qt6demo2.app/Contents/Info.plist qt6demo2.app/Contents/MacOS qt6demo2.app/Contents/MacOS/qt6demo2 qt6demo2.app/Contents/MacOS/PySide6 -> ../Frameworks/PySide6 qt6demo2.app/Contents/MacOS/Python qt6demo2.app/Contents/MacOS/base_library.zip -> ../Resources/base_library.zip qt6demo2.app/Contents/MacOS/lib-dynload -> ../Frameworks/lib-dynload qt6demo2.app/Contents/MacOS/shiboken6 -> ../Frameworks/shiboken6 qt6demo2.app/Contents/Resources qt6demo2.app/Contents/Resources/base_library.zip qt6demo2.app/Contents/Resources/icon-windowed.icns qt6demo2.app/Contents/_CodeSignature qt6demo2.app/Contents/_CodeSignature/CodeDirectory qt6demo2.app/Contents/_CodeSignature/CodeRequirements qt6demo2.app/Contents/_CodeSignature/CodeRequirements-1 qt6demo2.app/Contents/_CodeSignature/CodeResources qt6demo2.app/Contents/_CodeSignature/CodeSignature

$ otool -l qt6demo2.app/Contents/MacOS/qt6demo2 | grep -b3 RPATH
6641-  dataoff 970848
6658- datasize 25888
6674-Load command 22
6690:          cmd LC_RPATH
6713-      cmdsize 32
6730-         path @executable_path (offset 12)
6773-Load command 23
6789:          cmd LC_RPATH
6812-      cmdsize 48
6829-         path @executable_path/../Frameworks/ (offset 12)

$ otool -l qt6demo2.app/Contents/MacOS/qt6demo2 | grep -b3 RPATH
12407-      current version 1311.100.3
12440-compatibility version 1.0.0
12468-Load command 14
12484:          cmd LC_RPATH
12507-      cmdsize 32
12524-         path /opt/homebrew/lib (offset 12)
12568-Load command 15
--
12801-  dataoff 3609200
12819- datasize 46480
12835-Load command 18
12851:          cmd LC_RPATH
12874-      cmdsize 32
12891-         path @executable_path (offset 12)
12934-Load command 19
12950:          cmd LC_RPATH
12973-      cmdsize 48
12990-         path @executable_path/../Frameworks/ (offset 12)

And a simple bash script that shows the applied changes (which could be done by PyInstaller in the first place), not including PYTHONPATH:

 #!/bin/zsh

if [ ! -d "$1" ] then
    echo "usage: fix-py-bundle.sh <app-bundle>" >&2
   exit 1
fi

WRAPPER_NAME="$(basename $1 .app)"

pushd "$1" > /dev/null

   # move any shared objects and other dependencies to Frameworks
    find Contents/MacOS/ -iname '*.dylib' -mindepth 0 -maxdepth 1 -exec mv '{}' Contents/Frameworks/ ';'
    find Contents/MacOS/ -iname '*.so'    -mindepth 0 -maxdepth 1 -exec mv '{}' Contents/Frameworks/ ';'
    find Contents/MacOS/ -name 'Qt*'     -mindepth 0 -maxdepth 1 -exec mv '{}' Contents/Frameworks/ ';'
    find Contents/MacOS/ -type d          -mindepth 1 -maxdepth 1 -exec mv '{}' Contents/Frameworks/ ';'
 
   # add the missing rpath entries to actually look in Frameworks for shared objects
    install_name_tool -add_rpath '@executable_path' "Contents/MacOS/$WRAPPER_NAME"
    install_name_tool -add_rpath '@executable_path' Contents/MacOS/Python
    install_name_tool -add_rpath '@executable_path/../Frameworks/' "Contents/MacOS/$WRAPPER_NAME"
    install_name_tool -add_rpath '@executable_path/../Frameworks/' Contents/MacOS/Python

   # create symlinks for all directories that got moved to Frameworks since we don't have influence on
   # PYTHONPATH (would not be needed if it contained @executable_path/../Frameworks as well)
    pushd Contents/MacOS/ > /dev/null
    find ../Frameworks/ -type d -mindepth 1 -maxdepth 1 -exec ln -s '{}' . ';'
    popd  > /dev/null

    # refresh the ad-hoc signature (could our actual signing profile here..)
    codesign -s - -f --deep .
popd > /dev/null

I would have gladly tried to provide a PR with all of this but attempting to build PyInstaller on macOS is a hot mess ^^'.

Context information (for bug reports)

• Output of pyinstaller --version: 5.6.1
• Version of Python: 3.10.6
• Platform: OS X
• How you installed Python: brew
• Did you also try this on another platform? Does it work there? - not relevant