Hello!

C:\Users\ipetrash\Desktop\PyScripts\hideme.ru-proxy-list>pipreqs C:\Users\ipetrash\Desktop\PyScripts\hideme.ru-proxy-list
Traceback (most recent call last):
  File "C:\Python34\lib\runpy.py", line 170, in _run_module_as_main
    "__main__", mod_spec)
  File "C:\Python34\lib\runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "C:\Python34\Scripts\pipreqs.exe\__main__.py", line 9, in <module>
  File "C:\Python34\lib\site-packages\pipreqs\pipreqs.py", line 178, in main
    init(args)
  File "C:\Python34\lib\site-packages\pipreqs\pipreqs.py", line 157, in init
    local = get_import_local(candidates)
  File "C:\Python34\lib\site-packages\pipreqs\pipreqs.py", line 112, in get_import_local
    local = get_locally_installed_packages()
  File "C:\Python34\lib\site-packages\pipreqs\pipreqs.py", line 105, in get_locally_installed_packages
    'version': package[1].replace(".dist", ""),
IndexError: list index out of range

Used for: https://github.com/gil9red/hideme.ru-proxy-list

Sincerely yours, gil9red

Added new option "dynamic", for dynamic versioning.

Example: wheel==0.23.0

There will be 3 possible args for this option, micro, minor or all. The result in requirements.txt will be as below.

• wheel==0.23.* (micro)
• wheel==0.* (minor)
• wheel (all)

This will enable more targeted installations, esp if one is only looking at bug fixes, security patches or minor/micro version updates, or simply just install most recent updates.

--no-pin option is merged within this new option as the "all" arg.

@jcch94

I just installed pipreqs for the first time. This is what it does:

$ pipreqs $(pwd)
Traceback (most recent call last):
  File "/Users/tillmann/dev/textSum/.direnv/python-3.8.3/bin/pipreqs", line 10, in <module>
    sys.exit(main())
  File "/Users/tillmann/dev/textSum/.direnv/python-3.8.3/lib/python3.8/site-packages/pipreqs/pipreqs.py", line 470, in main
    init(args)
  File "/Users/tillmann/dev/textSum/.direnv/python-3.8.3/lib/python3.8/site-packages/pipreqs/pipreqs.py", line 406, in init
    candidates = get_all_imports(input_path,
  File "/Users/tillmann/dev/textSum/.direnv/python-3.8.3/lib/python3.8/site-packages/pipreqs/pipreqs.py", line 122, in get_all_imports
    contents = f.read()
  File "/usr/local/bin/../Cellar/[email protected]/3.8.3_2/bin/../Frameworks/Python.framework/Versions/3.8/lib/python3.8/codecs.py", line 322, in decode
    (result, consumed) = self._buffer_decode(data, self.errors, final)
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xb1 in position 81: invalid start byte

Am I doing something wrong?

$ neofetch           
                    'c.          [email protected] 
                 ,xNMM.          -------------------- 
               .OMMMMo           OS: macOS Catalina 10.15.5 19F101 x86_64 
               OMMM0,            Host: MacBookPro15,1 
     .;loddo:' loolloddol;.      Kernel: 19.5.0 
   cKMMMMMMMMMMNWMMMMMMMMMM0:    Uptime: 17 days, 14 hours, 5 mins 
 .KMMMMMMMMMMMMMMMMMMMMMMMWd.    Packages: 115 (brew) 
 XMMMMMMMMMMMMMMMMMMMMMMMX.      Shell: zsh 5.7.1 
;MMMMMMMMMMMMMMMMMMMMMMMM:       Resolution: [email protected], [email protected], [email protected] 
:MMMMMMMMMMMMMMMMMMMMMMMM:       DE: Aqua 
.MMMMMMMMMMMMMMMMMMMMMMMMX.      WM: Quartz Compositor 
 kMMMMMMMMMMMMMMMMMMMMMMMMWd.    WM Theme: Blue (Light) 
 .XMMMMMMMMMMMMMMMMMMMMMMMMMMk   Terminal: Apple_Terminal 
  .XMMMMMMMMMMMMMMMMMMMMMMMMK.   Terminal Font: HackNerdFontComplete-Regular 
    kMMMMMMMMMMMMMMMMMMMMMMd     CPU: Intel i7-8850H (12) @ 2.60GHz 
     ;KMMMMMMMWXXWMMMMMMMk.      GPU: Intel UHD Graphics 630, Radeon Pro 560X 
       .cooc,.    .,coo:.        Memory: 10080MiB / 16384MiB 
$ python -V                      
Python 3.8.3

I develop this project: https://github.com/tuwien-musicir/rp_extract

As you can see from the imports it uses a lot of libraries (numpy, scipy, matplotlib, argparse, unicsv, cPickle, sklearn, ...) - many of which are missed by pipreqs:

pipreqs --debug --force . DEBUG: Found packages: set(['argparse', 'cPickle', 'uuid', 'tempfile', 'numpy', 'pylab', 'matplotlib', 'wave', 'sys', 'subprocess', 'os', 'sklearn']) DEBUG: Found imports: matplotlib, numpy, matplotlib, scikit_learn DEBUG: Getting packages information from Local/PyPI INFO: Starting new HTTPS connection (1): pypi.python.org DEBUG: Setting read timeout to None DEBUG: "GET /pypi/numpy/json HTTP/1.1" 200 65657 INFO: Starting new HTTPS connection (1): pypi.python.org DEBUG: Setting read timeout to None DEBUG: "GET /pypi/scikit_learn/json HTTP/1.1" 301 0 DEBUG: Setting read timeout to None DEBUG: "GET /pypi/scikit-learn/json HTTP/1.1" 200 102410 DEBUG: Writing 4 requirements: matplotlib, matplotlib, numpy, scikit_learn to ./requirements.txt INFO: Successfully saved requirements file in ./requirements.txt [email protected]:~/rp_extract$ cat requirements.txt matplotlib == 1.3.1.egg matplotlib == 1.3.1.egg numpy == 1.10.1 scikit_learn == 0.17

Why does it miss many of the library requirements? (some of them are even mentioned in the debug output, some are not, e.g. scipy, unicsv) (and matplotlib on the other hand is put twice into the requirements.txt)

I installed pipreqs using pip install pipreqs within my local virtualenv and then executed it, got this error:

~/code % pipreqs web
Looking for imports
Traceback (most recent call last):
  File "/home/satiani/code/web/venv/bin/pipreqs", line 8, in <module>
    load_entry_point('pipreqs==0.1.8', 'console_scripts', 'pipreqs')()
  File "/home/satiani/code/web/venv/local/lib/python2.7/site-packages/pipreqs/pipreqs.py", line 109, in main
    init(args)
  File "/home/satiani/code/web/venv/local/lib/python2.7/site-packages/pipreqs/pipreqs.py", line 92, in init
    imports = get_all_imports(args['<path>'])
  File "/home/satiani/code/web/venv/local/lib/python2.7/site-packages/pipreqs/pipreqs.py", line 62, in get_all_imports
    with open(os.path.join(os.path.dirname(__file__), "stdlib"), "r") as f:
IOError: [Errno 2] No such file or directory: '/home/satiani/code/web/venv/local/lib/python2.7/site-packages/pipreqs/stdlib'
zsh: exit 1     pipreqs web

When I try to run the pipreqs from cli, I got ther is no command found. I miss something? The installation process and the usage is jus this:

$ pip install pipreqs
$ pipreqs [path/to/project]

For example, to import beautifulsoup4 package, it should be import bs4. So pipreqs cannot find the beautifulsoup4 package from pypi server. I don't have an idea to resolve this problem... :(

pipreqs fails on python files which have blank lines at the beginning of the file.

System:

• Python 3.6.8
• 16.04.1-Ubuntu
• pipreqs 0.4.10

Stacktrace:

ERROR: Failed on file: /home/test/file.py
Traceback (most recent call last):
  File "/usr/local/bin/pipreqs", line 10, in <module>
    sys.exit(main())
  File "/usr/local/lib/python3.6/dist-packages/pipreqs/pipreqs.py", line 470, in main
    init(args)
  File "/usr/local/lib/python3.6/dist-packages/pipreqs/pipreqs.py", line 409, in init
    follow_links=follow_links)
  File "/usr/local/lib/python3.6/dist-packages/pipreqs/pipreqs.py", line 138, in get_all_imports
    raise exc
  File "/usr/local/lib/python3.6/dist-packages/pipreqs/pipreqs.py", line 124, in get_all_imports
    tree = ast.parse(contents)
  File "/usr/lib/python3.6/ast.py", line 35, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 1
    
    ^
SyntaxError: invalid character in identifier

Is there a way to output >= instead of == in requirements.txt?

pygsheets>=1.1.3
retrying>=1.3.3

Instead of

pygsheets==1.1.3
retrying==1.3.3

Thanks!

A freshly installed pipreqs (in a venv) crashes on pylint source (in a venv in my case)

Offending line is: https://bitbucket.org/logilab/pylint/src/cc5990f6a12a467d09567bfc1b210ba999f6cb13/pylint/test/functional/unused_import.py?at=default#cl-3

~/src/c3 $ pipreqs .
Traceback (most recent call last):
  File "/home/koert/src/c3/.ve2/bin/pipreqs", line 11, in <module>
    sys.exit(main())
  File "/home/koert/src/c3/.ve2/local/lib/python2.7/site-packages/pipreqs/pipreqs.py", line 167, in main
    init(args)
  File "/home/koert/src/c3/.ve2/local/lib/python2.7/site-packages/pipreqs/pipreqs.py", line 139, in init
    candidates = get_all_imports(args['<path>'])
  File "/home/koert/src/c3/.ve2/local/lib/python2.7/site-packages/pipreqs/pipreqs.py", line 48, in get_all_imports
    res = map(get_name_without_alias, item.split(","))
  File "/home/koert/src/c3/.ve2/local/lib/python2.7/site-packages/pipreqs/pipreqs.py", line 130, in get_name_without_alias
    name = REGEXP[0].match(name.strip()).groups(0)[0]
AttributeError: 'NoneType' object has no attribute 'groups'
~/src/c3 $ pip freeze
docopt==0.6.2
pipreqs==0.2.4
requests==2.7.0
yarg==0.1.9

I'm using Facebook hydra-core package (see Hydra.cc). But this package is not correctly handled because of another package with the same name (hydra - the python bloom filter).

Example

# content of my.py, the only file in my dir to show the behavior with pipreqs
import hydra

if __name__ == "__main__":
    print(hydra.__version__)

Case 1:

Only hydra-core is locally installed

# Name Version Build Channel hydra-core 1.0.6 pypi_0 pypi

Then output of pipreqs --print is:

hydra_core==1.0.6
hydra==2.5
INFO: Successfully output requirements

And output of pipreqs --print --use-local is:

hydra_core==1.0.6
INFO: Successfully output requirements

Case 2:

When both hydra-core and hydra are installed (this easily happens to anyone using fb hydra-core package because of accidentally using pip install hydra instead of pip install hydra-core), then for both commands (with and without --use-local flag) the output is following:

Hydra==2.5
INFO: Successfully output requirements

Question

I was thinking about updating mapping with a line of hydra:hydra-core (similarly to https://github.com/bndr/pipreqs/pull/234). Is that the right way how to deal with this issue? I was just a bit wondering about this since the behavior described above was quite strange to me (I was also confused with e.g. why hydra starts sometimes with capital letter and sometimes not).

Environment

Python 3.8.6 pipreqs 0.4.10

Bumps wheel from 0.23.0 to 0.38.1.

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Is there a way to include additional packages in the requirements.txt file that are not imported into the project? For example, including pipreqs in the outputted requirements.txt.

Thanks!

Hi, when I do this command : pipreqs --encoding=utf8 --force . I have this error : 'utf-8' codec can't decode byte 0xf6 in position 122: invalid start byte. I tried without the encoding, and I have the charmap error. i tried with utf16, other error. Do you know why ?

Hi,

i'm actually using pipreqs to generate a requirements.in file and then use pip-tools on it.

My issue is that using pipreqs --savepath requirements.in is overwriting my existing requirements.in file, even if i do not use the --force option.

Any idea why this is happening? Is there a way to just append the new requirements pipreqs finds without overwriting the existing ones? (Some i added by hand, so they get deleted everytime).

This does not happen when using pipreqs to generate the "default" requirements.txt, so the issue is only when specifying a custom file name with --savepath.

Thank you.