When the process loop raised an exception it would bubble through into the cleanup which would prevent the disconnect callback from being fired. In this case it was UnicodeDecodeError from a bad name in advertisment. We now handle unicode decode errors by replacing invalid utf-8 and catch the exception so it does not prevent the disconnected callback from running

seen https://github.com/home-assistant/core/pull/83888#issuecomment-1347670905

We still have a bit of latency with the reader because we have to lock and unlock every loop. Once we have finished the handshake (noise only) we hold the read lock for the duration of the connection to avoid locking/unlocking on every read

Traceback (most recent call last): File "C:\Users\Administrator\aio\aio\lib\site-packages\aioesphomeapi\client.py", line 176, in connect await self._connection.connect() File "C:\Users\Administrator\aio\aio\lib\site-packages\aioesphomeapi\connection.py", line 157, in connect self._socket_reader, self._socket_writer = await asyncio.open_connection( File "C:\Users\Administrator\AppData\Local\Programs\Python\Python38\lib\asyncio\streams.py", line 52, in open_connection transport, _ = await loop.create_connection( File "C:\Users\Administrator\AppData\Local\Programs\Python\Python38\lib\asyncio\base_events.py", line 1047, in create_connection raise ValueError( ValueError: A Stream Socket was expected, got <socket.socket fd=592, family=AddressFamily.AF_INET, type=0, proto=6, laddr=('192.168.2.4', 32149), raddr=('192.168.2.25', 6053)> The above exception was the direct cause of the following exception: Traceback (most recent call last): File "t.py", line 24, in <module> loop.run_until_complete(main()) File "C:\Users\Administrator\AppData\Local\Programs\Python\Python38\lib\asyncio\base_events.py", line 616, in run_until_complete return future.result() File "t.py", line 10, in main await api.connect(login=True) File "C:\Users\Administrator\aio\aio\lib\site-packages\aioesphomeapi\client.py", line 184, in connect raise APIConnectionError( aioesphomeapi.core.APIConnectionError: Unexpected error while connecting to 192.168.2.25: A Stream Socket was expected, got <socket.socket fd=592, family=AddressFamily.AF_INET, type=0, proto=6, laddr=('192.168.2.4', 32149), raddr=('192.168.2.25', 6053)>

After replacing, in line 132 of connection.py

self._socket = socket.socket( family=addr.family, type=addr.type, proto=addr.proto )

with

self._socket = socket.socket(socket.AF_INET, socket.SOCK_STREAM)

The problem is fixed.

Update esphome climate schema to be in sync with HA climate schema, intended to be backward compatible, so migration can happen incrementally. This PR is part of a bundle, as aioesphomeapi, HA esphome component also needs to change. Other relate PRs:

• https://github.com/esphome/esphome/pull/1471
• https://github.com/home-assistant/core/pull/48116

Similar to #26

Avoids executor overload at statup with lots of esphome devices

2021-09-17 07:34:00 DEBUG (MainThread) [homeassistant.util.executor] Calling executor with function: <function getaddrinfo at 0x7f96b7915a60>, args: (192.168.107.189, 6053, 0, 0, 6, 0), kwargs: {} 2021-09-17 07:34:00 DEBUG (MainThread) [homeassistant.util.executor] Calling executor with function: <function getaddrinfo at 0x7f96b7915a60>, args: (192.168.107.248, 6053, 0, 0, 6, 0), kwargs: {} 2021-09-17 07:34:00 DEBUG (MainThread) [homeassistant.util.executor] Calling executor with function: <function getaddrinfo at 0x7f96b7915a60>, args: (192.168.107.234, 6053, 0, 0, 6, 0), kwargs: {} 2021-09-17 07:34:00 DEBUG (MainThread) [homeassistant.util.executor] Calling executor with function: <function getaddrinfo at 0x7f96b7915a60>, args: (192.168.107.206, 6053, 0, 0, 6, 0), kwargs: {} 2021-09-17 07:34:00 DEBUG (MainThread) [homeassistant.util.executor] Calling executor with function: <function getaddrinfo at 0x7f96b7915a60>, args: (192.168.107.220, 6053, 0, 0, 6, 0), kwargs: {} 2021-09-17 07:34:00 DEBUG (MainThread) [homeassistant.util.executor] Calling executor with function: <function getaddrinfo at 0x7f96b7915a60>, args: (192.168.107.61, 6053, 0, 0, 6, 0), kwargs: {} 2021-09-17 07:34:00 DEBUG (MainThread) [homeassistant.util.executor] Calling executor with function: <function getaddrinfo at 0x7f96b7915a60>, args: (192.168.107.133, 6053, 0, 0, 6, 0), kwargs: {} 2021-09-17 07:34:00 DEBUG (MainThread) [homeassistant.util.executor] Calling executor with function: <function getaddrinfo at 0x7f96b7915a60>, args: (192.168.107.3, 6053, 0, 0, 6, 0), kwargs: {} 2021-09-17 07:34:00 DEBUG (MainThread) [homeassistant.util.executor] Calling executor with function: <function getaddrinfo at 0x7f96b7915a60>, args: (192.168.107.203, 6053, 0, 0, 6, 0), kwargs: {} 2021-09-17 07:34:00 DEBUG (MainThread) [homeassistant.util.executor] Calling executor with function: <function getaddrinfo at 0x7f96b7915a60>, args: (192.168.107.178, 6053, 0, 0, 6, 0), kwargs: {} 2021-09-17 07:34:00 DEBUG (MainThread) [homeassistant.util.executor] Calling executor with function: <function getaddrinfo at 0x7f96b7915a60>, args: (192.168.107.173, 6053, 0, 0, 6, 0), kwargs: {} 2021-09-17 07:34:00 DEBUG (MainThread) [homeassistant.util.executor] Calling executor with function: <function getaddrinfo at 0x7f96b7915a60>, args: (192.168.106.243, 6053, 0, 0, 6, 0), kwargs: {} 2021-09-17 07:34:00 DEBUG (MainThread) [homeassistant.util.executor] Calling executor with function: <function getaddrinfo at 0x7f96b7915a60>, args: (192.168.107.170, 6053, 0, 0, 6, 0), kwargs: {}

I'm trying to use aioesphomeapi from a Python program to drive some leds with fastled. The aim is to choose which color on which led i wanna to turn on. I was thinking of sending an array like this one : [ n_led, color_r, color_b, color_g , n_led_next, color_r, color_b, color_g ... ] I'm confuse on how to do that, I try to read the documentation but i do not understand on how to add an argument on a call from aiesphomeapi and what to add on the YAML for my ESP.

Can somebody have an example or explain to me how to do it ?

Thanks

To further reduce the pressure on the esp, we want to read and drain the buffer as fast as possible, and since we have to wait to read while the data is processing we want the read loop to read as much as possible first to keep the latency down and reduce the memory pressure on the esp.

The default timeouts were shorter than the timeout used by bleak and the surrounding stack which could lead to unexplained timeout failures.

fixes #286

home assistant logs "Error doing job: Task was destroyed but it is pending!". also, HA fails to connect to some devices sometimes. after the failure, a few seconds later, it reconnects successfully. I'm not sure they are related. installed HA via pip + virtualenv.

homeassistant              2022.10.3
aioesphomeapi              11.1.0

2022-10-12 11:31:23.830 ERROR (MainThread) [homeassistant] Error doing job: Task was destroyed but it is pending!:   File "/usr/home/hass/hass/.tox/python/bin/hass", line 10, in <module>
    sys.exit(main())                                                                                                                    
  File "/usr/home/hass/hass/.tox/python/lib/python3.9/site-packages/homeassistant/__main__.py", line 191, in main                       
    exit_code = runner.run(runtime_conf)                                                                                                
  File "/usr/home/hass/hass/.tox/python/lib/python3.9/site-packages/homeassistant/runner.py", line 119, in run                          
    return loop.run_until_complete(setup_and_run_hass(runtime_config))                                                                  
  File "/usr/local/lib/python3.9/asyncio/base_events.py", line 634, in run_until_complete                                               
    self.run_forever()                                                                                                                  
  File "/usr/local/lib/python3.9/asyncio/base_events.py", line 601, in run_forever                                                      
    self._run_once()                                                                                                                                                                                                                                                            
  File "/usr/local/lib/python3.9/asyncio/base_events.py", line 1897, in _run_once                                                       
    handle._run()                                                                                                                       
  File "/usr/local/lib/python3.9/asyncio/events.py", line 80, in _run                                                                   
    self._context.run(self._callback, *self._args)                                                                                      
  File "/usr/home/hass/hass/.tox/python/lib/python3.9/site-packages/aioesphomeapi/reconnect_logic.py", line 171, in _reconnect_loop                                                                                                                                             
    await self._reconnect_once()                                    
  File "/usr/home/hass/hass/.tox/python/lib/python3.9/site-packages/aioesphomeapi/reconnect_logic.py", line 166, in _reconnect_once
    await self._try_connect()                                       
  File "/usr/home/hass/hass/.tox/python/lib/python3.9/site-packages/aioesphomeapi/reconnect_logic.py", line 121, in _try_connect
    await self._cli.connect(on_stop=self._on_disconnect, login=True)                                                                    
  File "/usr/home/hass/hass/.tox/python/lib/python3.9/site-packages/aioesphomeapi/client.py", line 240, in connect                      
    await self._connection.connect(login=login)                                                                                         
  File "/usr/home/hass/hass/.tox/python/lib/python3.9/site-packages/aioesphomeapi/connection.py", line 305, in connect                  
    await _do_connect()                                             
  File "/usr/home/hass/hass/.tox/python/lib/python3.9/site-packages/aioesphomeapi/connection.py", line 294, in _do_connect              
    await self._connect_init_frame_helper()                         
  File "/usr/home/hass/hass/.tox/python/lib/python3.9/site-packages/aioesphomeapi/connection.py", line 205, in _connect_init_frame_helper
    asyncio.create_task(self._process_loop())                                                                                           
  File "/usr/local/lib/python3.9/asyncio/tasks.py", line 361, in create_task                                                            
    task = loop.create_task(coro)                                   

I'm encountering this error enumerating the entities of my climate device.

This problem is occurring within Homeassistant as well (see logs).

asyncio funkiness because I'm running in Jupyter.

Successfully installed aioesphomeapi-2.8.0

import nest_asyncio
nest_asyncio.apply()
import aioesphomeapi
import asyncio

async def main():
    """Connect to an ESPHome device and get details."""
    loop = asyncio.get_running_loop()

    # Establish connection
    api = aioesphomeapi.APIClient(loop, "prusa_enclosure.local", 6053, "")
    await api.connect(login=True)

    # Get API version of the device's firmware
    print(api.api_version)

    # Show device details
    device_info = await api.device_info()

    # List all entities of the device
    entities = await api.list_entities_services()
    for entity in entities[0]:
        print(entity)


loop = asyncio.get_event_loop()
loop.run_until_complete(main())

APIVersion(major=1, minor=4)

---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
<ipython-input-2-764d321eea0b> in <module>
     25 
     26 loop = asyncio.get_event_loop()
---> 27 loop.run_until_complete(main())

~/.venv3/lib/python3.9/site-packages/nest_asyncio.py in run_until_complete(self, future)
     68                 raise RuntimeError(
     69                     'Event loop stopped before Future completed.')
---> 70             return f.result()
     71 
     72     def _run_once(self):

/usr/lib/python3.9/asyncio/futures.py in result(self)
    199         self.__log_traceback = False
    200         if self._exception is not None:
--> 201             raise self._exception
    202         return self._result
    203 

/usr/lib/python3.9/asyncio/tasks.py in __step(***failed resolving arguments***)
    254                 # We use the `send` method directly, because coroutines
    255                 # don't have `__iter__` and `__next__` methods.
--> 256                 result = coro.send(None)
    257             else:
    258                 result = coro.throw(exc)

<ipython-input-2-764d321eea0b> in main()
     19 
     20     # List all entities of the device
---> 21     entities = await api.list_entities_services()
     22     for entity in entities[0]:
     23         print(entity)

~/.venv3/lib/python3.9/site-packages/aioesphomeapi/client.py in list_entities_services(self)
    135             for key, _ in attr.fields_dict(cls).items():
    136                 kwargs[key] = getattr(msg, key)
--> 137             entities.append(cls(**kwargs))
    138         return entities, services
    139 

~/.venv3/lib/python3.9/site-packages/aioesphomeapi/model.py in __init__(self, object_id, key, name, unique_id, supports_current_temperature, supports_two_point_target_temperature, supported_modes, visual_min_temperature, visual_max_temperature, visual_temperature_step, supports_away, supports_action, supported_fan_modes, supported_swing_modes)
      7     self.supports_two_point_target_temperature = supports_two_point_target_temperature
      8     if supported_modes is not NOTHING:
----> 9         self.supported_modes = __attr_converter_supported_modes(supported_modes)
     10     else:
     11         self.supported_modes = __attr_converter_supported_modes(__attr_factory_supported_modes())

~/.venv3/lib/python3.9/site-packages/aioesphomeapi/model.py in _convert_climate_modes(value)
    243 
    244 def _convert_climate_modes(value):
--> 245     return [ClimateMode(val) for val in value]
    246 
    247 

~/.venv3/lib/python3.9/site-packages/aioesphomeapi/model.py in <listcomp>(.0)
    243 
    244 def _convert_climate_modes(value):
--> 245     return [ClimateMode(val) for val in value]
    246 
    247 

/usr/lib/python3.9/enum.py in __call__(cls, value, names, module, qualname, type, start)
    358         """
    359         if names is None:  # simple value lookup
--> 360             return cls.__new__(cls, value)
    361         # otherwise, functional API: we're creating a new Enum type
    362         return cls._create_(

/usr/lib/python3.9/enum.py in __new__(cls, value)
    675             ve_exc = ValueError("%r is not a valid %s" % (value, cls.__qualname__))
    676             if result is None and exc is None:
--> 677                 raise ve_exc
    678             elif exc is None:
    679                 exc = TypeError(

ValueError: 6 is not a valid ClimateMode

esphome:
  name: prusa_enclosure
  platform: ESP32
  board: esp32dev

wifi:
  ssid: ""
  password: ""

  # Enable fallback hotspot (captive portal) in case wifi connection fails
  ap:
    ssid: "Prusa Enclosure Fallback Hotspot"
    password: ""

captive_portal:

# Enable logging
logger:

# Enable Home Assistant API
api:

ota:

output:
  - platform: ledc
    pin: GPIO32
    id: fan_output
    frequency: "25kHz"

  - platform: template
    id: fan_output_scaled
    type: float
    write_action:
      - output.set_level:
          id: fan_output
          level: !lambda |-
                 return (state ? state*.55+.20 : 0);

light:
  - platform: monochromatic
    name: "Enclosure fan"
    output: fan_output_scaled
    gamma_correct: 1
    default_transition_length: 0s

  - platform: fastled_clockless
    chipset: WS2812B
    pin: GPIO26
    num_leds: 68
    rgb_order: GRB
    name: "Enclosure light"

sensor:
  - platform: pulse_counter
    pin: GPIO33
    name: 'Fan speed'
    filters:
      - multiply: 0.5
    update_interval: 1s
        
  - platform: dht
    pin: 25
    temperature:
            name: "Enclosure temperature"
            id: "enclosure_temp"
            unit_of_measurement: "°C"
    humidity:
            name: "Enclosure humidity"
    update_interval: 1s
    model: DHT22


climate:
  - platform: pid
    name: "Enclosure PID controller"
    id: pid_enclosure
    sensor: enclosure_temp
    default_target_temperature: 26.00C
    cool_output: fan_output
    control_parameters:
        kp: 0.25000
        ki: 0.00150
        kd: 0.15000


switch:
  - platform: template
    name: "PID Autotune"
    turn_on_action:
      - climate.pid.autotune:
              id: pid_enclosure
              noiseband: 0.10
              negative_output: -75%

2021-06-16 09:15:10 ERROR (MainThread) [homeassistant] Error doing job: Task exception was never retrieved
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/components/esphome/__init__.py", line 214, in on_login
    entity_infos, services = await cli.list_entities_services()
  File "/usr/local/lib/python3.8/site-packages/aioesphomeapi/client.py", line 137, in list_entities_services
    entities.append(cls(**kwargs))
  File "<attrs generated init aioesphomeapi.model.ClimateInfo>", line 9, in __init__
    self.supported_modes = __attr_converter_supported_modes(supported_modes)
  File "/usr/local/lib/python3.8/site-packages/aioesphomeapi/model.py", line 245, in _convert_climate_modes
    return [ClimateMode(val) for val in value]
  File "/usr/local/lib/python3.8/site-packages/aioesphomeapi/model.py", line 245, in <listcomp>
    return [ClimateMode(val) for val in value]
  File "/usr/local/lib/python3.8/enum.py", line 339, in __call__
    return cls.__new__(cls, value)
  File "/usr/local/lib/python3.8/enum.py", line 662, in __new__
    raise ve_exc
ValueError: 6 is not a valid ClimateMode

My ESPHome device publish some logs with log level DEBUG.

If I try to subscribe to the log with subscribe_logs(log_callback, LOG_LEVEL_DEBUG) I receive nothing. Messages are received only with subscribe_logs(log_callback, LOG_LEVEL_VERBOSE) or subscribe_logs(log_callback, LOG_LEVEL_VERY_VERBOSE).

Output example:

level: LOG_LEVEL_VERBOSE
message: "\033[0;36m[D][AirCon:976]: 0001776712: [=>] [BB 00 01 80 01 00 08 00] 1C 27 00 00 00 00 00 00 [1E 58] \033[0m"

There is a string "[D]" in output. It means that message has LOG_LEVEL = DEBUG.

It looks like an incorrect comparison somewhere in the code. "<" instead of "<=" or something like that.

This removes ~ 20k call_soons per minute which translates to a significant latency improvement (also reduces the run time by ~ 18-24%) with 7 ble proxies.

With this change we can refactor a significant number of coroutines into normal functions.

Eliminates:

• read_loop
• process_loop
• queue

Updates the requirements on mock to permit the latest version.

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Bumps actions/cache from 3.0.11 to 3.2.2.

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Bumps isort from 5.11.2 to 5.11.4.

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Bumps pylint from 2.15.8 to 2.15.9.

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Error while reading incoming messages: Invalid preamble 5e 2022-12-13 12:14:38.800 ERROR (MainThread) [homeassistant] Error doing job: Task exception was never retrieved Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/aioesphomeapi/connection.py", line 137, in _do_cleanup await self._process_task File "/usr/local/lib/python3.10/site-packages/aioesphomeapi/connection.py", line 559, in _process_loop msg.ParseFromString(pkt.data) File "/usr/local/lib/python3.10/site-packages/google/protobuf/message.py", line 202, in ParseFromString return self.MergeFromString(serialized) File "/usr/local/lib/python3.10/site-packages/google/protobuf/internal/python_message.py", line 1128, in MergeFromString if self._InternalParse(serialized, 0, length) != length: File "/usr/local/lib/python3.10/site-packages/google/protobuf/internal/python_message.py", line 1178, in InternalParse raise message_mod.DecodeError('Field number 0 is illegal.') google.protobuf.message.DecodeError: Field number 0 is illegal.